Yay! Glad things are going your way with the apple boy. I agree with the idea that if he really wants to see you, he'll make the time and the effort to do so. It's cool that you want to ask him out (I give you props, girl! I call myself "old-fashioned" but I think it's just a euphemism for "chicken" in my case.) But I think you should wait until he takes you on at least 3 "proper" dates(involves at least a little planning, not just "hanging out") to ask him out.
Think of it as his reward for his persistant pursuit. He sure will.
__________________
Stop the habit of wishful thinking and start the habit of thoughtful wishes.
Mary Martin