Do I really like him?

There's this guy that I've been getting to know lately. We are interested in each other, and we hope to date someday. We've hung out, and have even slept together. He's crazy about me, but I'm not so sure how much I like him...that's the problem. I know I do like him, but it's not as much as I thought it was. I don't get it. At first I was so eager to get to know him, but that eagerness has worn off. I know feelings build over time, but I'm scared they wont. I don't want to give up just yet because of how far we've come, but I just don't know what to do. I don't know what to say to him, cause I don't want to hurt him. I don't know if im just really nervous cause we're at the point of dating, or i was infatuated and now it has worn off. What do i do? Do i end everything, keep going, what? HELP