I feel bad I wasn't able to post more the other day, and I'm not sure how useful my advice is, but, from the point of view of being a guy who, when I was looking for a woman to be with, was specifically looking for someone for a committed, long-term relationship (which it sounds like is what this guy is looking for), when I was looking for someone, if it became apparent that the person wasn't interested in that, I would basically just move on. Which is what it seems like he was close to doing the other day.
I mean, the guy flew out there to be with you, is making all the moves and trying to get this to move forward to being a serious relationship. And it seems like (from my understanding of it) that if it's not that, he's not too interested in it otherwise.
Now, obviously I don't know you - or him - or what either of you are looking for. But, from the sounds of it, if you do want to be with him, you're going to need to assure him that you're in this and show a similar level of commitment back to him.
If that's not what you want/what you're looking for, obviously don't just do it because that's what he wants to hear. And I understand you have some other issues with self-confidence and such - talk with him about that stuff! Get it out there, put it all on the table, be up-front and honest with him about what's on your mind. From how it seems, it seems like he would appreciate that. However, indicision and feeling like there's stuff that's not being said seems like what would drive him away.
So, as I said, take that for what it's worth. I could be completely off. I could be reading him completely wrong. And again, my perspective is admittedly a different one. But, that's my take on it, at least.