is a relationship possible?

This is my first time posting in a love forum, so I'm a little nervous. I met a guy at a club about 1.5 months ago, and we hit it off pretty well, although I think part of it could be attributed to the fact that he's foreign, speaks little English, and I speak his language fluently. I am 26, and he is 30. We exchanged numbers, and I didn't think much about it since we only spoke for a short while, but two days later he called me, and continued to call me for the next 3 days. He then asked me out for dinner, and I agreed, so we met after work one day, and while it was fun, I was still pretty sceptical as he was not going to stay in the country for a long time, and I am not looking for a casual relationship.

During dinner, however, he wanted to make plans to meet up again, and even though I was not very keen, I decided to give it a try when he suggested a double date. We met up two days later, with me bringing a female friend, and him bringing his male friend, and the more time I spend with him, the more I felt like I could get to know him better. We talked a lot about our lives, and flirted quite a bit, and later that night, in the taxi, he held my hand the whole time, and kept telling me that he likes me and wants to know me better. He tried asking if I wanted to see his place, but I said no, and he left it at that.

The following week he was going back to his country for two weeks, and even though he told me he would contact me, I didn't think much about it, but he really did, and continue to text me every day for the next two weeks, telling me what he was up to, where he went (with pictures), asking how my day was. We didn't meet for the next month, as I was on vacation when he got back to the country, but when I was away, he told me several times that he missed me and wanted to see me soon.

I got back last week, and met up after work on a weeknight, and I found myself really enjoying his company. After dinner, when we left the restaurant, he took my hand again, and kissed me in the elevator. I ended up going back to his place, but I told him that I will not sleep with him, and that I'm still a virgin. Again, he didn't push me to have sex, but we did make out for a bit, with him telling me that he likes me again and again. He didn't want to let me go, but I insisted, and he said okay, and send me down to take a taxi.

It all seems to be going great, but now I'm not so sure where we're heading. Did we get intimate too soon? I don't want to end up having a casual relationship or a fling with this guy, as we share a lot in common, and after spending some time with him, I think I've started to see this going somewhere, and would like to explore that, but how do I breach this topic with him?

He has another 2 months here before he has to go back for good, and has hinted several times that he wants me to go with him. I told him I'm not sure, and he said it's fine, we don't know what will happen in the future. But I'm torn and at a loss as to what to do. Help?