Definitely speak to him about it, start going on a few more dates so you can tell he is intereted in spending time with you etc