Or he could be a polite person that doesn't make remarks on people's sexuality?

I think that you should try to subtely clarify this matter before you fall in love even more and avoid suffering...