You named several elements of a relationship:
- emotional connection,
- intellectual connection,
- looks (physical attractiveness),
- and sexual chemistry.
I think you need at least 3 out of 4 to have a chance, or a little of each. So, date him if you like and find out for yourself. You will never know unless you try.
If you break up, don't consider it a failure. Consider it a learning experience. What did you learn about him? What did you learn about yourself?
I have a long time interest in psychology, specializing in relationship dynamics for 30 years.
(Please note, we give the best advice we can based on the information given in a post. For better advice, please include the age of all romantic partners.)