Many guys are mostly sensitive to these things, if a girl doesn't like them. So mostly, there is no way you can avoid hurting his feelings. He will just have to deal with it like an adult.
The worst thing you could do is string him along, and act like you want to date him, but you don't.
I have a long time interest in psychology, specializing in relationship dynamics for 30 years.
(Please note, we give the best advice we can based on the information given in a post. For better advice, please include the age of all romantic partners.)