Did he come in town with the express intention to have sex with you (and your daughter being in the same room?)?
I think this guy thought you and he were going to be having sex and that's why he came to your city--if this line of conversation has been going on for 15 years, I would think that he expected a different outcome based on what you two have been discussing for a decade and a half. So yeah, he's a bit over you now since you switched up on him at the last minute. He's probably thinking about all the money he's had to shell out to come see you and he's pissed at you, hence him being cold.
You can't control how he feels about you now. He's going to remember he spent 15 years grooming you for this moment and you balked at the last minute.
If you're confused and don't know what to do, then do nothing. The moment for him is gone now. I seriously doubt there is anything you can do, short of flying to his hometown and having sex from the moment you land til the moment you take off back home, that's going to change his mind on how he feels about you now.
This plan of yours doesn't sound like it was well thought out to its logical conclusion.
People treat you the way they feel about you
If you choose to remain with someone who doesn't treat you well, you cease being the victim and become the volunteer.
~Derrick Jaxn -- look him up