Ultimately it boils down to do you like the guy or not? If you don't like the way he's acting (for whatever reason) then it is your choice to no longer see him.
If you cannot tolerate behavior such as this... then I'm sure there will be more behavior that you won't tolerate as you learn more about him.
The choice is and will always be yours. So, do you want to give the guy another chance or do you think you should follow the 'feeling' you're getting so far and let him go? Because to me it sounds like you're wanting us to agree you should let him go.
"The weakest soul, knowing its own weakness, and believing this truth that strength can only be developed by effort and practice, will, thus believing, at once begin to exert itself, and, adding effort to effort, patience to patience, and strength to strength, will never cease to develop, and will at last grow divinely strong."
- James Allen