Lol... it's basic logic actually. "Universally" means that EVERYONE likes him (as I said). Provide even just one counterexample (i.e. me, in this case), and it's no longer "universal". A lot of people like him, he just isn't universally liked.
On a more general scale, there simply is no such thing as a "universally attractive" (or "universally unattractive") person.
I did. I was attracted to him, even though he was MILES away from what is standardly considered "attractive".