I'm enthralled by this hypothetical you seem to be so sure about.
I'm not making any judgment yet.
But isn't allure what makes us attracted to a person in the first place? In most cases, like when a prospective date is someone you aren't well acquainted with, the prevailing reason to want to date this person is their appeal.
This applies to both sides in my opinion. You seem to be putting all of your focus on women--as you stated, being selective over the person they'd date purely based on an attractiveness scale. Unless the case is that the individual seeking dates is asking every single woman out there I wouldn't be ready to draw any conclusions, since that would be impossible (and not to mention desperate), but my point is that the guy making the effort to initiate something with a woman is certainly also based on his appeal to her.
Now, on to the situation you're referring to. Did the context of this situation involve her making a reference that her consideration to date you was based on the attractiveness she has toward you?
It just sounds a little insecure on your part and that you are undermining yourself.