"u live in the past get into the future i am not ur ex"
When he asked you if what your ex thought of you two together did you tell him what your ex thought? Because if you did then it means your still in contact with him and you've not detached from him if you're telling him about your life with the new guy. That's what I think he meant by that.
However: It really makes little difference what he meant because the fact is, this guy is playing games and won't even have a decent, honest conversation with you about what he means when he says things. He's not mature enough to have a proper and mutually satisfying relationship if he won't or can't communicate honestly and openly with you.
Having sex twice in the last 3 months doesn't make you in an actual relationship with this man, it makes you bed buddies with his non-comunicational game playing in between.
I'd tell him to get lost and come back when/if he has had a chance to become emotionally mature and capable of a decent, open conversation. Drunk messaging is probmatic in itself. Ugh. What does this guy actually have going for him that is positive in your eyes?
“The willingness to accept responsibility for one’s own life is the source from which self-respect springs.” ~Joan Didion