Okay.. I'll give you an answer to your actual question:
why'd he bring up Linda instead, when we weren't even discussing her? am i right to assume that there's some truth to his statement?
I'd say yes you are, He indeed brought her up because he still loves "Linda."
I'm sorry you're not his No. 1 but rather his "you'll do until I can get back with Linda." Up to you if you can ignore that fact and carry on with him or you can't and you break up with him.
“The willingness to accept responsibility for one’s own life is the source from which self-respect springs.” ~Joan Didion