Is this your only cause for suspicion?

If so, then I fully agree with the harmless, flirty banter conclusions.

It is still flirty enough for him to be embarrased if you let him know you saw...