first of all, unemployment sucks, it can bring anyonr or a group of people down fast. secondly, I'm guessing that he wants to look presentable when he goes out with you, that shows he cares. When he goes out with his friends in the clothes he's wearing, don't take it personal or anything, its just like yard work clothing actually. He doesn't need to look good for them nor does he care to, and its just something that guys do I think. Not to look good for the passing guy, but for the passing lady. what I'm trying to say is don't be irritated about it, its not that he doesn't care for u.
A little opinion in a big matter.