I wouldn't shave my chest but thats just cause I think it looks stupid...don't mind shavin other stuff but that is just to large of an area to not have hair...at least in my opinion.
Seriously I think you should really try to give it some more time and get past it...like I said I got past the nose ring I didn't like. Of course I don't have a nose fetish so maybe it is a little different. But I do consider myself something of a breast man and pierced nipples don't bother me so I really can't relate.