Your background is no excuse for his bad behavior. He is what he is, it's you that doesn't always understand that someone like him is toxic and brings out the worst in you. You need to find someone who brings the best in you, and respects you as a woman and as a person.