He doesn't have the same relationship boundaries for himself that he wants you to have. That is a huge red flag and I think at the four month mark of dating you'd be very unwise to move anywhere "in" with this man. Take your time to see how you are incompatible in other areas, how controlling he actually is and if he's abusive and just simply trying to isolate you from your friends and family.
Nothing good can come of you jumping into something with someone you don't even know. In a long distance relationship of only 4 months just how few hours have you actually spent in his company getting to know the real him?
“The willingness to accept responsibility for one’s own life is the source from which self-respect springs.” ~Joan Didion