Girlies, i have a question about how yall would deal with this.. please let me know your opinions, im struggling. 🩷

So my boyfriend runs a business that involves people from across the country. He doesn’t work it, instead he has people that work for him basically selling the product. They work Weekends normally all over the country. Friday-Sunday. He accommodates their stay, rentals, etc. For the past 2 years, they have stayed in his parents backyard in a building. His parents have a house and this space outside that they can stay in.. However, for the past couple months it has became an issue. Now that it has became a issue , he wants me to be okay with allowing 4 grown men into my home, my safe space, my peace mind you we have 3 bedrooms, 2 baths. One is his bathroom, One is mine. We have one guest room that’s my makeup room, and i am currently pregnant so the other room is going to be a nursery. We simply don’t have room for 4 grown men, besides it would make me completely uncomfortable and anxoious in my own home. He is upset and saying i only care about myself, but i don’t understand. If i knew this was going to be something, we would’ve had a discussion prior to us ever living together. what would yall do? am i in the wrong? help