My thoughts is that it's a simple situation really. If they're harassing or assaulting people, the women will call the cops or something, simple situation and get the guy arrested. If he's not doing anything, it's nothing harmful. Apparently that's not a solid enough answer. What should I have said?
Its an ancient argument and your answer is correct.
There is no cock check at restroom doors anyone can enter.