My thoughts is that it's a simple situation really. If they're harassing or assaulting people, the women will call the cops or something, simple situation and get the guy arrested. If he's not doing anything, it's nothing harmful. Apparently that's not a solid enough answer. What should I have said?
You know I still don't understand the issue people have with this. Every bathroom I've been in either has stalls to use with urinals on the side and dividers between those for some privacy, or is only designed for one person at a time anyway. I can't imagine having any issue with anyone of any gender in those types of bathroom, unless they where being clear creeps and trying to press an eye to a gap in a divide or something. Which isn't solved by limiting the genders who can enter, it's solved by building better dividers and not leaving gaps.
This isn't Rome my dude, we're not all sitting in one room and having a face to face while we clart.