Both. He doesn't find her attractive, but he needs to be extra to get the point across without Mrs. True getting involved and potentially using Everett as a blunt object against the offending woman.

Man's kept in place by a mix of love and acknowledging he's found the only person who can take him down.

Everett is just being a misogynist asshole.

If it was just about being loyal to his wife he wouldn't be slinging insults at a woman who did nothing to wrong him outside of inviting him to a slightly naughty party game.