If you look at historical accounts I think its clear people like slave owners had serious psychological problems caused by the things they did. They clearly benefited more than they were harmed due to the economic benefits they got from slavery, but it did cause obvious psychological harm. These problems they faced were normalized and they would deny they existed or their connection to the things they did, but they were real.

I don't think there is something like that going on with most people. Or if there is, it's masked by the many other greater problems going on in society. These other problems are so much greater it becomes a rounding error.

Of course this is just my subjective opinion based on no data and I could easily see it going either way.