They think that if colonized peoples are allowed to use violence against their colonizers that the colonized will enact the same level of violence on the colonizers and that's bad because they realize they're the colonizers. "I'm only the beneficiary of this system, don't be mean to me when you seek to undo it!!!"