Kek, I assert you take me too seriously. All I want to argue is that the Shadow temple implies that the Hyrule royal family has some... ehem... skeletons in the closet. If you take theories seriously enough, there's an idea that some redeads are shiekah (like those that guard the sun song in the royal tomb). Bottom of the well has explicit torture devices. The first Tears of the Kingdom trailer has Ganondorf all sealed up in what could be described as torturous magic which further enshrines the sheikah as a fucked up army of the royal family. The idea that you have all this torture and forbidden magic, but you don't levee taxes would be absurd by my estimation.

Also, do we know why the Gerudo captured those construction guys? Maybe the Hylians were gentrifying, you can't rule it out