Is about a trio of like 'judges' that travel around the galaxy and 'exterminate' civilizations that have become too evil.
And basically there is a humanoid species that had developed a horrifying type of 'communism', and those 'judges' destroy the planet.
Volcanoes and slavery are mentioned.
No further details because of spoilers and it should already be easily recognizable.
If anyone here has read that short story, or knows the title or author, then please do tell.
That seems to be it. Is possible that I heard it there but I am not entirely sure yet...
Edit: found an online text version here: https://archive.org/details/Analog_Science_Fiction_and_Fact_June_2015/page/n63/mode/2up
It seems to have been published in multiple scifi collections including audibooks; but HPMOR podcast is probably where I heard it too.
Edit: I'm going to bed, will comment about it here tomorrow.