Use steel wool, if you're worried about scratching shit try not pressing super hard.

I don't think that's how that works

Edit: dish brushes exist