does anyone outside trans circles even use the term chaser derogatorily?

Yes.

like you just know they heard this term cause they, or someone they know, got called a chaser and they got mad about it so they started trying to call other people chasers.

No, in fact I'm quite positive that didn't happen, actually.