Actually yeah. It goes back to the French Revolution. The liberals, including Robespierre called people like Hebert and Roux "ultras", it was used by the Jacobin Club to condemn the more radical section of the mountain.