As far as i understand it, the usage of "semitism" originates in the accusation that jews as a diaspora organize completely separately from the nations they live in for their own benefit, basically that they are only loyal to themselves.

This is also why it's suggested that you never hyphenate "antisemitism", as one word it only describes the beliefs of antisemites, while hyphenated it treats "semitism" as a legitimate force.