Not really sure if the best response to fascists using a common and ancient symbol is to rip out our artistic and cultural heritage.

There are buildings with Swastikas and Fasces all over Europe and the US that considerably pre-date the Nazis.

It's not like removing statues of slavers and criminals (which is based), since these older buildings and artworks aren't and weren't glorifying the horrendous crimes they later came to be associated with.