Not really.
If a Swastika was on my property I would have it removed regardless to what historic value someone wants to give it and I am not even fucking Jewish. Shit I would have the same attitude if was a General Custer's monument and I am not Native American either.