We don't have to resort to technicalities. This attack was a reactionary populist movement, led by white supremacist groups (eg the poor boys). It is a stretch to label the whole thing "Nazi", but only slightly.
Republicans are currently faced with a choice - conservatism xor this new reactionary populism. If you're an actual conservative and don't appreciate your own voice being pigeonholed with the neo-Naziism, then work to cut the cancer out of your party.