I think that deep down in American culture, across most of the political spectrum, there's a belief that right wing violence is fundamentally legitimate, even if it is scary or undesirable.
They're scared of it because they think the right 'gets to do that' on some level, and other people don't.