It's been a thing that has bugged me too, for years.
It has almost always felt like the majority of these anti-whatever kind of people do not have empathy for victims, they just want to appear like they do. It's hard to actually help your community, but easy to blame a fictional example of a taboo.