When people say "not all men", of course it isn't.
Women know that too. But until we start to wear badges to let them know which ones are a threat, they have no way of knowing. So do what you can to make them feel safer. Cross a road, walk home a different way, don't join in with abuse, and for fuck