Yeah, this defensive comment is evidence that a) you didn’t express yourself well when inserting your fears/concerns into arguments about trans discrimination & b) you centered yourself and got your feelings hurt.
“I hear/support your argument but WHAT ABOUT ME?” is always going to get backlash.