At the end of the day its up to the individual. Many trans men still heavily connect with sisterhood even if their gender doesnt reflect that.
Also, many people dislike the idea of the lesbian identity being centered around the idea of men. It’s basically this meme lol if that makes sense