Reposted by Sweta Agrawal
As neural metrics are a pillar for #MT, being extensively used for evaluation but also improving translation, we'd want them to be fair.
🚨 Our #ACL2025 paper shows they consistently, unduly favor masculine-inflected translations, or gendered forms, over neutral ones.
arxiv.org/pdf/2410.10995 
