Sign in

Giuseppe Attanasio

@gattanasio.cc
285 followers 268 following 39 posts

Postdoc at @sardine-lab-it.bsky.social working on fair and safe language technologies. | gattanasio.cc | he/him

PostsRepliesMedia
Giuseppe Attanasio @gattanasio.cc · 22/06/2026
Only ~half of interactions were rated usable. Gaps persist across dialect and gender groups. And QA-based evaluation (roughly: Does key information survive translation?) predicts usability far better than standard metrics. Dataset released CC-BY 4.0.
100
Giuseppe Attanasio @gattanasio.cc · 22/06/2026
Speech translation scores well on benchmarks, but is it actually usable when it counts? 🎙️ New paper: Ouvia, a user-centered framework for evaluating speech translation in real-world 1-to-1 communication. 1,700+ interactions, 174 speakers, 3 dialect groups. github.com/g8a9/ouvia #nlp #nlproc
1113
Giuseppe Attanasio @gattanasio.cc · 29/07/2025
👀 Interested in gender bias in NLP and MT evaluation? I strongly encourage you to check out our poster presentations held by @manoszar.bsky.social! 👉🏻 Poster Session 3, today (July 29) from 16:00–17:30 OR at the Gender Bias Workshop, Friday (Aug 1) during Poster Session 2, 14:00–14:45. #acl2025
030
Giuseppe Attanasio @gattanasio.cc · 14/07/2025
As neural metrics are a pillar for #MT, being extensively used for evaluation but also improving translation, we'd want them to be fair. 🚨 Our #ACL2025 paper shows they consistently, unduly favor masculine-inflected translations, or gendered forms, over neutral ones. arxiv.org/pdf/2410.10995
Figure 1 of the paper shows that the metrics score the masculine forms higher than the feminine or neutral ones.
1128
Giuseppe Attanasio @gattanasio.cc · 04/12/2024
We collected, annotated, and released a large set of tweets about people's reactions to financial aid during the COVID-19 pandemic (e.g., "bonus bicicletta"). Our study highlights the potential and pitfalls. @deboranozza.bsky.social will present the poster on Dec 5, 10:30-11:30. + Fabio Pernisi
Academic poster presenting the results of the research project.
051
Giuseppe Attanasio @gattanasio.cc · 04/12/2024
TweetyIta and ItaEval are a language model and evaluation benchmark for Italian tasks. What's more, they are 100% community-driven and born within RiTA (rita-nlp.org). @asantilli.bsky.social will present the poster on Dec 5, 16:30-17:30. + Pieter Delobelle, Moreno La Quatra, @bsavoldi.bsky.social
academic poster presenting the results of the research project.
164
Giuseppe Attanasio @gattanasio.cc · 08/11/2024
And yes, about the Lisbon bit. @sardine_lab_it and @andre_t_martins are hiring postdocs and PhD students, so take the chance to chat with any of us 🐟
000