Reposted by Sardine LabGiuseppe Attanasio @gattanasio.cc · 14/07/2025As neural metrics are a pillar for #MT, being extensively used for evaluation but also improving translation, we'd want them to be fair. 🚨 Our #ACL2025 paper shows they consistently, unduly favor masculine-inflected translations, or gendered forms, over neutral ones. arxiv.org/pdf/2410.10995 1128
Sardine Lab @sardine-lab-it.bsky.social · 24/06/2025New paper from Manos Zaranis, @tozefarinhas.bsky.social and other sardines!!🚀 Meet MF²: Movie Facts & Fibs: a new benchmark for long-movie understanding This benchmark focuses on narrative understanding (key events, emotional arcs, causal chains) in long movies. Paper: arxiv.org/abs/2506.06275arxiv.orgMovie Facts and Fibs (MF$^2$): A Benchmark for Long Movie UnderstandingDespite recent progress in vision-language models (VLMs), holistic understanding of long-form video content remains a significant challenge, partly due to limitations in current benchmarks. Many focus... 000
Sardine Lab @sardine-lab-it.bsky.social · 28/02/2025Applications for the 2025 Lisbon Machine Learning Summer School (LxMLS) are open, with @andre-t-martins.bsky.social as one of the organizers. LxMLS is a great opportunity to learn from top speakers and to interact with other students. You can apply for a scholarship. Apply here: lxmls.it.pt/2025/lxmls.it.ptLxMLS 2025 - The 15th Lisbon Machine Learning Summer School 021
Reposted by Sardine LabGiuseppe Attanasio @gattanasio.cc · 22/01/2025📣 New paper alert! We released a new safety benchmark for VLMs with a core focus on test cases that become unsafe by combining text and images. TL;DR: many modern VLMs are unsafe across various types of queries and languages. arxiv.org/abs/2501.10057 huggingface.co/datasets/fel... 0131
Sardine Lab @sardine-lab-it.bsky.social · 03/02/2025🎉 New paper by Saul Santos in collaboration with @tozefarinhas.bsky.social and @andre-t-martins.bsky.social!! 🎉 ∞-Video: A Training-Free Approach to Long Video Understanding via Continuous-Time Memory Consolidation Paper: arxiv.org/abs/2501.19098arxiv.org$\infty$-Video: A Training-Free Approach to Long Video Understanding via Continuous-Time Memory ConsolidationCurrent video-language models struggle with long-video understanding due to limited context lengths and reliance on sparse frame subsampling, often leading to information loss. This paper introduces $... 092