Reposted by Pinzhen "Patrick" Chen
Last Translation Benchmark is a live paper+dataset and you can still join last-translation-benchmark.vilda.net
Massive thanks to all the >250 dataset contributors and @niyatibafna.bsky.social @mukundc2k.bsky.social @maikezufle.bsky.social @pinzhen.bsky.social
last-translation-benchmark.vilda.net
Last Translation Benchmark
Current machine translation benchmarks are saturated. Last Translation Benchmark crowdsources a dataset of inputs that demonstrably break state-of-the-art translation models.