bowphs.bsky.social @bowphs.bsky.social · 13/05/2026"How deep is your love? Like the ocean?" Looking out at the Balearic Sea got me thinking about ancient feelings. Just how deep *did* the Romans and Greeks love? Come find out at the first poster session of @LREC2026! 📍 Poster 1196 🕐 11:20 - 13:00 021
bowphs.bsky.social @bowphs.bsky.social · 27/07/2025Looking at Bruegel's Tower of Babel in Vienna makes you wonder: How can multilingual language models overcome the language barriers? Find out tomorrow! 📍 Level 1 (ironic, right?), Room 1.15-1 🕐 2 PM #ACL2025NLP 030
bowphs.bsky.social @bowphs.bsky.social · 07/06/2025This phenomenon has a visible effect on text generation: In BLOOM-560m, activating 'earthquake' neurons derived from Spanish data at checkpoint 10,000 generates Spanish text. At checkpoint 400,000, the same method yields English text! 120
bowphs.bsky.social @bowphs.bsky.social · 07/06/2025This is not a bug, it's a feature! These layers are repurposing the space to form cross-lingual abstractions. We track this by examining how specific concepts (like "earthquake" or "joy") align across languages. 120
bowphs.bsky.social @bowphs.bsky.social · 07/06/2025How and when do multilingual LMs achieve cross-lingual generalization during pre-training? And why do later, supposedly more advanced checkpoints, lose some language identification abilities in the process? Our #ACL2025 paper investigates. 132
bowphs.bsky.social @bowphs.bsky.social · 07/06/2025This phenomenon has a visible effect on text generation: In BLOOM-560m, activating 'earthquake' neurons derived from Spanish data at checkpoint 10,000 generates Spanish text. At checkpoint 400,000, the same method yields English text! 100
bowphs.bsky.social @bowphs.bsky.social · 07/06/2025This is not a bug, it's a feature! These layers are repurposing the space to form cross-lingual abstractions. We track this by examining how specific concepts (like "earthquake" or "joy") align across languages. 100
bowphs.bsky.social @bowphs.bsky.social · 06/06/2025This phenomenon has a visible effect on text generation: In BLOOM-560m, activating 'earthquake' neurons derived from Spanish data at checkpoint 10,000 generates Spanish text. At checkpoint 400,000, the same method yields English text! 100
bowphs.bsky.social @bowphs.bsky.social · 06/06/2025This is not a bug, it's a feature! These layers are repurposing the space to form cross-lingual abstractions. We track this by examining how specific concepts (like "earthquake" or "joy") align across languages. 100