Reposted by Tim DavidsonSkander Moalla @skandermoalla.bsky.social · 03/03/2025A dream come true! I presented "No Representation, No Trust" on my favorite RL podcast, TalkRL! Make sure to check it out to learn why training with PPO for too long makes your agent collapse! 142
Reposted by Tim DavidsonVolkan Cevher @cevherlions.bsky.social · 13/02/2025🔥 Want to train large neural networks WITHOUT Adam while using less memory and getting better results? ⚡ Check out SCION: a new optimizer that adapts to the geometry of your problem using norm-constrained linear minimization oracles (LMOs): 🧵👇 3186
Reposted by Tim DavidsonSepideh Mamooler@ACL🇦🇹 @smamooler.bsky.social · 17/12/2024🚀 Introducing PICLe: a framework for in-context named-entity detection (NED) using pseudo-annotated demonstrations. 🎯 No human labeling needed—yet it outperforms few-shot learning with human annotations! #AI #NLProc #LLMs #ICL #NER 1128
Reposted by Tim DavidsonSander Dieleman @sedielem.bsky.social · 16/12/2024Here's Veo 2, the latest version of our video generation model, as well as a substantial upgrade for Imagen 3 🧑🍳🚢 (Did I mention we are hiring on the Generative Media team, btw 👀) blog.google/technology/g...blog.googleState-of-the-art video and image generation with Veo 2 and Imagen 3We’re rolling out a new, state-of-the-art video model, Veo 2, and updates to Imagen 3. Plus, check out our new experiment, Whisk. 06017
Reposted by Tim DavidsonSkander Moalla @skandermoalla.bsky.social · 10/12/2024Also, check out our ML project template—it’s a game-changer!🚀🚀 @caglarai.bsky.social 🧑💻 github.com/CLAIRE-Labo/... 063
Reposted by Tim DavidsonCaglar Gulcehre @caglarai.bsky.social · 09/12/2024I am in Vancouver for NeurIPS 2024 until December 16th if you want to meet, DM or email me. We have two accepted papers from my lab: 1. Building on Efficient Foundations: Effective Training of LLMs with Structured Feedforward Layers, on Wednesday, East Exhibit Hall A-C #2010 (1/3) 1114
Reposted by Tim DavidsonSander Dieleman @sedielem.bsky.social · 02/12/2024Better VQ-VAEs with this one weird rotation trick! I missed this when it came out, but I love papers like this: a simple change to an already powerful technique, that significantly improves results without introducing complexity or hyperparameters. 18613
Reposted by Tim DavidsonChengkun Li @ckli.bsky.social · 22/11/2024I've put together a starter pack of EPFL researchers across all labs and domains! 🇨🇭 Would love to expand this list and showcase more amazing work happening at EPFL. Drop a reply to be added! #EPFL #academicsky go.bsky.app/73zdbtp 7103