Sign in

Skander Moalla

@skandermoalla.bsky.social
60 followers 67 following 18 posts

PhD @Caglar Gulcehre Lab for AI Research (CLAIRE) @EPFL. Deep Reinforcement Learning, RLHF, foundation models. ML Research Template (github.com/CLAIRE-Labo/python-ml-re…)

PostsRepliesMedia
Reposted by Skander Moalla
Antoine Bosselut @abosselut.bsky.social · 03/09/2025
The next generation of open LLMs should be inclusive, compliant, and multilingual by design. That’s why we @icepfl.bsky.social @ethz.ch @cscsch.bsky.social ) built Apertus.
2248
Skander Moalla @skandermoalla.bsky.social · 15/07/2025
🚀 Big time! We can finally do simple LLM RL fine-tuning with rewards and leverage offline/off-policy data! ❌ You want rewards, but GRPO only works online? ❌ You want offline, but DPO is limited to preferences? ✅ QRPO can do both! 🧵Here's how we do it:
1124
Reposted by Skander Moalla
Xiuying Wei @xiuyingwei.bsky.social · 12/07/2025
⚡️🧠 Excited to share our recent work on long-context efficiency! We propose a new layer called RAT—fast and lightweight like RNNs, yet powerful like Attention. 🐭✨ This is the joint effort with Anunay Yadav, @razvan-pascanu.bsky.social @caglarai.bsky.social !
173
Reposted by Skander Moalla
Anja Surina @anjasurina.bsky.social · 26/04/2025
Excited to share our latest work on EvoTune, a novel method integrating LLM-guided evolutionary search and reinforcement learning to accelerate the discovery of algorithms! 1/12🧵
12010
Reposted by Skander Moalla
Martin Jaggi @mjaggi.bsky.social · 08/03/2025
Anastasia @koloskova.bsky.social recently won the European @ellis.eu PhD award, for her amazing work on AI and optimization. She will be joining University of Zurich as a professor this summer, and hiring PhD students and postdocs. You should apply to her group! Her website: koloskova.github.io
koloskova.github.io
Anastasia Koloskova
Anastasia Koloskova, PhD student in Machine Learning at EPFL.
091
Skander Moalla @skandermoalla.bsky.social · 03/03/2025
A dream come true! I presented "No Representation, No Trust" on my favorite RL podcast, TalkRL! Make sure to check it out to learn why training with PPO for too long makes your agent collapse!
142
Reposted by Skander Moalla
Ghjulia Sialelli @ghjuliasialelli.bsky.social · 27/01/2025
Excited to share that the first paper of my PhD has been accepted for publication at the ISPRS Geospatial Week 2025! This dataset paper introduces a globally representative, high-resolution (10m) benchmark dataset for Above Ground Biomass estimation.
2255
Reposted by Skander Moalla
Razvan Pascanu @razvan-pascanu.bsky.social · 15/12/2024
For my first post on Bluesky .. I'll start by announcing our 2025 edition of EEML which will be in Sarajevo :) ! I'm really excited about it and hope to see many of you there. Please follow the website (and Bluesky account) for more details which are coming soon ..
1337
Skander Moalla @skandermoalla.bsky.social · 10/12/2024
Also, check out our ML project template—it’s a game-changer!🚀🚀 @caglarai.bsky.social 🧑‍💻 github.com/CLAIRE-Labo/...
063
Skander Moalla @skandermoalla.bsky.social · 10/12/2024
Ever been puzzled by your PPO agent collapsing out of nowhere? 📈🤯📉 Come check out our poster tomorrow! Wed 11 Dec 11 am - 2 pm PST West Ballroom A-D #6403 @caglarai.bsky.social @andreamiele.bsky.social @razvan-pascanu.bsky.social
171