Sign in

Graham Neubig

@gneubig.bsky.social
865 followers 30 following 2 posts

Associate professor at CMU, studying natural language processing and machine learning. Co-founder All Hands AI

PostsRepliesMedia
Graham Neubig @gneubig.bsky.social · 09/06/2025
Where does one language model outperform the other? We examine this from first principles, performing unsupervised discovery of "abilities" that one model has and the other does not. Results show interesting differences between model classes, sizes and pre-/post-training.
162
Reposted by Graham Neubig
Ramon Astudillo @ramon-astudillo.bsky.social · 08/02/2025
Nice contribution to the understanding of Long CoT induction arxiv.org/abs/2502.03373 by Edward Yeo and colleagues (advised by @gneubig.bsky.social and @xiangyue96.bsky.social ). Its hard not to see this as mostly a negative result on induction on the 8B scale. 👇
arxiv.org
Demystifying Long Chain-of-Thought Reasoning in LLMs
Scaling inference compute enhances reasoning in large language models (LLMs), with long chains-of-thought (CoTs) enabling strategies like backtracking and error correction. Reinforcement learning (RL)...
172
Reposted by Graham Neubig
Xuhui Zhou @nlpxuhui.bsky.social · 19/02/2025
LLM agents can code—but can they ask clarifying questions? 🤖💬 Tired of coding agents wasting time and API credits, only to output broken code? What if they asked first instead of guessing? 🚀 (New work led by Sanidhya Vijay: www.linkedin.com/in/sanidhya-...)
173
Graham Neubig @gneubig.bsky.social · 27/11/2024
We are now done with all classes for CMU CS11-711 Advanced NLP! Slides: phontron.com/class/anlp-f... Videos: youtube.com/playlist?lis... Hope this is useful to people 😀
phontron.com
Schedule
The weekly event schedule.
0537
Reposted by Graham Neubig
Akari Asai @akariasai.bsky.social · 19/11/2024
1/ Introducing ᴏᴘᴇɴꜱᴄʜᴏʟᴀʀ: a retrieval-augmented LM to help scientists synthesize knowledge 📚 @uwnlp.bsky.social & Ai2 With open models & 45M-paper datastores, it outperforms proprietary systems & match human experts. Try out our demo! openscholar.allen.ai
616339
Reposted by Graham Neubig
Lindia Tjuatja @lindiatjuatja.bsky.social · 20/11/2024
💬 Have you or a loved one compared LM probabilities to human linguistic acceptability judgments? You may be overcompensating for the effect of frequency and length! 🌟 In our new paper, we rethink how we should be controlling for these factors 🧵:
Screenshot of the paper title "What Goes Into a LM Acceptability Judgment? Rethinking the Impact of Frequency and Length"
18519