SmolLM2 paper is out! We wrote a paper detailing the steps we took to train one of the best smol LM 🤏 out there: pre-training and post-training data, training ablations and some interesting findings 💡
Go check it out and don't hesitate to write your thoughts/questions in the comments section!
