SYNTH paper is also a contribution to pretraining science. Thanks to controlled environments, we discovered that epistemic calibration (does the model knows it doesn’t know?) is an emerging capability from 300M parameters onwards.
Alexander Doria
@dorialexander.bsky.social
8.1K followers 721 following 2.1K posts
LLM for the commons.
