“Forecasting Downstream Performance of LLMs With Proxy Metrics” by
Arkil Patel, Siva Reddy, Marius Mosbach, Dzmitry Bahdanau
arxiv.org
Forecasting Downstream Performance of LLMs With Proxy Metrics
Progress in language model development is often driven by comparative decisions: which architecture to adopt, which pretraining corpus to use, or which training recipe to apply. Making these decisions...