(5/6) SNR naturally gives a way to improve benchmarks, we introduce 3 “interventions” in our work! For example:
❗️ Simply using the top 16 MMLU subtasks by SNR exhibits better decision accuracy and lower scaling law error than using the full task (only 6 for an AutoBencher task)
