simons.berkeley.edu
Are Transformers necessary? A data-centric view on generalization
Researchers have proposed many methods to make neural networks more reliable under distribution shift, yet there is still large room for improvement. Are better training algorithms or training data th...