Hyperscaling is a dead end, don't take it from me take it from MIT.
mitsloan.mit.edu/ideas-made-t...
mitsloan.mit.edu
The rise of smaller ‘meek models’ could democratize AI systems | MIT Sloan
AI systems built or run with limited resources could soon perform on par with leading larger models while costing much less, according to new research.