iiinova — where your digital self keeps evolving

Roy Frostig

@froystig.bsky.social

737 followers 138 following 5 posts

research scientist at google deepmind. co-author of JAX (github.com/jax-ml/jax). cs.stanford.edu/~rfrostig

Posts Replies Media

Reposted by Roy Frostig

Jeff Dean @jeffdean.bsky.social · 04/02/2025

Training our most capable Gemini models relies heavily on our JAX software stack+Google's TPU hardware platforms. If you want to learn more, see this awesome book "How to Scale Your Model": jax-ml.github.io/scaling-book/ Put together by several of my Google DeepMind colleagues listed below 🎉.

27813

Roy Frostig @froystig.bsky.social · 04/02/2025

Our online book on systems principles of LLM scaling is live at jax-ml.github.io/scaling-book/ We hope that it helps you make the most of your computing resources. Enjoy!

jax-ml.github.io

How To Scale Your Model

Training LLMs often feels like alchemy, but understanding and optimizing the performance of your models doesn't have to. This book aims to demystify the science of scaling language models on TPUs: how...

3359