Been using @hf.co’s Accelerate library for a few months now, and I can’t emphasize enough how great it is. It makes launching distributed training effortless. If you’re into training deep learning models, definitely give it a try.
GitHub repo: github.com/huggingface/...
#ML #DistributedTraining
github.com
GitHub - huggingface/accelerate: 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-conf...
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed suppo...