Reposted by @shenc.bsky.social
"As researchers, we tend to publish only positive results, but I think a lot of valuable insights are lost in our unpublished failures."
New blog post: Getting SAC to Work on a Massive Parallel Simulator (part I)
araffin.github.io/post/sac-mas...
araffin.github.io
Getting SAC to Work on a Massive Parallel Simulator: An RL Journey With Off-Policy Algorithms (Part I) | Antonin Raffin | Homepage
This post details how I managed to get the Soft-Actor Critic (SAC) and other off-policy reinforcement learning algorithms to work on massively parallel simulators (think Isaac Sim with thousands of ro...