x.com
Keller Jordan on X: "One motivation for me to add these optimizers was seeing @_arohan_, a senior researcher whose contributions I respect, repeatedly claim that Muon is Shampoo. IIUC, his argument is that if we disable accumulation in both Muon and Shampoo, then they become... 4/6 https://t.co/FsjAnJdJOx" / X
One motivation for me to add these optimizers was seeing @_arohan_, a senior researcher whose contributions I respect, repeatedly claim that Muon is Shampoo. IIUC, his argument is that if we disable accumulation in both Muon and Shampoo, then they become... 4/6 https://t.co/FsjAnJdJOx
