dan @danabra.mov · 24/06/2025what is the main reason that gradient descent (at least the vanilla version) uses a proportional step to the gradient value? i understand why it needs to use the sign (for direction) but why is being proportional a good idea? 6131
dan @danabra.mov · 24/06/2025this video is looking pretty great as an overview of the area. love the visualsyoutube.comWho's Adam and What's He Optimizing? | Deep Dive into Optimizers for Machine Learning!YouTube video by Sourish Kundu 1121
