🧵5/5 - Come discuss with us at NeurIPS:
📍 East Exhibit Hall A-C
🎯 Poster #2803
⏰ Thu Dec 12, 11am-2pm PST
Or check our paper: arxiv.org/abs/2311.09058
arxiv.org
Improving Deep Learning Optimization through Constrained Parameter Regularization
Regularization is a critical component in deep learning. The most commonly used approach, weight decay, applies a constant penalty coefficient uniformly across all parameters. This may be overly restr...
