A technical thread on loss scaling in diffusion and flow matching models (related to a new preprint):
Since the dawn of time, people have been messing with (or dropping entirely) these pesky time-dependent loss scaling terms, mostly because the models train better without them.
