Did Ralph loops ever work?
They were popular for a while, but when I did a comparison, they underperformed. There were all these theories about why Ralph loops were effective ("invert the latent space of the model"), but AFAICT people just didn't run the comparison?
danluu.com/pl-tokens/#r...