🚀 What if we could scale LLM inference by sampling different model weights, not just more tokens?
We show that a single query can be enough to generate useful LoRA updates, and that predicting a distribution over them is key to making hypernets work!
Here's what we found 🧵