Finished reading this really nice survey paper. Love reading survey papers as a method to revise and fill in gaps in my understanding of a topic ..
arxiv.org/abs/2406.16838
arxiv.org
From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models
One of the most striking findings in modern research on large language models (LLMs) is that scaling up compute during training leads to better results. However, less attention has been given to the b...