Speculative Decoding is the coolest trick for speeding up LLM inference!
Check out the video and learn why rejection sampling preserves quality, and how methods such as draft trees, Medusa, MTP, EAGLE, and DFlash further accelerate LLM inference.
youtu.be/l8gWQlrVOKQ
