github.com
[Demo] Gemma 4 grammar jump decoding by alecsolder · Pull Request #7 · alecsolder/vllm
AI GENERATED
Gemma 4 grammar jump decoding
This branch is a research prototype for accelerating constrained Gemma 4 tool
calls. When the grammar has exactly one legal continuation, the decoder can
...