Wish LM could plan—not just guess the next word?
TRACE lets LM see all endings before each move.
– Global control at inference time
– Tractable lookahead via an HMM LM-proxy
– Linear classifier per constraint
Outperform RL, DPO, FUDGE—at just +20% decoding over base LM.
#ICML2025 @guyvdb.bsky.social
