I am so excited about this paper. Wayfarer fulfills a vision I had 10 years ago when I wrote Learning Purposeful Behaviour in the Absence of Rewards.
It fulfills the promise of options, maybe for the first time.
End of thread. 9/9
arXiv link: arxiv.org/abs/2610.03604
arxiv.org
Mastering Atari 2600 Games with Discovered Options
Temporal abstractions, often instantiated as options, have long been regarded as a mechanism for accelerating credit assignment, facilitating exploration, and enabling generalisation in reinforcement ...