Our main result is that Committed Q-learning converges to the optimal reactive policy in any "rewire-robust" POMDP, which generalizes both 𝑞⋆-realizability and quasi-Markov environments. The reason is that, by adding commitment, Q-learning automatically learns "entrance values"!
