iiinova — where your digital self keeps evolving

Olivier Codol @oliviercodol.bsky.social · 12/11/2025

Happy to announce that as of this summer, I've joined the CTRL-Labs group at Meta Reality Labs as a Research Scientist! I've also relocated to the bustling city of New York, where I hope I can do my best work (and enjoy running in Central Park).

The view a Research Scientist may enjoy running in Central Park

3220

Olivier Codol @oliviercodol.bsky.social · 06/11/2025

“Edge of chaos” dynamics are long recognized as a computationally potent dynamical regime that avoids vanishing gradients during learning and allows greater memory and expressivity of a system. This stark difference surprised us, and we think it can help explain our results on neural adaptation.

241

Olivier Codol @oliviercodol.bsky.social · 06/11/2025

Indeed, Lyapunov exponents show that fixed points for RL models largely stay near 0, showing these networks’ dynamics lie at the edge of chaos. Whereas SL models’ dynamics are contractive and orderly, keeping very little information in memory for long and having stereotyped expressivity.

151

Olivier Codol @oliviercodol.bsky.social · 06/11/2025

Does this mean SL models are very orderly, while RL models lie at the interface between order and chaos? To formally confirm, we looked at Lyapunov exponents, which tell us how fast close-by states diverge. Unlike Jacobians, this tells us about long-horizon, not just local, dynamics.

120

Olivier Codol @oliviercodol.bsky.social · 06/11/2025

We looked at local dynamics around fixed points over time. This showed that SL models’ fixed points are indeed very stable, having nearly all modes of their eigenspectrum <1. RL models showed many more self-sustaining modes ≈1, again demonstrating isometric dynamics.

130

Olivier Codol @oliviercodol.bsky.social · 06/11/2025

A dynamical system could recover perfectly against a state perturbation, or it could expand following that perturbation. It turns out supervised learning (SL) models do the former, while reinforcement learning (RL) models do something in-between; they act as isometric systems.

130

Olivier Codol @oliviercodol.bsky.social · 06/11/2025

But a biological brain receives an ever-changing stream of inputs, rarely ever reducing to steady-state inputs. Our models reflect that, and their inputs are time varying. So we took a slightly different approach, and asked how fixed-points evolved over time and over perturbed neural states.

130

Olivier Codol @oliviercodol.bsky.social · 06/11/2025

This similarity to NHP neural recordings was true for geometric similarity metrics (CCA), but also for dynamical similarity. Importantly, this was only evident when our models were trained to control biomechanistically realistic effectors.

140

Olivier Codol @oliviercodol.bsky.social · 18/12/2024

This paper even reports some tasks with an UB of 50 bits/sec. So 10 bit/sec isn't quite a "limit" even by that paper's count.

220

Olivier Codol @oliviercodol.bsky.social · 05/12/2024

Winter is here folks! Excited to do some awesome science with the best view ever, Montréal in the snow.

1250

Olivier Codol @oliviercodol.bsky.social · 24/10/2024

Exciting morning for #NeuroAI at #MAIN2024! Talk session on neuro foundation models chaired by no other than @glajoie.bsky.social Looking forward to the upcoming panel discussion

051

Olivier Codol @oliviercodol.bsky.social · 07/10/2024

Finally, we show that the neural representations produced by RL have stabilization properties when fine-tuning to new environmental dynamics. Unlike supervised learning, this leads to representational reorganization that mirrors cortical plasticity in monkeys.

140

Olivier Codol @oliviercodol.bsky.social · 07/10/2024

A long-standing question in psych and neuro is what serves as a dominant "teaching signal" over which to optimize when learning new skills. Instead of approaching this behaviourally, we compared monkey neural recordings to modelling predictions under the same objective function using MotorNet.

140