Jens-Bastian Eppler @j-b-eppler.bsky.social · 29/07/2026Figure 6: does this matter for real networks? In deep neural networks, continued training produces representational drift with the same underlying geometry-preservation. So, a simple theoretical idea connects experiments, random networks, recurrent circuits and modern deep learning. 7/8 🧠🧪 150
Jens-Bastian Eppler @j-b-eppler.bsky.social · 29/07/2026Figures 4 & 5: how general is this? The phenomenon isn't specific to random rewiring in feedforward networks. We find the same behaviour with Hebbian plasticity, and it extends to recurrent networks. Preserving manifolds during drift is a surprisingly generic property of network dynamics. 6/8 🧠🧪 141
Jens-Bastian Eppler @j-b-eppler.bsky.social · 29/07/2026Figure 3: now let the network drift. We randomly rewire a fraction of synapses between sessions. The result looks strikingly like experimental representational drift: individual neurons change their tuning over time. At first glance, it looks as if the representation is falling apart... 4/8 🧠🧪 141
Jens-Bastian Eppler @j-b-eppler.bsky.social · 29/07/2026Figure 2: random networks preserve geometry. Before thinking about drift, we asked a simpler question: If similar stimuli enter a random network, are their outputs still similar? Well, yes. In fact, we show that output similarity is a simple monotonic function of input similarity. 3/8 🧠🧪 141
Jens-Bastian Eppler @j-b-eppler.bsky.social · 29/07/2026Figure 1: the puzzle. During representational drift, individual neurons change their tuning over days, yet the representational geometry is maintained. The figure illustrates exactly that. So... how can both be true? 2/8 🧠🧪 142
Jens-Bastian Eppler @j-b-eppler.bsky.social · 13/02/2026Fig. 6: Modeling the mechanism Finally, the model! So, we see Hebbian structure in the data. But is a Hebbian mechanism enough to explain the observed drift? No. 🧠🧪 8/9 121
Jens-Bastian Eppler @j-b-eppler.bsky.social · 13/02/2026Fig. 5: Fear conditioning decreases Hebbian signature During fear conditioning, the signal correlation → noise correlation relationship is dampened. The Hebbian plasticity is weakened. During learning! Why might that be? 🧠🧪 6/9 100
Jens-Bastian Eppler @j-b-eppler.bsky.social · 13/02/2026Fig. 4: Signal correlation stabilizes noise correlation Not only do signal correlations predict future noise correlation, they also predict noise correlation stability between t and t+1. Stronger signal correlation → more stable noise correlation. 🧠🧪 5/9 110
Jens-Bastian Eppler @j-b-eppler.bsky.social · 13/02/2026Fig. 3: Hebbian plasticity during drift Here’s the first big result: 👉 Signal correlations at time t predict noise correlations at time t+1. If two neurons co-activate now, their future functional coupling rises. This is the classic: “Fire together → wire together.” 🧠🧪 4/9 100
Jens-Bastian Eppler @j-b-eppler.bsky.social · 13/02/2026Fig. 2: A volatile steady state Both signal and noise correlations appear to be in a stable distribution across days… BUT on the level of individual pairs, both are highly volatile. So at the population level it looks stable, yet at the pairwise level it’s highly dynamic. 🧠🧪 3/9 100
Jens-Bastian Eppler @j-b-eppler.bsky.social · 13/02/2026Fig. 1: Defining SC and NC - Signal correlations (SC): co-active cells - Noise correlations (NC): functional connectivity For the SC/NC aficionados: We compute SC from the median response and estimate both SC and NC via bootstrapping. 👉 At a single time point, SC and NC are uncorrelated. 🧠🧪 2/9 100