Sign in

T. Anderson Keller

@andykeller.bsky.social
382 followers 372 following 17 posts

Postdoctoral Fellow at Harvard Kempner Institute. Trying to bring natural structure to artificial neural representations. Prev: PhD at UvA. Intern @ Apple MLR, Work @ Intel Nervana

PostsRepliesMedia
Reposted by T. Anderson Keller
Erik Bekkers @erikjbekkers.bsky.social · 15/04/2026
We're looking for a new colleague at @amlab.bsky.social: Assistant Professor in AI for Science 🔬🤖 World-class ML research, Amsterdam's thriving AI ecosystem (ELLIS, startups, big tech), and some of the best academic labor conditions in Europe ❤️ Deadline: May 30 👉 werkenbij.uva.nl/en/vacancies...
werkenbij.uva.nl
Vacancy — Assistant Professor in AI for Science (AI4Science)
<p><span>Are you passionate about advancing Machine Learning by integrating insights from the natural sciences? Are you eager to bridge the 3rd (<em><span>computational</span></em>) and 4th (<em><span...
03316
Reposted by T. Anderson Keller
Kempner Institute at Harvard University @kempnerinstitute.bsky.social · 12/03/2026
🧠🤖 Are you at #COSYNE2026? Check out the #KempnerInstitute's presentations! 👇 #neuroscience #NeuroAI
166
Reposted by T. Anderson Keller
Edvard I Moser @edvardmoser.bsky.social · 28/01/2026
The hippocampal map has its own attentional control signal! Our new study reveals that theta #sweeps can be instantly biased towards behaviourally relevant locations. See 📹 in post 4/6 and preprint here 👉 www.biorxiv.org/content/10.6... 🧵(1/6)
biorxiv.org
Attention-like regulation of theta sweeps in the brain's spatial navigation circuit
Spatial attention supports navigation by prioritizing information from selected locations. A candidate neural mechanism is provided by theta-paced sweeps in grid- and place-cell population activity, which sample nearby space in a left-right-alternating pattern coordinated by parasubicular direction signals. During exploration, this alternation promotes uniform spatial coverage, but whether sweeps can be flexibly tuned to locations of particular interest remains unclear. Using large-scale Neuropixels recordings in freely-behaving rats, we show that sweeps and direction signals are rapidly and dynamically modulated: they track moving targets during pursuit, precede orienting responses during immobility, and reverse during backward locomotion — without prior spatial learning. Similar modulation occurs during REM sleep. Canonical head-direction signals remain head-aligned. These findings identify sweeps as a flexible, attention-like mechanism for selectively sampling allocentric cognitive maps. ### Competing Interest Statement The authors have declared no competing interest. European Research Council, Synergy Grant 951319 (EIM) The Research Council of Norway, Centre of Neural Computation 223262 (EIM, MBM), Centre for Algorithms in the Cortex 332640 (EIM, MBM), National Infrastructure grant (NORBRAIN, 295721 and 350201) The Kavli Foundation, https://ror.org/00kztt736 Ministry of Science and Education, Norway (EIM, MBM) Faculty of Medicine and Health Sciences; NTNU, Norway (AZV)
418362
Reposted by T. Anderson Keller
Adam J. Eisen @adamjeisen.bsky.social · 26/11/2025
How do brain areas control each other? 🧠🎛️ ✨In our NeurIPS 2025 Spotlight paper, we introduce a data-driven framework to answer this question using deep learning, nonlinear control, and differential geometry.🧵⬇️
18930
Reposted by T. Anderson Keller
Champalimaud Research @champalimaudr.bsky.social · 15/10/2025
@andykeller.bsky.social @kempnerinstitute.bsky.social presented “Flow Equivariant Cybernetics”, a blueprint for agents that learn through continuous feedback with their environment.
142
Reposted by T. Anderson Keller
Kempner Institute at Harvard University @kempnerinstitute.bsky.social · 22/07/2025
New in the #DeeperLearningBlog: #KempnerInstitute research fellow @andykeller.bsky.social introduces the first flow equivariant neural networks, which reflect motion symmetries, greatly enhancing generalization and sequence modeling. bit.ly/451fQ48 #AI #NeuroAI
bit.ly
Flow Equivariant Recurrent Neural Networks - Kempner Institute
Sequence transformations, like visual motion, dominate the world around us, but are poorly handled by current models. We introduce the first flow equivariant models that respect these motion symmetrie...
084
Reposted by T. Anderson Keller
Kanaka Rajan @kanakarajanphd.bsky.social · 02/07/2025
(1/7) New preprint from Rajan lab! 🧠🤖 @ryanpaulbadman1.bsky.social & Riley Simmons-Edler show–through cog sci, neuro & ethology–how an AI agent with fewer ‘neurons’ than an insect can forage, find safety & dodge predators in a virtual world. Here's what we built Preprint: arxiv.org/pdf/2506.06981
39432
Reposted by T. Anderson Keller
Nick Blauch @nblauch.bsky.social · 16/06/2025
What shapes the topography of high-level visual cortex? Excited to share a new pre-print addressing this question with connectivity-constrained interactive topographic networks, titled "Retinotopic scaffolding of high-level vision", w/ Marlene Behrmann & David Plaut. 🧵 ↓ 1/n
16724
Reposted by T. Anderson Keller
Eugene Vinitsky 🍒 @eugenevinitsky.bsky.social · 23/05/2025
Are you an RL PhD at Harvard who has had your funding wrecked by the government and working on topics related to multi-agent? Reach out, I am happy to try to find a way to support you.
1497
Reposted by T. Anderson Keller
DrBreaky @drbreaky.bsky.social · 06/05/2025
Looking forward to presenting our work on cortico-hippocampal coupling and wave-wave interactions as a basis for some core human cognitions 5pm May 6th EST (US) 8am May 7th AEST (Sydney) Zoom link: columbiacuimc.zoom.us/j/92736430185 Thanks to WaveClub conveners Erfan Zabeh & Uma Mohan
2194
Reposted by T. Anderson Keller
Kempner Institute at Harvard University @kempnerinstitute.bsky.social · 29/03/2025
It’s another big day for the #KempnerInstitute at @CosyneMeeting! Check out our work highlighted in poster session 3 today! #COSYNE2025
1122
T. Anderson Keller @andykeller.bsky.social · 12/03/2025
Such a cool connection!! I never heard of that, but that is an ingenious solution. I will likely use this reference in my future talks and mention your comment if you don’t mind!
120
T. Anderson Keller @andykeller.bsky.social · 11/03/2025
Thanks for reading! Can you explain your thought process here? Imagine a neuron with a receptive field (size of the yellow square) localized to the center of the pentagon. Its input would be entirely white — same as if it were localized to the center of the triangle; and therefore indistinguishable.
020
Reposted by T. Anderson Keller
Kevin Mitchell @wiringthebrain.bsky.social · 10/03/2025
Super interesting thread!
2382
T. Anderson Keller @andykeller.bsky.social · 10/03/2025
And not to forget, a huge thanks to all those involved in the work: Lyle Muller, Roberto Budzinski & Demba Ba!! And further thanks to those who advised me and shaped my thoughts on these ideas @wellingmax.bsky.social & Terry Sejnowski. This work would not have been possible without their guidance.
040
Reposted by T. Anderson Keller
Mozes Jacobs @mozesjacobs.bsky.social · 10/03/2025
Traveling waves of neural activity are observed all over the brain. Can they be used to augment neural networks? I am thrilled to share our new work, "Traveling Waves Integrate Spatial Information Through Time" with @andykeller.bsky.social! 1/13
23810
Reposted by T. Anderson Keller
Yohan J John @dryohanjohn.bsky.social · 10/03/2025
Really interesting RNN work. And based on some spiking simulations I've tinkered with, it seems plausible that PV, CB & CR interneurons can contribute to changing the boundary conditions and the 'elasticity' of the oscillating 'rubber sheet' of cortex (and probably hippocampus and amygdala too). 🤓
0102
T. Anderson Keller @andykeller.bsky.social · 10/03/2025
For all the technical details and more ablations, please see our paper recently accepted in workshop-form at ICLR Re-Align, and full-version preprint on ArXiv! Paper: arxiv.org/abs/2502.06034 Code: github.com/KempnerInsti... Hope to see you in Singapore! Fin/
arxiv.org
Traveling Waves Integrate Spatial Information Through Time
Traveling waves of neural activity are widely observed in the brain, but their precise computational function remains unclear. One prominent hypothesis is that they enable the transfer and integration...
190
T. Anderson Keller @andykeller.bsky.social · 10/03/2025
If you want more visualizations, a bit more depth, and even some audio of what different images 'sound' like to our models, please check out our @kempnerinstitute.bsky.social blog-post! kempnerinstitute.harvard.edu/research/dee... 13/14
kempnerinstitute.harvard.edu
Traveling Waves Integrate Spatial Information Through Time - Kempner Institute
The act of vision is a coordinated activity involving millions of neurons in the visual cortex, which communicate over distances spanning up to centimeters on the cortical surface. How do […]
1101
T. Anderson Keller @andykeller.bsky.social · 10/03/2025
Overall, we believe this is the first step of many towards creating neural networks with alternative methods of information integration, beyond those that we have currently such as network depth, bottlenecks, or all-to-all connectivity, like in Transformer self-attention. 12/14
150
T. Anderson Keller @andykeller.bsky.social · 10/03/2025
We found that wave-based models converged much more reliably than deep CNNs, and even outperformed U-Nets with similar numbers parameter when pushed to their limits. We hypothesize that this is due to the parallel processing ability that wave-dynamics confer and other CNNs lack. 11/14
Tables from the paper comparing wave based models and baselines (CNNs and U-Nets) on a variety of semantic segmentation tasks
160
T. Anderson Keller @andykeller.bsky.social · 10/03/2025
As a first step towards the answer, we used the Tetris-like dataset and variants of MNIST to compare the semantic segmentation ability of these wave-based models (seen below) with two relevant baselines: Deep CNNs w/ large (full-image) receptive fields, and small U-Nets. 10/14
161
T. Anderson Keller @andykeller.bsky.social · 10/03/2025
We were super excited about these results—they aligned with the long-standing hypothesis that traveling waves integrate spatial information in the brain*. But does this hold any practical implications for modern machine learning? pubmed.ncbi.nlm.nih.gov/7947408 www.science.org/doi/abs/10.1... 9/14
science.org
Horizontal Propagation of Visual Activity in the Synaptic Integration Field of Area 17 Neurons
The receptive field of a visual neuron is classically defined as the region of space (or retina) where a visual stimulus evokes a change in its firing activity. At the cortical level, a challenging is...
150
T. Anderson Keller @andykeller.bsky.social · 10/03/2025
Was this just due to using Fourier transforms for semantic readouts, or wave-biased architectures? No! The same models with LSTM dynamics and a linear readout of the hidden-state timeseries still learned waves when trying to semantically segment images of Tetris-like blocks! 8/14
150
T. Anderson Keller @andykeller.bsky.social · 10/03/2025
Looking at the Fourier transform of the resulting neural oscillations at each point in the hidden state, we then saw that the model learned to produce different frequency spectra for each shape, meaning each neuron really was able to 'hear' which shape it was a part of! 7/14
Plot of five representative frequency bins from the FFT of the dynamics of our wave-RNN on the shape task. We see different shapes pop out in different bins, indicating that they 'sound' different, and allowing the model to uniquely classify each shape. On the right we plot the average FFT for each pixel, separated by each shape, over the whole dataset, showing that different shapes do have measurably different frequency spectra, even in this average case.
170
T. Anderson Keller @andykeller.bsky.social · 10/03/2025
We made wave dynamics flexible by adding learned damping and natural frequency encoders, allowing hidden state dynamics to adapt based on the input stimulus. On simple polygon images, we found the model learned to use these parameters to produce shape-specific wave dynamics: 6/14
270
T. Anderson Keller @andykeller.bsky.social · 10/03/2025
To test this, we needed a task; so we opted for semantic segmentation on large images, but crucially with neurons having very small one-step receptive fields. Thus, if we were able to decode global shape information from each neuron, it must be coming from recurrent dynamics. 5/14
Visualization of the input stimuli to our network (left) and the target segmentation labels by color (right). The receptive field of the final layer neurons in our model is plotted as the yellow box, demonstrating that a single neuron has no way to know what shape it may be a part of simply from its local neighborhood, and therefore will require global integration of information over time to solve the task.
260
T. Anderson Keller @andykeller.bsky.social · 10/03/2025
We found that, in-line with theory, we could reliably predict the area of the drum analytically by looking at the fundamental frequency of oscillations of each neuron in our hidden state. But is this too simple? How much further can we take it if we add learnable parameters? 4/14
Visualization of the same wave-based RNN on two drums of different sizes (13 and 33 side length respectively). In the middle (in purple) we show the displacement of the drum head at a point just off the center, and (in red) the theoretical fundamental frequency of vibration that we can analytically derive for a square of side length L plotted. On the right we show the Fourier transform of these time-series dynamics, showing the frequency peak in the expected location. This validates we can estimate the size of a drum head from the frequency spectrum of vibration at any point.
161
T. Anderson Keller @andykeller.bsky.social · 10/03/2025
Inspired by Mark Kac’s famous question, "Can one hear the shape of a drum?" we thought: Maybe a neural network can use wave dynamics to integrate spatial information and effectively "hear" visual shapes... To test this, we tried feeding images of squares to a wave-based RNN: 3/14
191
T. Anderson Keller @andykeller.bsky.social · 10/03/2025
Just as ripples in water carry information across a pond, traveling waves of activity in the brain have long been hypothesized to carry information from one region of cortex to another (Sato 2012)*; but how can a neural network actually leverage this information? * www.cell.com/neuron/fullt... 2/14
cell.com
Traveling Waves in Visual Cortex
In this Review, Sato et al. summarize the evidence in favor of traveling waves in primary visual cortex. The authors suggest that their substrate may lie in long-range horizontal connections and that ...
171
T. Anderson Keller @andykeller.bsky.social · 10/03/2025
In the physical world, almost all information is transmitted through traveling waves -- why should it be any different in your neural network? Super excited to share recent work with the brilliant @mozesjacobs.bsky.social: "Traveling Waves Integrate Spatial Information Through Time" 1/14
314943
Reposted by T. Anderson Keller
Kempner Institute at Harvard University @kempnerinstitute.bsky.social · 10/03/2025
New research shows neurons learn to encode and transmit information to other spatially distant neurons through traveling waves. Read more in the #KempnerInstitute’s blog: bit.ly/3DrIPEq
072