iiinova — where your digital self keeps evolving

Reposted by Chandan Singh

Koyena Pal @koyena.bsky.social · 22/01/2026

Can models understand each other's reasoning? 🤔 When Model A explains its Chain-of-Thought (CoT) , do Models B, C, and D interpret it the same way? Our new preprint with @davidbau.bsky.social and @csinva.bsky.social explores CoT generalizability 🧵👇 (1/7)

1278

Chandan Singh @csinva.bsky.social · 20/01/2026

Really excited about our new work, which makes building clinical prediction models way easier! AI agents do the grunt work of hypothesizing and validating EHR features, enabling easy auditing by clinicians Iterating yields sensible SOTA (fully interpretable!) models arxiv.org/abs/2601.09072

010

Reposted by Chandan Singh

Naomi Saphra @nsaphra.bsky.social · 29/08/2025

How can an imitative model like an LLM outperform the experts it is trained on? Our new COLM paper outlines three types of transcendence and shows that each one relies on a different aspect of data diversity. arxiv.org/abs/2508.17669

29418

Reposted by Chandan Singh

Alexander Huth @alexanderhuth.bsky.social · 18/08/2025

New paper with @rjantonello.bsky.social @csinva.bsky.social, Suna Guo, Gavin Mischler, Jianfeng Gao, & Nima Mesgarani: We use LLMs to generate VERY interpretable embeddings where each dimension corresponds to a scientific theory, & then use these embeddings to predict fMRI and ECoG. It WORKS!

1178

Reposted by Chandan Singh

RJ Antonello @rjantonello.bsky.social · 18/08/2025

In our new paper, we explore how we can build encoding models that are both powerful and understandable. Our model uses an LLM to answer 35 questions about a sentence's content. The answers linearly contribute to our prediction of how the brain will respond to that sentence. 1/6

1259

Chandan Singh @csinva.bsky.social · 14/08/2025

New paper: Ask 35 simple questions about sentences in a story and use the answers to predict brain responses. Interpretable, compact, & surprisingly high performance in both fMRI and ECoG. 🧵 biorxiv.org/content/10.1...

120

Reposted by Chandan Singh

George Pearkes @peark.es · 06/08/2025

We’ve discovered a literal miracle with almost unlimited potential and it’s being scrapped for *no reason whatsoever*. This isn’t even nihilism, it’s outright worship of death and human suffering.

47103173294

Reposted by Chandan Singh

Jeffrey Bowers @jeffreybowers.bsky.social · 26/06/2025

Binz et al. (in press, Nature) developed an LLM called Centaur that better predicts human responses in 159 of 160 behavioural experiments compared to existing cognitive models. See: arxiv.org/abs/2410.20268

36423

Reposted by Chandan Singh

Bo Liu (Benjamin Liu) @benjamin-eecs.bsky.social · 01/07/2025

We're excited about self-play unlocking continuously improving agents. RL selects CoT patterns from LLMs. Games=perfect testing grounds. SPIRAL: models learn via self-competition. Kuhn Poker → +8.7% math, +18.1 Minerva Math! 🃏 Paper: huggingface.co/papers/2506.... Code: github.com/spiral-rl/spiral

2175

Reposted by Chandan Singh

Paul Bogdan @pbogdan.bsky.social · 24/06/2025

🚨 New preprint 🚨 Prior work has mapped how the brain encodes concepts: If you see fire and smoke, your brain will represent the fire (hot, bright) and smoke (gray, airy). But how do you encode features of the fire-smoke relation? We analyzed fMRI with embeddings extracted from LLMs to find out 🧵

1328

Reposted by Chandan Singh

Mark Lescroart @neuromdl.bsky.social · 12/06/2025

🚨Paper alert!🚨 TL;DR first: We used a pre-trained deep neural network to model fMRI data and to generate images predicted to elicit a large response for each many different parts of the brain. We aggregate these into an awesome interactive brain viewer: piecesofmind.psyc.unr.edu/activation_m...

piecesofmind.psyc.unr.edu

Cortex Feature Visualization

2116

Reposted by Chandan Singh

Greta Tuckute @gretatuckute.bsky.social · 23/05/2025

What are the organizing dimensions of language processing? We show that voxel responses during comprehension are organized along 2 main axes: processing difficulty & meaning abstractness—revealing an interpretable, topographic representational basis for language processing shared across individuals

37129

Reposted by Chandan Singh

Lindia Tjuatja @lindiatjuatja.bsky.social · 09/06/2025

When it comes to text prediction, where does one LM outperform another? If you've ever worked on LM evals, you know this question is a lot more complex than it seems. In our new #acl2025 paper, we developed a method to find fine-grained differences between LMs: 🧵1/9

27020

Reposted by Chandan Singh

Science Magazine @science.org · 21/04/2025

Five people have seen a color never before visible to the naked human eye, thanks to a new retinal stimulation technique called Oz. Learn more in #ScienceAdvances: scim.ag/442Hjn6

scim.ag

Novel color via stimulation of individual photoreceptors at population scale

Image display by cell-by-cell retina stimulation, enabling colors impossible to see under natural viewing.

47211

Reposted by Chandan Singh

Nature Portfolio @natureportfolio.nature.com · 16/04/2025

Two clinical trials reported in Nature demonstrate the safety of stem cell therapies for Parkinson’s disease. The papers investigate the use of cells derived from human induced pluripotent stem cells and human embryonic stem cells. go.nature.com/4ikcJc2 go.nature.com/4jfSRYX 🧪

This is figure 2 from “Phase I/II trial of iPS-cell-derived dopaminergic cells for Parkinson’s disease,” which shows chronological changes in clinical end points.

0429

Reposted by Chandan Singh

Erica Busch @elbusch.bsky.social · 04/04/2025

New preprint! Excited to share our latest work “Accelerated learning of a noninvasive human brain-computer interface via manifold geometry” ft. outstanding former undergraduate Chandra Fincke, @glajoie.bsky.social, @krishnaswamylab.bsky.social, and @wutsaiyale.bsky.social's Nick Turk-Browne 1/8

doi.org

Accelerated learning of a noninvasive human brain-computer interface via manifold geometry

Brain-computer interfaces (BCIs) promise to restore and enhance a wide range of human capabilities. However, a barrier to the adoption of BCIs is how long it can take users to learn to control them. W...

26619

Reposted by Chandan Singh

Leyla Isik @lisik.bsky.social · 14/03/2025

New preprint “Monkey See, Model Knew: LLMs accurately predict visual responses in humans AND NHPs” Led by Colin Conwell with @emaliemcmahon.bsky.social Akshay Jagadeesh, Kasper Vinken @amrahs-inolas.bsky.social @jacob-prince.bsky.social George Alvarez @taliakonkle.bsky.social & Marge Livingstone 1/n

15017

Reposted by Chandan Singh

Nanthia Suthana @suthanalab.bsky.social · 10/03/2025

🚨 New lab paper!🚨 A dream study of mine for nearly 20 yrs not possible until now thanks to NIH 🧠 funding & 1st-author lead @seeber.bsky.social We tracked hippocampal activity as people walked memory-guided paths & imagined them again. Did brain patterns reappear?🧵👇 www.nature.com/articles/s41...

nature.com

Human neural dynamics of real-world and imagined navigation - Nature Human Behaviour

Seeber et al. studied brain recordings from implanted electrodes in freely moving humans. Neural dynamics encoded actual and imagined routes similarly, demonstrating parallels between navigational, im...

1028183

Reposted by Chandan Singh

Naomi Saphra @nsaphra.bsky.social · 03/03/2025

2018: Saliency maps give plausible interpretations of random weights, triggering skepticism and catalyzing the mechinterp cultural movement, which now advocates for SAEs. 2025: SAEs give plausible interpretations of random weights, triggering skepticism and ...

Sanity Checks for Saliency Maps
Julius Adebayo, Justin Gilmer, Michael Muelly, Ian Goodfellow, Moritz Hardt, Been Kim
Saliency methods have emerged as a popular tool to highlight features in an input deemed relevant for the prediction of a learned model. Several saliency methods have been proposed, often guided by visual appeal on image data. In this work, we propose an actionable methodology to evaluate what kinds of explanations a given method can and cannot provide. We find that reliance, solely, on visual assessment can be misleading. Through extensive experiments we show that some existing saliency methods are independent both of the model and of the data generating process. Consequently, methods that fail the proposed tests are inadequate for tasks that are sensitive to either data or model, such as, finding outliers in the data, explaining the relationship between inputs and outputs that the model learned, and debugging the model. We interpret our findings through an analogy with edge detection in images, a technique that requires neither training data nor model. Theory in the case of a linear model and a single-layer convolutional neural network supports our experimental findings.

Sparse Autoencoders Can Interpret Randomly Initialized Transformers
Thomas Heap, Tim Lawson, Lucy Farnik, Laurence Aitchison
Sparse autoencoders (SAEs) are an increasingly popular technique for interpreting the internal representations of transformers. In this paper, we apply SAEs to 'interpret' random transformers, i.e., transformers where the parameters are sampled IID from a Gaussian rather than trained on text data. We find that random and trained transformers produce similarly interpretable SAE latents, and we confirm this finding quantitatively using an open-source auto-interpretability pipeline. Further, we find that SAE quality metrics are broadly similar for random and trained transformers. We find that these results hold across model sizes and layers. We discuss a number of number interesting questions that this work raises for the use of SAEs and auto-interpretability in the context of mechanistic interpretability.

29515

Reposted by Chandan Singh

Ilyass Moummad @ilyassmoummad.bsky.social · 18/02/2025

Yi Ma & colleagues managed to simplify DINO & DINOv2 by removing many ingredients and adding a robust regularization term from information theory (coding rate) that learn informative decorrelated features. Happy to see principled approaches advance deep representation learning!

173

Reposted by Chandan Singh

Pablo Samuel Castro @pcastr.bsky.social · 10/02/2025

Can LLMs be used to discover interpretable models of human and animal behavior?🤔 Turns out: yes! Thrilled to share our latest preprint where we used FunSearch to automatically discover symbolic cognitive models of behavior. 1/12

313645

Reposted by Chandan Singh

Antonino Greco @agreco.bsky.social · 24/12/2024

"...responses of V4 neurons under naturalistic conditions can be explained by a hierarchical three-stage model where each stage consists entirely of units like those found in area V1" #NeuroAI www.biorxiv.org/content/10.1...

03815

Chandan Singh @csinva.bsky.social · 07/12/2024

At NeurIPS this week, presenting our work on crafting *interpretable embeddings* by asking yes/no questions to black-box LLMs. Drop me a message if you want to chat about interpretability/language neuroscience!

070

Reposted by Chandan Singh

Julian Skirzynski @jskirzynski.bsky.social · 23/11/2024

I tried to find everyone who works in the area but I certainly missed some folks so please lmk... go.bsky.app/BYkRryU

325318

Chandan Singh @csinva.bsky.social · 20/11/2024

Science faces an explainability crisis: ML models can predict many natural phenomena but can't explain them We tackle this issue in language neuroscience by using LLMs to generate *and validate* explanations with targeted follow-up experiments

020

Chandan Singh @csinva.bsky.social · 20/11/2024

Mechanistic interp has made cool findings but struggled to make them useful We show that "induction heads" found in LLMs can be reverse-engineered to yield accurate & interpretable next-word prediction models

010