Sign in

Andrea de Varda

@andreadevarda.bsky.social
395 followers 400 following 52 posts

Postdoc at MIT BCS, interested in language(s) in humans and LMs andrea-de-varda.github.io

PostsRepliesMedia
Reposted by Andrea de Varda
Greta Tuckute @gretatuckute.bsky.social · 17/09/2026
Thanks so much for the fun conversation @wiair.bsky.social ! A pleasure to chat about language, LLMs, and memory--covering some work with @bkhmsi.bsky.social @mschrimpf.bsky.social @michael-lepori.bsky.social @klemenkotar.bsky.social @evfedorenko.bsky.social @thomashikaru.bsky.social, among others!
1245
Reposted by Andrea de Varda
Ev Fedorenko @evfedorenko.bsky.social · 01/09/2026
Go, @andreadevarda.bsky.social! A beautiful and comprehensive study! 🔑 findng: behav. measures are ~fully reducible to simple predictors of processing effort (surprisal, word length+frequency), but for 🧠 measures, LLM embeddings carry additional predictive power, likely capturing aspects of meaning.
093
Reposted by Andrea de Varda
Yevgeni Berzak @whylikethis.bsky.social · 02/09/2026
Wonderful work by @andreadevarda.bsky.social linking behavioral and neural manifestations of language comprehension using language models. With @rplevy.bsky.social and @evfedorenko.bsky.social
162
Andrea de Varda @andreadevarda.bsky.social · 01/09/2026
New preprint! 🧠👀🤖 Behavioral and brain responses to language reflect different levels of linguistic representation w/ @whylikethis.bsky.social , @evfedorenko.bsky.social , and @rplevy.bsky.social (1/10)
1356
Reposted by Andrea de Varda
Chiara Saponaro @chiarasaponaro.bsky.social · 20/08/2026
New paper out! 🎉 Can preverbal logical inferences scaffold the early acquisition of logical words? We asked this question with Mahham Fayyaz, Grace Pavalko and Nicolò Cesana-Arlotti, focusing on disjunction: escholarship.org/uc/item/3pf7....
escholarship.org
1124
Andrea de Varda @andreadevarda.bsky.social · 07/08/2026
Bowers and colleagues (B&al) have a new response to our paper on the cost of thinking in reasoning models and humans. Here we address the core disagreements.🧵
142
Reposted by Andrea de Varda
Cognitive Science Society @cogscisociety.bsky.social · 25/07/2026
First up in the Glushko Dissertation Prize Symposium: Andrea de Varda @andreadevarda.bsky.social examines what multilingual neural language models can reveal about language and cognition. #CogSci2026
1302
Reposted by Andrea de Varda
Damián Blasi @damianblasi.bsky.social · 23/07/2026
How many languages have existed over the Holocene—and what does that reveal about the design space of languages and cultures? Now out in @science.org www.science.org/eprint/QDZNY....
science.org
The rise and fall of language diversity through the Holocene
Characterizing the factors that have shaped linguistic diversity is fundamental for understanding human history, culture, and cognition. In this study, we combined statistical and social computational...
213254
Reposted by Andrea de Varda
micha heilbron @mheilbron.bsky.social · 16/07/2026
What makes some stimuli more memorable than others? In a new paper w/ @davogelsang.bsky.social, we show that the magnitude of a stimulus's ANN representation predicts both image and word memorability Stimuli that activate more features, more strongly, leave a stronger memory trace Out now in JML⬇️
34411
Reposted by Andrea de Varda
MilaNLP Lab @milanlp.bsky.social · 13/07/2026
🧠🤖 It was a pleasure to host @andreadevarda.bsky.social for his talk, "Large Language Models as Models of Human Language(s) and Higher-Level Cognition." A truly inspiring talk! #NLProc
093
Reposted by Andrea de Varda
Ev Fedorenko @evfedorenko.bsky.social · 30/06/2026
I am so excited about this finding from @pengrui-han.bsky.social and @andreadevarda.bsky.social, also with Jacob Andreas! Perhaps modularity is inevitable in intelligent systems, biological or in silico. :)
0336
Reposted by Andrea de Varda
pengrui-han.bsky.social @pengrui-han.bsky.social · 30/06/2026
The human brain is strikingly modular: distinct networks for language, formal reasoning, social reasoning, physical reasoning. Is this fundamental to intelligent systems, or an accident of evolution? In our new preprint, we find the same modular organization emerges in LLMs.
129320
Andrea de Varda @andreadevarda.bsky.social · 01/07/2026
Like the human brain, LLMs use separate sets of units for language, formal reasoning, social reasoning, and intuitive physical reasoning. A modular organization of cognition may be a fundamental principle of intelligence!
0133
Reposted by Andrea de Varda
Anna (Anya) Ivanova @neuranna.bsky.social · 12/06/2026
Thanks to the Weber School for inviting me to give a #TEDx talk! I discuss how much people vary in their inner thought — from thinking mainly in words to thinking mostly abstractly — and the implications it has for understanding AI cognition. youtu.be/WAm0XQIRBMw
youtu.be
Do We Think In Words? Does AI? | Anna Ivanova | TEDxWeber School Youth
YouTube video by TEDx Talks
1245
Reposted by Andrea de Varda
Tom McCoy @rtommccoy.bsky.social · 22/05/2026
🤖🧠NEW PAPER🧠🤖 Children & neural networks can learn syntax from linear strings of words. How do they do it? Our hypothesis: Word co-occurrence statistics provide cues to syntax! (I.e., a new type of bootstrapping to consider!) Paper: arxiv.org/abs/2605.20529 1/n
Paper overview.
Title: "Collocational bootstrapping: A hypothesis about the learning of subject-verb agreement in humans and neural networks"
Authors: Claire Hobbs and Tom McCoy
Method: We trained many neural nets, varying how predictable a subject is given its verb. We tested them on subject-verb agreement
Findings: With the right level of predictability, neural networks robustly generalize. The predictability of child-directed language is near the neural net optimum.
Conclusion: Statistical regularities in word co-occurrence can support the learning of abstract syntactic rules
The text is accompanied by a graph showing neural-network accuracy as a function of the level of variability; the accuracy peaks at an in-between level of variability
2395
Reposted by Andrea de Varda
Adele Goldberg @adelegoldberg.bsky.social · 27/02/2026
Idan Blank (UCLA, psych) makes the complex intuitive if you want to learn how LLMs work, watch👇 newly posted to YouTube (no ads) www.youtube.com/watch?v=cGMn...
youtu.be
How Transformers Work: A Detailed, Conceptual Explanation (No Coding / Math)
YouTube video by IbanDlank
06815
Reposted by Andrea de Varda
Chiara Saponaro @chiarasaponaro.bsky.social · 17/03/2026
Can we process meaning unconsciously? Our new study suggests: not really… unless language has a way to express it!🧵 New paper out with Andrea Nadalini, Daniel Casasanto, @davidecrepaldi.bsky.social and Roberto Bottini
1131
Reposted by Andrea de Varda
Catherine Arnett @catherinearnett.bsky.social · 09/03/2026
@tylerachang.bsky.social and I will be presenting the Goldfish as an oral at #LREC2026 in Mallorca! 🌴
1204
Reposted by Andrea de Varda
Badr AlKhamissi @bkhmsi.bsky.social · 27/01/2026
Happy to share that our paper “Mixture of Cognitive Reasoners: Modular Reasoning with Brain-Like Specialization” (aka MiCRo) has been accepted to #ICLR2026!! 🎉 See you in Rio 🇧🇷 🏝️
072
Reposted by Andrea de Varda
CIMeC_UniTrento @cimecunitrento.bsky.social · 27/01/2026
Bridge AI and linguistics with the Computational and Theoretical Modelling of Language and Cognition (CLC) track at @cimecunitrento.bsky.social! Apply to our MSc in Cognitive Science First-call deadline for non-EU applicants: March 4, 2026. ℹ️ corsi.unitn.it/en/cognitive-science #cimec_unitrento #AI
032
Reposted by Andrea de Varda
Anna (Anya) Ivanova @neuranna.bsky.social · 11/12/2025
The last chapter of my PhD (expanded) is finally out as a preprint! “Semantic reasoning takes place largely outside the language network” 🧠🧐 www.biorxiv.org/content/10.6... What is semantic reasoning? Read on! 🧵👇
biorxiv.org
Semantic reasoning takes place largely outside the language network
The brain's language network is often implicated in the representation and manipulation of abstract semantic knowledge. However, this view is inconsistent with a large body of evidence suggesting that...
29126
Andrea de Varda @andreadevarda.bsky.social · 10/12/2025
Some words sound like what they mean. In IconicITA we show that the (psycho)linguistic factors that modulate which words are most iconic are similar between English and Italian. Lots more details in the paper!
151
Andrea de Varda @andreadevarda.bsky.social · 10/12/2025
Great work led by Daria & Greta showing that diverse agreement types draw on shared units (even across languages)!
093
Reposted by Andrea de Varda
Colton Casto @coltoncasto.bsky.social · 26/11/2025
What does it mean to understand language? We argue that the brain’s core language system is limited, and that *deeply* understanding language requires EXPORTING info to other brain regions. w/ @neuranna.bsky.social @evfedorenko.bsky.social @nancykanwisher.bsky.social arxiv.org/abs/2511.19757 1/n🧵👇
arxiv.org
What does it mean to understand language?
Language understanding entails not just extracting the surface-level meaning of the linguistic input, but constructing rich mental models of the situation it describes. Here we propose that because pr...
28233
Andrea de Varda @andreadevarda.bsky.social · 21/11/2025
Computational psycho/neurolinguistics is lots of fun, but most studies only focus on English. If you think cross-linguistic evidence matters for understanding the language system, consider submitting an abstract to MMMM 2026!
mmmm2026.github.io
Multilingual Minds and Machines Meeting 2026
This is a great workshop that will bring together amazing people.
020
Andrea de Varda @andreadevarda.bsky.social · 19/11/2025
Our paper “The cost of thinking is similar between large reasoning models and humans” is now out in PNAS! 🤖🧠 w/ @fepdelia.bsky.social, @hopekean.bsky.social, @lampinen.bsky.social, and @evfedorenko.bsky.social Link: www.pnas.org/doi/10.1073/... (1/6)
pnas.org
PNAS
Proceedings of the National Academy of Sciences (PNAS), a peer reviewed journal of the National Academy of Sciences (NAS) - an authoritative source of high-impact, original research that broadly spans...
14010
Reposted by Andrea de Varda
Tom McCoy @rtommccoy.bsky.social · 14/11/2025
🤖🧠I'll be considering applications for PhD students & postdocs to start at Yale in Fall 2026! If you are interested in the intersection of linguistics, cognitive science, & AI, I encourage you to apply! PhD link: rtmccoy.com/prospective_... Postdoc link: rtmccoy.com/prospective_...
Top: A syntax tree for the sentence "the doctor by the lawyer saw the artist".

Bottom: A continuous vector.
23713
Reposted by Andrea de Varda
micha heilbron @mheilbron.bsky.social · 18/08/2025
New preprint! w/@drhanjones.bsky.social Adding human-like memory limitations to transformers improves language learning, but impairs reading time prediction This supports ideas from cognitive science but complicates the link between architecture and behavioural prediction arxiv.org/abs/2508.05803
arxiv.org
Human-like fleeting memory improves language learning but impairs reading time prediction in transformer language models
Human memory is fleeting. As words are processed, the exact wordforms that make up incoming sentences are rapidly lost. Cognitive scientists have long believed that this limitation of memory may, para...
1112
Reposted by Andrea de Varda
Greta Tuckute @gretatuckute.bsky.social · 10/08/2025
Can't wait for #CCN2025! Drop by to say hi to me / collaborators!
0271
Reposted by Andrea de Varda
Hope Kean @hopekean.bsky.social · 03/08/2025
Is the Language of Thought == Language? A Thread 🧵 New Preprint (link: tinyurl.com/LangLOT) with @alexanderfung.bsky.social, Paris Jaggers, Jason Chen, Josh Rule, Yael Benn, @joshtenenbaum.bsky.social, ‪@spiantado.bsky.social‬, Rosemary Varley, @evfedorenko.bsky.social 1/8
tinyurl.com
Evidence from Formal Logical Reasoning Reveals that the Language of Thought is not Natural Language
Humans are endowed with a powerful capacity for both inductive and deductive logical thought: we easily form generalizations based on a few examples and draw conclusions from known premises. Humans al...
68133
Reposted by Andrea de Varda
Marianne de Heer Kloots @mdhk.net · 24/07/2025
Next week I’ll be in Vienna for my first *ACL conference! 🇦🇹✨ I will present our new BLiMP-NL dataset for evaluating language models on Dutch syntactic minimal pairs and human acceptability judgments ⬇️ 🗓️ Tuesday, July 29th, 16:00-17:30, Hall X4 / X5 (Austria Center Vienna)
The BLiMP-NL dataset consists of 84 Dutch minimal pair paradigms covering 22 syntactic phenomena, and comes with graded human acceptability ratings & self-paced reading times. 

An example minimal pair:
A. Ik bekijk de foto van mezelf in de kamer (I watch the photograph of myself in the room; grammatical)
B. Wij bekijken de foto van mezelf in de kamer (We watch the photograph of myself in the room; ungrammatical)

Differences in human acceptability ratings between sentences correlate with differences in model syntactic log-odds ratio scores.
2284
Reposted by Andrea de Varda
Marco Ciapparelli @marcociapparelli.bsky.social · 18/07/2025
I'm sharing a Colab notebook on using large language models for cognitive science! GitHub repo: github.com/MarcoCiappar... It's geared toward psychologists & linguists and covers extracting embeddings, predictability measures, comparing models across languages & modalities (vision). see examples 🧵
1114
Reposted by Andrea de Varda
ERCbravenewword @ercbravenewword.bsky.social · 04/07/2025
📢 New paper out! We show that auditory iconicity is not marginal in English: word sounds often resemble real-world sounds. Using neural networks and sound similarity measures, we crack the myth of arbitrariness. Read more: link.springer.com/article/10.3... @andreadevarda.bsky.social
link.springer.com
Cracking arbitrariness: A data-driven study of auditory iconicity in spoken English - Psychonomic Bulletin & Review
Auditory iconic words display a phonological profile that imitates their referents’ sounds. Traditionally, those words are thought to constitute a minor portion of the auditory lexicon. In this articl...
041
Reposted by Andrea de Varda
Ben Lipkin @benlipkin.bsky.social · 13/05/2025
Many LM applications may be formulated as text generation conditional on some (Boolean) constraint. Generate a… - Python program that passes a test suite. - PDDL plan that satisfies a goal. - CoT trajectory that yields a positive reward. The list goes on… How can we efficiently satisfy these? 🧵👇
2136
Reposted by Andrea de Varda
Colton Casto @coltoncasto.bsky.social · 21/04/2025
New paper! 🧠 **The cerebellar components of the human language network** with: @hsmall.bsky.social @moshepoliak.bsky.social @gretatuckute.bsky.social @benlipkin.bsky.social @awolna.bsky.social @aniladmello.bsky.social and @evfedorenko.bsky.social www.biorxiv.org/content/10.1... 1/n 🧵
biorxiv.org
The cerebellar components of the human language network
The cerebellum's capacity for neural computation is arguably unmatched. Yet despite evidence of cerebellar contributions to cognition, including language, its precise role remains debated. Here, we sy...
24918
Reposted by Andrea de Varda
Greta Tuckute @gretatuckute.bsky.social · 10/04/2025
PINEAPPLE, LIGHT, HAPPY, AVALANCHE, BURDEN Some of these words are consistently remembered better than others. Why is that? In our paper, just published in J. Exp. Psychol., we provide a simple Bayesian account and show that it explains >80% of variance in word memorability: tinyurl.com/yf3md5aj
tinyurl.com
APA PsycNet
13914
Reposted by Andrea de Varda
Agata Wolna @awolna.bsky.social · 03/04/2025
Excited to share new work on the language system! Using a large fMRI dataset (n=772) we comprehensively search for language-selective regions across the brain. w/ Aaron Wright, @benlipkin.bsky.social, and @evfedorenko.bsky.social Link to the preprint: biorxiv.org/content/10.1... Thread below!👇🧵
biorxiv.org
The extended language network: Language selective brain areas whose contributions to language remain to be discovered
Although language neuroscience has largely focused on core left frontal and temporal brain areas and their right-hemisphere homotopes, numerous other areas - cortical, subcortical, and cerebellar - ha...
1268
Reposted by Andrea de Varda
Cory Shain @coryshain.bsky.social · 31/03/2025
New brain/language study w/ @evfedorenko.bsky.social! We applied task-agnostic individualized functional connectomics (iFC) to the entire history of fMRI scanning in the Fedorenko lab, parcellating nearly 1200 brains into networks based on activity fluctuations alone. doi.org/10.1101/2025... . 🧵
doi.org
A language network in the individualized functional connectomes of over 1,000 human brains doing arbitrary tasks
A century and a half of neuroscience has yielded many divergent theories of the neurobiology of language. Two factors that likely contribute to this situation include (a) conceptual disagreement…
14213
Reposted by Andrea de Varda
Marco Ciapparelli @marcociapparelli.bsky.social · 19/03/2025
1/n Happy to share a new paper with Calogero Zarbo & Marco Marelli! How well do LLMs represent the implicit meaning of familiar and novel compounds? How do they compare with simpler distributional semantics models (DSMs; i.e., word embeddings)? doi.org/10.1111/cogs...
doi.org
Conceptual Combination in Large Language Models: Uncovering Implicit Relational Interpretations in Compound Words With Contextualized Word Embeddings
Large language models (LLMs) have been proposed as candidate models of human semantics, and as such, they must be able to account for conceptual combination. This work explores the ability of two LLM...
1134
Reposted by Andrea de Varda
Ev Fedorenko @evfedorenko.bsky.social · 18/03/2025
So excited to have our work on conlangs out in PNAS: www.pnas.org/doi/10.1073/... Congrats, Saima, Maya, and the rest of the crew -- well done! Here is the MIT news story: news.mit.edu/2025/esperan...
news.mit.edu
To the brain, Esperanto and Klingon appear the same as English or Mandarin
MIT research finds the brain’s language-processing network also responds to artificial languages such as Esperanto and languages made for TV, such as Klingon on “Star Trek” and High Valyrian and Dothr...
05418
Reposted by Andrea de Varda
Siyuan Song @siyuansong.bsky.social · 12/03/2025
New preprint w/ @jennhu.bsky.social @kmahowald.bsky.social : Can LLMs introspect about their knowledge of language? Across models and domains, we did not find evidence that LLMs have privileged access to their own predictions. 🧵(1/8)
26116
Andrea de Varda @andreadevarda.bsky.social · 04/02/2025
New preprint! 🧠🤖 Brain encoding in 21 languages! www.biorxiv.org/content/10.1... w/ Saima Malik-Moraleda, @gretatuckute.bsky.social , and @evfedorenko.bsky.social (1/)
biorxiv.org
Multilingual Computational Models Reveal Shared Brain Responses to 21 Languages
At the heart of language neuroscience lies a fundamental question: How does the human brain process the rich variety of languages? Recent developments in Natural Language Processing, particularly in m...
1185