Sign in

Raphaël Millière

@raphaelmilliere.com
7.2K followers 1.5K following 149 posts

Philosopher of Artificial Intelligence & Cognitive Science raphaelmilliere.com

PostsRepliesMedia
Reposted by Raphaël Millière
John Morrison @johnmorrison.bsky.social · 05/08/2026
with @raphaelmilliere.com
0112
Reposted by Raphaël Millière
John Morrison @johnmorrison.bsky.social · 21/07/2026
This should be fun! I'll be talking about what it means for a neural network to have a world model (joint work with @raphaelmilliere.com) and presenting new evidence that the standard example, Othello-GPT, does not have one (joint work with @shauli.bsky.social among others).
1183
Raphaël Millière @raphaelmilliere.com · 04/07/2026
I’ll be at #ICML2026 in Seoul all week. If you’re interested in the intersection of cognitive science, mechanistic interpretability, and philosophy -- let’s chat! DMs are open. Check my website for more on what I work on (raphaelmilliere.com), or see below.
1121
Reposted by Raphaël Millière
Jennifer Hu @jennhu.bsky.social · 01/07/2026
Sadly won't be at ACL in person, but check out our presentations below! 🌟 I'm giving a (remote) keynote at SCiL on 7/4! 🌟We also have a poster on probability x grammaticality, and a talk on pragmatics x Theory of Mind! Our lab is actively recruiting, so please reach out! Details at glintlab.org ✨
1214
Raphaël Millière @raphaelmilliere.com · 02/07/2026
My commentary on @kmahowald.bsky.social & @futrell.bsky.social's excellent BBS paper on the relevance and significance of LLMs for linguistics is now out, along with many other peer commentaries: www.cambridge.org/core/journal... (preprint to follow)
0151
Raphaël Millière @raphaelmilliere.com · 11/06/2026
Now published in open access! Your one-stop shop for the philosophy of language models. It's the spiritual descendant of our two-part preprint from 2024, fully updated. This should be particularly useful for anyone looking for an entry point into this rapidly growing field.
compass.onlinelibrary.wiley.com
The Philosophy of Language Models
The success of large language models (LLMs) across many domains of AI research has generated intense debate. Some attribute their impressive performance on complex tasks to human-like linguistic and ...
211032
Raphaël Millière @raphaelmilliere.com · 04/05/2026
Looking foward to this!
030
Reposted by Raphaël Millière
Kyle Mahowald @kmahowald.bsky.social · 17/04/2026
Richard @futrell.bsky.social and I have posted our response to the commentaries on our BBS target article "How Linguistics Learned to Stop Worrying and Love the Language Models." The response is: "You Can't Fight in Here! This is BBS!" arxiv.org/abs/2604.09501
arxiv.org
You Can't Fight in Here! This is BBS!
Norm, the formal theoretical linguist, and Claudette, the computational language scientist, have a lovely time discussing whether modern language models can inform important questions in the language ...
13513
Raphaël Millière @raphaelmilliere.com · 14/04/2026
Looking forward to speaking at this ICML workshop on ML & Philosophy! Check out the full lineup and CFP below (deadline: May 11th). Despite the title, the CFP is open to work in many areas of the philosophy of AI, not just AI ethics. sites.google.com/view/philmli...
1132
Reposted by Raphaël Millière
Mark Riedl @markriedl.bsky.social · 04/02/2026
New work by my former PhD student, Boyang Li His team produced 500 stories of less than 100 words. LLMs were basically chance-level at answering binary questions about the stories arxiv.org/abs/2601.12410
arxiv.org
Are LLMs Smarter Than Chimpanzees? An Evaluation on Perspective Taking and Knowledge State Estimation
Cognitive anthropology suggests that the distinction of human intelligence lies in the ability to infer other individuals' knowledge states and understand their intentions. In comparison, our closest ...
612114
Reposted by Raphaël Millière
Tomer Ullman @tomerullman.bsky.social · 27/01/2026
now accepted at ICLR! 🐺🥳🐺 arxiv.org/abs/2506.20666
0409
Raphaël Millière @raphaelmilliere.com · 20/01/2026
Very cool idea! Some quick thoughts. It looks like the corruption preserves a lot of information (function words, morphology, word order, punctuation, numbers, register) which would strongly constrains the posterior over plausible discourse frames as it were. 1/3
1171
Reposted by Raphaël Millière
Department of Statistics @oxfordstatistics.bsky.social · 26/08/2025
With @jesusoxford.bsky.social we are looking for a Professor of Statistics. Become part of a historic institution and a community focused on academic excellence, innovative thinking, and significant practical application. About the role: tinyurl.com/b8uy6mr5 Deadline: 15 September
Jesus College
143
Raphaël Millière @raphaelmilliere.com · 21/08/2025
I'm happy to share that I'll be joining Oxford this fall as an associate professor, as well as a fellow of @jesusoxford.bsky.social and affiliate with the Institute for Ethics in AI. I'll also begin my AI2050 Fellowship from @schmidtsciences.bsky.social there. Looking forward to getting started!
3480
Raphaël Millière @raphaelmilliere.com · 11/08/2025
Can LLMs reason by analogy like humans? We investigate this question in a new paper published in the Journal of Memory and Language (link below). This was a long-running but very rewarding project. Here are a few thoughts on our methodology and main findings. 1/9
514038
Raphaël Millière @raphaelmilliere.com · 18/07/2025
I wrote an entry on Transformers for the Open Encyclopedia of Cognitive Science (‪@oecs-bot.bsky.social‬). I had to work with a tight word limit, but I hope it's useful as a short introduction for students and researchers who don't work on machine learning: oecs.mit.edu/pub/ppxhxe2b
oecs.mit.edu
Transformers
15412
Raphaël Millière @raphaelmilliere.com · 14/07/2025
Happy to share this updated Stanford Encyclopedia of Philosophy entry on 'Associationist Theories of Thought' with @ericman.bsky.social. Among other things, we included a new major section on reinforcement learning. Many thanks to Eric for bringing me on board! plato.stanford.edu/entries/asso...
plato.stanford.edu
Associationist Theories of Thought (Stanford Encyclopedia of Philosophy)
1398
Reposted by Raphaël Millière
Sam Gershman @gershbrain.bsky.social · 09/07/2025
The sycophantic tone of ChatGPT always sounded familiar, and then I recognized where I'd heard it before: author response letters to reviewer comments. "You're exactly right, that's a great point!" "Thank you so much for this insight!" Also how it always agrees even when it contradicts itself.
518722
Raphaël Millière @raphaelmilliere.com · 10/06/2025
Despite extensive safety training, LLMs remain vulnerable to “jailbreaking” through adversarial prompts. Why does this vulnerability persist? In a new paper published in Philosophical Studies, I argue this is because current alignment methods are fundamentally shallow. 🧵 1/13
4638
Raphaël Millière @raphaelmilliere.com · 03/06/2025
Transformer-based neural networks achieve impressive performance on coding, math & reasoning tasks that require keeping track of variables and their values. But how can they do that without explicit memory? 📄 Our new ICML paper investigates this in a synthetic setting! 🎥 youtu.be/Ux8iNcXNEhw 🧵 1/13
youtu.be
How Do Transformers Learn Variable Binding in Symbolic Programs?
YouTube video by Raphaël Millière
1527
Reposted by Raphaël Millière
Andrew Perfors @perfors.net · 12/02/2025
Ah... the morning Australian ritual, waking up and checking into Bluesky with the thought "what fresh hell happened overnight while I was asleep?"
4311
Raphaël Millière @raphaelmilliere.com · 06/02/2025
I'm mildly amused by the fact that when you watch obscure videos on syntactic theory, Youtube will serve you ads for Gammarly
0100
Raphaël Millière @raphaelmilliere.com · 03/02/2025
I'm back in the Bay Area for this great workshop at UC Berkeley – if you're in the area and interested in LLMs & Cog Sci, come along! simons.berkeley.edu/workshops/ll...
simons.berkeley.edu
LLMs, Cognitive Science, Linguistics, and Neuroscience
At a conceptual level, LLMs profoundly change the landscape for theories of human language, of the brain and computation, and of the nature of human intelligence. In linguistics, they provide a new wa...
1180
Raphaël Millière @raphaelmilliere.com · 17/01/2025
Losing Lynch is a strange feeling. This is hardly an original thing to say, but his work left a big impression on me since I was a teenager. I've rewatched most of his movies over the past year, they're every bit as enthralling as I remembered them. Now it's time to rewatch Twin Peaks!
media.tenor.com
a woman is sitting at a table with the words " one day the sadness will end "
ALT: a woman is sitting at a table with the words " one day the sadness will end "
1200
Raphaël Millière @raphaelmilliere.com · 17/12/2024
My article 'Constitutive Self-Consciousness' is now published online in the Australasian Journal of Philosophy. It argues (spoiler alert!) against the claim that self-consciousness is constitutive of consciousness.
The claim that consciousness constitutively involves self-consciousness has a long philosophical history, and has received renewed support in recent years. My aim in this paper is to argue that this surprisingly enduring idea is misleading at best, and insufficiently supported at worst. I start by offering an elucidatory account of consciousness, and outlining a number of foundational claims that plausibly follow from it. I subsequently distinguish two notions of self-consciousness: consciousness of oneself and consciousness of one’s experience. While ‘self-consciousness’ is often taken to refer to the former notion, the most common variant of the constitutive claim, on which I focus here, targets the latter. This claim can be further interpreted in two ways: on a deflationary reading, it falls within the scope of foundational claims about consciousness, while on an inflationary reading, it points to determinate aspects of phenomenology that are not acknowledged by the foundational claims as being aspects of all conscious mental states. I argue that the deflationary reading of the constitutive claim is plausible, but should be formulated without using a term as polysemous and suggestive as ‘self-consciousness’; by contrast, the inflationary reading is not adequately supported, and ultimately rests on contentious intuitions about phenomenology. I conclude that we should abandon the idea that self-consciousness is constitutive of consciousness.
1203
Raphaël Millière @raphaelmilliere.com · 11/12/2024
I'm happy to share that I'll be one of Schmidt Sciences's new AI2050 fellows! I'll be focusing on addressing the risk of interpretability illusions in AI – cases where interpretability methods yield seemingly plausible yet incorrect explanations. www.schmidtsciences.org/schmidt-scie...
schmidtsciences.org
Schmidt Sciences to Award $12 Million to Advance Research on Beneficial AI
AI2050 fellowships recognize scholars working to create AI for a better world
3400
Reposted by Raphaël Millière
Mike Frank @mcxfrank.bsky.social · 03/12/2024
Three ManyBabies projects - big collaborative replications of infancy phenomena - wrapped up this year. The first paper came out this fall. I thought I'd take this chance to comment on what I make of the non-replication result. 🧵 bsky.app/profile/laur...
213759
Reposted by Raphaël Millière
Clément Canonne @ccanonne.github.io · 28/11/2024
He's making a list, He's checking it twice He's gonna find out Who's naughty or... Searching in an unsorted list takes linear time, Christmas is postponed to January
9533
Raphaël Millière @raphaelmilliere.com · 25/11/2024
Inspired by @mariaa.bsky.social's custom feed for NLP papers, I created a custom feed for philosophy papers posted on BlueSky. It's not perfect, but it works decently well: bsky.app/profile/did:...
24814
Raphaël Millière @raphaelmilliere.com · 23/11/2024
Happy to see Bluesky taking off. Here's an attempt at a Philosophy of AI starter pack: go.bsky.app/8pf4odt
136113
Raphaël Millière @raphaelmilliere.com · 23/11/2024
I also persist in saying "computational resources" which almost feels old-fashioned. Though I believe that's what linguists call deverbal zero-nominalization and it's pretty common in English, so at some point it'll probably become part of the lexicon?
170
Reposted by Raphaël Millière
Tomer Ullman @tomerullman.bsky.social · 15/11/2024
reinforcement learning
1486
Raphaël Millière @raphaelmilliere.com · 15/11/2024
PSA: If you're on Bluesky and Mastodon (or another fediverse network), you can bridge the two with this tool: fed.brid.gy
fed.brid.gy
Bridgy Fed
1103
Reposted by Raphaël Millière
Clément Canonne @ccanonne.github.io · 02/11/2024
ICYMI: The School of Computer Science at the University of Sydney 🇦🇺 is hiring, with multiple (equiv.) tenure-track positions. All areas of CS welcome, with a specific focus on Systems, PL, ML, and Quantum Computing. usyd.wd3.myworkdayjobs.com/en-US/USYD_E... Please share, and get in touch!
usyd.wd3.myworkdayjobs.com
Multiple Continuing (Tenure-Track) Academic Positions, School of Computer Science, The University of Sydney
Join a growing Faculty and be part of a University that places amongst the world’s best teaching and research institutions Located in the heart of Sydney’s bustling inner west quarter, close to beache...
12113
Reposted by Raphaël Millière
Melanie Mitchell @melaniemitchell.bsky.social · 04/10/2024
Graduating PhDs and postdocs in AI, ML, Cogsci, or related areas: apply to work with me and others on AI models of visual and multimodal reasoning. Two years of funding with possible extension to a third year. Application deadline November 22. santafe.edu/about/jobs/p...
santafe.edu
sfiscience
SFI seeksa full-time postdoctoral fellow to collaborate with Dr. Melanie Mitchell and other project participants in developing AI models of visual and multimodal reasoning.
01517
Raphaël Millière @raphaelmilliere.com · 03/10/2024
New chapter with @cameronbuckner.bsky.social on interventionist methods for interpreting deep neural networks. We review and discuss the significance of recent developments in interpretability research on DNNs from a philosophical perspective. 1/6 philpapers.org/rec/MILIMF-2
philpapers.org
Raphaël Millière & Cameron Buckner, Interventionist Methods for Interpreting Deep Neural Networks - PhilPapers
Recent breakthroughs in artificial intelligence have primarily resulted from training deep neural networks (DNNs) with vast numbers of adjustable parameters on enormous datasets. Due to their complex ...
3163
Reposted by Raphaël Millière
Edouard Machery @edouardmachery.bsky.social · 10/09/2024
Nick Shea's terrific book on concepts is now out, and it is open access. Download it and read it! philpapers.org/rec/SHECAT-11
philpapers.org
Nicholas Shea, Concepts at the Interface - PhilPapers
Research on concepts has concentrated on the way people apply concepts online, when presented with a stimulus. Just as important, however, is the use of concepts offline, when planning what to ...
13910
Raphaël Millière @raphaelmilliere.com · 15/08/2024
📄I finally preprinted this new chapter for the upcoming Oxford Handbook of the Philosophy of Linguistics, edited by the excellent Gabe Dupre, Ryan Nefdt & Kate Stanton. Before you get mad about the title – read on! 1/ arxiv.org/abs/2408.07144
arxiv.org
Language Models as Models of Language
This chapter critically examines the potential contributions of modern language models to theoretical linguistics. Despite their focus on engineering goals, these models' ability to acquire...
13615
Raphaël Millière @raphaelmilliere.com · 23/05/2024
New paper (in open access): "Philosophy of cognitive science in the age of deep learning" – in which I argue that although progress in DL is largely driven by engineering goals, it is far from irrelevant to (the philosophy of) cog sci, and vice versa. wires.onlinelibrary.wiley.com/doi/10.1002/...
wires.onlinelibrary.wiley.com
Philosophy of cognitive science in the age of deep learning
Cognitive science has a key role to play in the rigorous evaluation of deep learning models, through behavioral methods inspired by cognitive psychology as well as intervention methods inspired by ne....
0103
Raphaël Millière @raphaelmilliere.com · 25/03/2024
I look forward to speaking at the 12th Annual Marshall M. Weinberg Symposium @UMich on Friday, alongside researchers whose work I deeply admire – Yejin Choi, @melaniemitchell.bsky.social, and Paul Smolensky. More information including link to the livestream: lsa.umich.edu/weinberginst...
12th Annual Marshall M. Weinberg Symposium
Human vs. Artificial Intelligence in the age of ChatGPT

Friday, March 29, 2024
9:50 AM-5:30 PM
Ballroom Michigan League

In November 2022, ChatGPT stunned the world by displaying abilities – answering questions, reasoning about problems, composing stories, writing code – that appear eerily “human-like”. Dramatic advances in artificial intelligence such as these raise pressing questions: What is intelligence? In what ways can models such as ChatGPT be said to possess it? In what ways do these models fall short, and what does this teach us about the capabilities of the human mind? The 2024 Weinberg Symposium on Cognitive Science features four world-leading experts on computational intelligence – from computer science, psychology, and philosophy – who will discuss and debate these timely and timeless questions.
051
Raphaël Millière @raphaelmilliere.com · 21/03/2024
In this new piece for the Institute of Art and Ideas, I examine the messy state of model evaluation in AI research and argue that we need to adopt best practices from cognitive science & supplement behavioral tests with interventions. Read here: iai.tv/articles/the...
iai.tv
The Turing Tests of today are mistaken
<p><em>Companies like OpenAI try to show that AIs are intelligent by hyping their high scores in behavioural tests – an approach with roots in the Turing Test. But there are hard limits to what we can...
1101
Reposted by Raphaël Millière
Max Grafe @amagicreflexham.bsky.social · 29/02/2024
Stop the presses, this thing musicologists and composers have been saying for literal decades just got validated by one of the fields of study people actually respect
phys.org
Pythagoras was wrong: There are no universal musical harmonies, study finds
The tone and tuning of musical instruments has the power to manipulate our appreciation of harmony, new research shows. The findings challenge centuries of Western music theory and encourage greater e...
717348
Raphaël Millière @raphaelmilliere.com · 29/02/2024
OpenAI unveiled its video generation model Sora two weeks ago. The technical report emphatically suggests that video generation models like Sora are world simulators. Are they? What does that even mean? I'm taking a deep dive into these questions in a new blog post (link below).
1122
Reposted by Raphaël Millière
Ida Momennejad @neuroai.bsky.social · 20/02/2024
📣📣Delighted to share our paper with amazing team Safoora Yousefi, Leo Betthauser, Hosein Hasanbeig, @raphaelmilliere.com on neuro-inspired analysis of LLMs, LLama2 70B & Vicuna 13B. Decoding In-Context Learning: Neuroscience-inspired Analysis of Representations in LLMs arxiv.org/abs/2310.00313 🧵1/n
192
Raphaël Millière @raphaelmilliere.com · 17/02/2024
There's a lot of speculation about whether OpenAI's video generation model Sora has a 'physics engine' (bolstered by OAI's own claims about 'world simulation'). Like the debate about world models in LLMs, this question is both genuinely interesting and somewhat ill-defined. 🧵1/
3275
Raphaël Millière @raphaelmilliere.com · 09/01/2024
📄Now preprinted – Part I of a two-part philosophical introduction to language models co-authored with @cameronbuckner.bsky.social! This first paper offers a primer on language models and an opinionated survey of their relevance to classic philosophical issues. 1/5 arxiv.org/abs/2401.03910
arxiv.org
A Philosophical Introduction to Language Models -- Part I:...
Large language models like GPT-4 have achieved remarkable proficiency in a broad spectrum of language-based tasks, some of which are traditionally associated with hallmarks of human intelligence....
23215
Reposted by Raphaël Millière
Cameron Buckner @cameronbuckner.bsky.social · 29/12/2023
Dear Philosophy of ML folks, as you transition from holidays to Syllabus Scramble Season: Raphael Milliere and I will soon arXiv a paper "A Philosophical Introduction to Language Models", if you are looking for a reading on language models/transformers...
1305
Reposted by Raphaël Millière
Cameron Buckner @cameronbuckner.bsky.social · 12/12/2023
#booklaunch day! Surrounded by family, friends, and colleagues who want to understand AI, but struggle to put the last ten years of furious progress into a systematic, philosophically-grounded framework? I have the perfect stocking-stuffer for you! global.oup.com/academic/pro...
65614
Raphaël Millière @raphaelmilliere.com · 28/11/2023
In this new Vox piece written with Charles Rathkopf, we ask why people – experts included – are so polarized about the kinds of psychological capacities they ascribe to language models like ChatGPT, and how we can move beyond simple dichotomies in this debate.
vox.com
Why it’s important to remember that AI isn’t human
ChatGPT can talk like a person. You shouldn’t think of it as one.
1166
Raphaël Millière @raphaelmilliere.com · 07/11/2023
📄 New preprint - The Alignment Problem in Context With the US Executive Order and the UK AI Safety Summit, AI safety concerns have taken the center stage in the past few weeks – But how concerned should we be in light of current developments? 🧵 1/
arxiv.org
The Alignment Problem in Context
A core challenge in the development of increasingly capable AI systems is to make them safe and reliable by ensuring their behaviour is consistent with human values. This challenge, known as the...
161