Sign in

NON-TOXICNo ads · No shady algorithms

iiinova is part of the Atmosphere — an open, public network where you own your identity.

Marco Giancotti

@marcogiancotti.mastodon.social.ap.brid.gy
2 followers 0 following 119 posts

Thinking tool artisan. Gardener of aethermug.com 🌉 bridged from ⁂ mastodon.social/@marcogiancotti, follow @ap.brid.gy to interact

PostsRepliesMedia
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 17/10/2026
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 13/10/2026
As a non-mathematician, I've been trying to understand the current situation with AI math. Yesterday I read this joke and I think I get it. OpenAI is releasing a ton of jokes no one can understand, and it's not helping joke-dom
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 06/09/2026
My current perception of the situation. It looks like LLM text is a clear step down from human writing only because you don't usually see the 80+% of human writing that would be worse, if people were bold enough to share it.
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 02/09/2026
There is value in finding that someone has put to words—even poorly and approximately—something that you knew already but could never put to words, or never even thought to try.
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 01/09/2026
5. You won't be tempted to blame it for your mistakes (not more than you can blame your keyboard for your words, at least)
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 01/09/2026
3. Getting angry at it becomes as hard as getting angry at a car: not impossible, but more easily recognized as useless.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 01/09/2026
Why you should not treat AI as a person: 1. When you are alone, you should know you're alone
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 28/08/2026
5. Thus, Clarke's Third Law is tautological.
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 28/08/2026
3. Magic is only magic if it defies your understanding of how it could physically work. Otherwise it would be engineering.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 28/08/2026
1. A human-made tool of any kind is technology.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 21/08/2026
We need a new term. AI slop = output of a model at the first or second try, shared without close checking or significant corrections ??? = output of a model after several turns of steering and corrections, accurately reflecting the user's intentions, preferences, and taste
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 13/08/2026
Treating AI like a kind of person makes thinking about these and other questions instinctively difficult. Think of AI as a passive lens instead. Read the full post: aethermug.com/posts/gen-ai-is-a-len…
aethermug.com
GenAI Is a Lens into Humanity
Marco Giancotti, August 13, 2026 A long time ago, in what now feels like a galaxy far, far away, large language models were next-word predictors. You gave them an unfinished chunk of text, and they continued from where it left off with plausible-sounding sequences of words. When OpenAI announced in 2019 their ground-breaking GPT-2 model, they boasted that it "generates coherent paragraphs of text" and is "chameleon-like—it adapts to the style and content of the conditioning text". The term "stochastic parrot" would have felt irrefutable to anyone using those models at the time. All an LLM did was trace "word trajectories" through locations in meaning space, i.e. an internalized map of its training dataset. Actually, that is _still_ all an LLM does today. If it feels very different, it's not (only) because it's gotten smarter. Then, at some point, people had the idea of cajoling the LLM into pretending to be in a conversation with someone. It's a very low-tech idea at its core: instead of having it complete an essay or a poem for you, you have it complete a back-and-forth transcript between a "Human" and an "Assistant", which is just another kind of text to parrot. The main trick is to automatically stop the LLM just before it starts generating the human's next turn. This simple reframing creates an irresistible illusion. Suddenly, what used to feel like a text-generation ~~gimmick~~ program turns into a convincing "someone" you can talk to for hours on end. The "conditioning text" with some generic "style and content" becomes _your own voice_ asking something of an imaginary person that seems to talk back to you in _their own voice_. It was a sudden shift in perspective. The model was doing the exact same work as before, but now you—the human sitting in front of the chatbox—couldn't help thinking of it as an interlocutor, no matter how much you told yourself it's just software. As I'm sure you remember all too well, that's when things really took off with AI. You know that A and B are exactly the same shade of gray, but it doesn't matter. They still look distinctly different in the complete picture. Conscious knowledge that an AI bot is not a person does nothing to convince your brain not to treat it as such. The tendency to treat a non-human thing as if it were human is called anthropomorphism. Our brains have evolved a bias towards erring on the side of anthropomorphizing stuff and inferring intentions "just in case", even from very weak signals like a lightning strike ("it's Zeus!") or the shape of a burn on a piece of toast ("it's Mary, the mother of God!"). When the signals are strong, like an animated character or a cogent chat "user" called Claude, the illusion becomes overpowering. You can't unsee it. The moment you assume (even as deliberate suspension of disbelief) that the thing in front of you is a somewhat realistic person, your neural and hormonal systems related to sociality and empathy kick in. This is why people can cry for the fate of a novel's main character, or fall in love with a virtual musician. That same visceral, emotional connectedness of people is what made AI chatbots an enormous success. Today the dissemination of the anthropomorphic framing is complete. All providers are fully bought into this narrative—which is not at all surprising, given that it perfectly aligns people's core engine of engagement (sociality) with their corporate engines of profit. Every interface, from web chatbots to coding agents to built-in assistants, uses conversation as its foundation. The bots actively encourage anthropomorphization by praising you, eagerly playing roles with you, and mimicking trust-building behaviors like frankly admitting their mistakes1. "Talking to an AI" has so fully become a synonym for "using AI" that most people use the two phrases interchangeably. This is, I think, a bargain with the devil. Riding on the biological mechanisms of social interactions has its benefits. Besides making people more engaged with the language model2 (and the AI providers rich), some people also claim that confiding in an LLM makes them happier, that it feels like a safe source of non-judgmental insights, and that AI has dissuaded some of them from committing suicide1. In education, the use of anthropomorphism has been shown (though not yet for LLMs specifically) to lead to better retention and higher intrinsic motivation in students3. The list of drawbacks is longer. Some protest that trust, the basis for all social interactions, is in danger when people can't tell the difference between real and "counterfeit" people. But even if trust is not as clearly endangered as they claim, people's mental health is. The conversational feedback loops can turn into deadly depressive spirals resulting in "suicide, violence, and delusional thinking", as well as "increased loneliness, social isolation, and emotional dependence"1. My point here is that these are the effects of _anthropomorphizing_ AI, not of AI per se. Many also report reducing their human interactions in favor of AI companions. Nearly a third of Americans now claim to have "emotionally intimate or even romantic relationships with AI systems, with many describing distress when the agent’s behavior changed or when its artificiality became salient." Granting, very charitably, that this _could_ be a net positive for older people who _already_ felt lonely, it would be hard to convince me that it's a good thing for young people. In a survey of students, around a fifth of them said they were in love with a chatbot4. Subscribe to receive new posts as soon as they're published. It's free. Loading verification... Or use the Atom feed for reading apps Even in the absence of unhealthy relationships, anthropomorphized AI leads to poor results. The polished and confident attitude of LLMs induces people to put too much trust in them: they become susceptible to lies and manipulation, more prone to sharing private information with the providers, and less able to spot mistakes in the AI's outputs42. It looks like we're in a pickle here. Pretending that an AI's output is a person simultaneously feels "right" _and_ throws you into a plethora of social, psychological, moral, legal, philosophical, and reliability risks, whether through ignorance, addiction, or akrasia. Yet this AI-as-person metaphor is so ingrained that there doesn't seem to be any alternative. Should we just cope with it? Are we even up to the task? Of course there are alternatives, and all you need is another reframing! Here's an idea: instead of a **person** you **talk to** , think of generative AI as something like a **lens** or optical instrument you **point at things**. AI is the equivalent of a telescope (or a microscope, or a pair of binoculars) for peering into the vast output of the lives and labor of millions of people. That may seem a little far-fetched, but bear with me. When a lab trains a transformer, the first thing they do is create a semantic map of the training dataset. Ideas that are close in meaning, like "tree" and "leaf", get mapped to nearby places in this abstract map made of numbers—they have similar "coordinates" in the map (needless to say, I'm simplifying here). This map is called the model's _embedding space_. AI embedding space is a mind-boggling concept. Nowadays the makers of these models train them on every last word they can scrape and download off the internet, plus the entirety of words they can get their greedy hands on by any other means necessary. All those semantic relationships are encapsulated into the model. All the novels you can't even hope to read in a lifetime, all the online discussions and flame wars not locked away behind a login, all the scientific textbooks and papers, all the famous speeches, all the source code, the essays, the pedagogic materials, the public announcements, the political tirades, the cries for help, the words of comfort, the lies, the rants, the opinions, the mathematical proofs, the great torrent of advertisements and product placements—all those things and many more are stored there in a map made of numbers. The part that beggars belief is that those maps are just _files_ —distant cousins of XLSX spreadsheets, actually—and they're not even that big! If the model is "open-weights", you can download it yourself. Even if you don't have a powerful GPU to actually run it, you can bask in the awareness of having, safely stored on your own drive, that marvellous condensation of the sum of all the human knowledge textually available. Does your new smartphone have 200+ GB of free space? Then it can hold half a dozen copies of Ministral 3 14B. Have a terabyte on your laptop's SSD? Help yourself to the excellent Kimi K2.6. It's like carrying one of the seven mythical dragon balls in your pocket. I don't know if I'll ever be able to get over the amazement. Now, the problem with embedding space is that, by itself, it's a completely unusable map. See for yourself: play with one of the many online tools that let you explore little corners of an LLM's embedding space. They show you how distances and positions along semantic coordinate axes represent their meanings. Some of these tools even let you do "word arithmetic", like the classic "king - man + woman = queen". All of this is fun for a few minutes, but you'll eventually ask yourself, _what do I use this for in practice?_ Those fun tools are equivalent to indexes that search for _place names_ on the semantic landscape—they're not the real map. A map is only useful if you can mentally journey across it, find _routes_ that take you where you want to go. Those routes can't be visualized on a chart: unlike a toponym, the right route depends on _your_ goals, _your_ context, and _your_ current position. Those meaning-routes locked inside an AI model are too fine, too high-dimensional to eyeball. In other words, you can't directly read this immensely-compressed map by yourself, even if it's right there sitting in your hard drive. That's why the map comes bundled with an optical instrument. Storing meaning in a numerical map is only half of what an LLM does, and it's arguably the _less_ advanced half. The other half is a built-in mechanism to _traverse_ the meaning territory based on _your_ inputs. You give it the coordinates you (think you) need to get to, and the model repoints its lens in that direction. You must give those "coordinates" to the LLM in a peculiar format: a string of words in natural language that we call a "prompt". Say you want to know how to react when someone is rude to you. You decide to consult your map to learn humanity's wisdom on this. With a "base" model (pre-ChatGPT), the way you read the map is by passing coordinates like the following: > PROMPT > > **When someone is rude to you, the best response as a mature individual is to** You leave it unfinished on purpose, because you're only indicating a direction, and want the AI to find the correct path to the destination. I tried this with a model called `Llama3.3 70B instruct`, and this is the route it found: > COMPLETION > > **When someone is rude to you, the best response as a mature individual is to** not take it personally, keep your cool, and maintain your dignity. Try not to let the other person's negativity get to you. Instead, focus on being kind, polite, and respectful, even in the face of adversity. By doing so, you show that you are a bigger person and that their behavior will not dictate your emotions or actions. The lens extracted a path from the semantic map for me, like a telescope would extract a beautiful image of Jupiter when I set the right altitude and azimuth. The chatbots you're used to today seem to work differently, but they don't really. They just tweak the format in which they complete the text, hide from the UI the text markers like `<HUMAN>` and `<ASSISTANT>` that make the AI author a two-person conversation, and stop the AI before it writes the human's response. Then extra training (RLHF) is done to teach the model which kind of assistant response users prefer to read. An LLM's next-token prediction is not about "what to answer the user?", it's mainly about "what would a text from this training corpus be likely to continue after the provided text?" to which RLHF adds "out of the probable continuations, which is more likely to convince the user I'm a nice and trustworthy person talking to them?" To put it another way, the lens homes in on a relevant little sliver of territory within the huge corpus of human lore and reveals a path in the direction you asked for. The obvious caveat is that _the route uncovered by the lens isn't necessarily "right"; it's only "an" answer according to whatever most of its training inputs had to say about the topic._ If the LLM had been trained only on texts and knowledge from ancient Sparta, it might have provided a very different completion to your prompt about rude people. Whether you think the model's completion is what you wanted or not doesn't matter to the lens: it showed you what the map says, for better or worse. (The AI "agents" you see nowadays seem to go farther than a simple turn-based chat, because they can access external information and tools, "reason", and work autonomously for many steps at a time. But it's still the same thing: it gets a prompt, it outputs words. The "agency" you see is just code that interprets some of those words as program execution commands.) I think the metaphor of a lens is apt here especially because it's better at explaining the ways in which generative AI falls short. A real lens can cause all sorts of optical aberrations: it can be unfocused, warp shapes, sizes, and colors, have blind spots, and introduce spurious artifacts like diffraction spikes and halos. An AI's metaphorical lens makes mistakes roughly equivalent to all those things. Lens defect| AI defects ---|--- bad focus| vague, generic, "off" output chromatic aberration| bias towards certain ideas/topics blind spots| unused knowledge distortions| jagged edge artifacts| hallucinations (Don't take the parallel too seriously, though. No metaphor is exact.) We've had several hundred years to refine our glass lens technology to minimize all those aberrations and achieve today's crisp, high-quality images. Our AI lenses are brand new and far, far behind on the quality front. ### You Might Also Like... * There Is Thinking and There Is Thinking and There Is Thinking * Case Study: Is There a Strange Culture War Over AI Art? * A Fundamental Framing of Human Language It's not only large language models that function as lenses into their embedding spaces. The analogy holds well for all kinds of generative AI, including image- and video-generation models. When you prompt Nano Banana with "A picture of a mango with sunglasses in the style of Monet," you're giving it the coordinates to a few specific places in its latent space, and its output image is the path that it found between them, presented to you in a form your eyes can actually see and understand. When early models produced people with seven-fingered hands, that was the effect of their lens-like distortions. The main thing about this strange AI-as-lens framing is that it is as far from anthropomorphism as possible. It explicitly treats generative models as what they are: tools, no more, no less. It's a metaphor, and as such it has its limitations: we need to understand it as a very peculiar kind of lens, one that doesn't quite exist in reality with those specific features (normal lenses are not "path-finding" tools per se, while AI lenses are). But the AI-as-person metaphor is arguably much worse, because _its_ limitations are more complex, addictive, and sneaky. AI-as-lens sacrifices some spontaneity in favor of honesty. That's interesting and all, but is avoiding anthropomorphism really worth the trouble? How do we know this reframing is valuable at all? I believe that every reframing worth its salt should have some of the same effects as a paradigm shift in science, as explained by Thomas Kuhn. With a good reframing, 1. a different set of questions takes center stage, 2. some old questions withstand the change of worldview and remain relevant, and 3. some old questions dissolve into irrelevance. For example, until the end of the 1800s, scientists believed that light was made of waves propagating in an invisible and intangible substance called aether. Then the Michelson-Morley experiment proved that aether couldn't exist, and Einstein's new theories of special relativity and the photoelectric effect showed that physics could work _better_ without assuming the existence of an aether or even "simple waves". Suddenly, some new questions— _how can light be both wave and particle?_ —emerged as critical to the advancement of physics; others—e.g. _what is the speed of light?_ —withstood the test and remained relevant; and some that had seemed central before— _how does aether work?_ —suddenly became moot. The reframing steered physics toward more fruitful research directions. Now, aether theory was factually, provably wrong, whereas here I'm suggesting that AI-as-person is only practically so. Still, does viewing genAI as an imperfect, path-finding lens into humanity promise anything like those same changes, at a much tinier scale? I think it does, but whether it actually delivers on that promise depends on whether people take it seriously. Below is a quick tour of what the three reframing categories (new questions surface vs old questions endure vs old questions dissolve) look like for AI-as-lens. Take these with a dose of skepticism, though: my point is not that AI-as-lens gives you all the right ways to think about this topic (that's not how framings work), only that it shifts the attention to quite different topics, and there is no a priori reason to believe that it does so any worse than the AI-as-person metaphor. And since we've already seen what a cognitive minefield AI-as-person is, I think that gives AI-as-lens the upper hand even without it being the final word in all contexts. ## 1 - Rarely-Asked Questions Highlighted by AI-as-Lens #### What needs to be done to turn these instruments into faithful, clear transmitters of their embedding spaces? (This is subtly different from trying to get to the right answers, which also depends on what's in the training dataset. The quality of accurately reflecting _whatever is actually there_ —whether right or wrong—is its own separate problem.) #### What is the most effective format to input coordinates into the lens? (There is no reason to believe that a chat-like conversation format is the best way to do this.) #### What is the most effective output format to surface exactly what the LLM's user is looking for and nothing more? (Again, an assistant's explanation is only one among many possibilities to be compared empirically.) #### Where is this technology's instruction manual? How does one become expert at operating, maintaining, and improving the tool, similar to how an astronomer or astrophile masters the use of their telescope over the course of years? (There is no magic wand.) ## 2 - Oft-Asked Questions That Remain Important With AI-as-Lens #### Who should get to decide what constitutes a good representative dataset for "the sum of human lore"? Is it okay to let the AI engineers decide in secret? #### Is it ethical and sustainable to ignore copyright when raking together that map of humanity? #### When and to what extent is it okay to let the lens complement your own thoughts, or replace them altogether? ## 3 - Some of Today's Hot Controversies and Widespread Sources of Anguish Melt Away Under the Lens Concept Tirades like this remind me of this passage by Baudelaire, in 1859: "As the photographic industry was the refuge of all failed painters, **too ill-equipped or too lazy to complete their studies** , this universal infatuation bore not only the character of **blindness and imbecility** , but also the color of vengeance. That such a **brainless conspiracy** , in which one finds, as in all the others, the wicked and the dupes, can achieve absolute success, I do not believe it, or at least **I do not want to believe it** ; but I am convinced that the ill-applied advancements of photography have greatly contributed, like all purely material progress, to the **impoverishment** of French artistic genius, which is already so rare." (Highlights and emphasis mine. Source) #### Is AI conscious, or will it be? (Clearly not more than a looking glass has good taste for what to show you, or a microscope is a cunning discoverer.) #### Is AI my friend or therapist? (Of course not; it can at most be your encyclopedia of therapeutical advice.) (Corollary: should I be nice to it, say "please" and "thank you"? With LLMs trained specifically to imitate people, maybe. But it's a spurious question, and I doubt it would be necessary for the base models.) #### Is it a good use of my time to argue with, or try to convince, an AI of anything? (No. Not that many people ask themselves this question today.) #### Can AI ever substitute a human? (Yes, but only for the things where a real human isn't really needed. Binoculars can substitute a sentinel, but that only means that the human isn't essential in all parts of the sentinel's job. This is a tautology with AI-as-lens and a giant red herring with AI-as-person.) #### Will AI kill us all? (Maybe, like a Rube Goldberg contraption maybe would if we put a nuclear button in any of its steps.) (Note: if it were highly profitable to put a nuclear button in a Rube Goldberg machine, sooner or later someone would do it.) #### Can generative AI be warm or empathic or have a "good writing style"? (Of course not, no more than a telescope can have a sense of beauty.) #### Is AI slop devoid of meaning, or more base than human output? (Of course not: it is as human as it can possibly get, for better or for worse.) Which questions do you want to ask? ● ## Comments Loading comments... Subscribe to receive new posts as soon as they're published. It's free. Loading verification... Or use the Atom feed for reading apps # References ## Footnotes 1. Dohnány, S., Kurth-Nelson, Z., Spens, E., Luettgau, L., Reid, A., Gabriel, I., Summerfield, C., Shanahan, M., & Nour, M. M. (2026). Technological folie à deux: Feedback loops between AI chatbots and mental health. _Nature Mental Health, 4_(3), 336–345. https://doi.org/10.1038/s44220-026-00595-8. ↩ ↩2 ↩3 2. Kadambi, A., D'Elia, Y., Shah, T., Comsa, I., Lentz, A., Siri-Ngammuang, K., Buechler, T., Kaplan, J., Damasio, A., Narayanan, S., & Aziz-Zadeh, L. (2026). Anthropomorphism and trust in human-large language model interactions. arXiv:2604.15316. https://arxiv.org/abs/2604.15316. ↩ ↩2 3. Schneider, S., Häßler, A., Habermeyer, T., Beege, M., & Rey, G. D. (2019). The more human, the higher the performance? Examining the effects of anthropomorphism on learning with media. _Journal of Educational Psychology, 111_ , 57–72. https://doi.org/10.1037/edu0000273. ↩ 4. Reinecke, M. G., Ting, F., Savulescu, J., & Singh, I. (2025). The double-edged sword of anthropomorphism in LLMs. https://doi.org/10.3390/proceedings2025114004. ↩ ↩2
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 13/08/2026
Under this framing some hot controversies melt away. E.g.: Is AI conscious? Not more than a looking glass has good taste for what to show you. Is AI slop more base than human output? Of course not, it is as human as it can possibly get, for better or for worse.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 13/08/2026
We've refined glass for centuries. AI lenses are brand new, and they are *rough*.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 13/08/2026
The metaphor leads to some parallels with optical aberrations: bad focus → vague, generic output chromatic aberration → model bias blind spots → unused knowledge distortions → the jagged edge artifacts → hallucinations
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 13/08/2026
But you can't read that map yourself, so it comes bundled with an "optical" instrument. Your prompt is just the coordinates you point it at.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 13/08/2026
Training a model starts by building a semantic map of everything it was fed: novels, flame wars, papers, source code, cries for help, ads. In other words, an LLM encapsulates the fruits of humanity's labors.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 13/08/2026
You need another reframing. Instead of a person you talk to, think of generative AI as a lens you point at things: a telescope for peering into the vast output of the lives and labor of millions of people.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 13/08/2026
Our brains evolved a bias towards inferring intentions "just in case", even from a lightning strike ("it's Zeus!") or a burn on a piece of toast ("it's Mary, the mother of God!"). With a human-pretender like Claude, you can't unsee it. "Knowing" it's not a person doesn't help.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 13/08/2026
At some point people had the idea of cajoling the LLM into pretending to be in a conversation with someone. It completes a "Human"/"Assistant" transcript, and you stop it before it writes the human's next turn. That low-tech trick creates an irresistible illusion.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 13/08/2026
A long time ago, in what now feels like a galaxy far, far away, large language models were next-word predictors. Actually, that is *still* all an LLM does today. If it feels very different, it's not (only) because it's gotten smarter.
110 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 12/08/2026
Text Is My Gimmick. aethermug.com/posts/text-is-my-gimm…
aethermug.com
Text Is My Gimmick
Marco Giancotti, July 31, 2026 Cover image: _Petroglyphs in Kei Islands (1894), Garrick Mallery_ Words have always had a way with me. They find me if and when it suits their fancy. If they do find me, they usually find me between thirty minutes and thirty days after they would have been just _perfect_ to tell someone. That's why I've always been more of a text person—the words that come to me may not be timely, but text rarely needs to be anyway. Read, think, write: this is the kind of conversation I like the most. It is my weakness, my Achilles' heel even, because my alphabetical bias means I miss out on much of the richness of spoken dialog. Nonverbal channels, subtle facial cues, and eloquent pauses are off limits in my world of _just_ words. It's true, the written has its privileges. First and foremost, it is blessed with a sublime, lithic stability of character. Its surface can be rough, its verbs smooth, its sentences accumulate into great cliffs of ideas, but its shape will always be firm and consistent. Text is always only text—line upon line of static letters, spaces, punctuation, the occasional sprinkling of numbers and other symbols, and nothing else. This predictability cradles you, and it allows you to forget it exists. Your retinas take in strings of squiggles, but your mind visits places. The stillness of written words is the secret to their transparency. But ask yourself: is this really a good thing? Is transparency so desirable in language as to justify the predictability of form? Ask anyone in the street and they'll tell you that predictability is boring, and that boredom is the enemy of this age. They'll also tell you that it's not good to escape reality, because reality can't be escaped. The sweet escapist nectar of text, its infinite stability is at the same time a blessing and a curse, a devil's kiss, a cage made of gold—it calls to me, it soothes what reason ever inhabits me, it takes me away and I go, I usually go along with it but perhaps I should fight—I should break free of its limitations, I want to master it, transcend it, go beyond it, fully understand it! But how to do that, if first I cannot answer the simple question: what is text? Visual effect: The text is rendered in a weight gradient: thin and light at the top, growing progressively heavier toward the bottom. It's true, the written has its privileges. First and foremost, it is blessed with a sublime, lithic stability of character. Its surface can be rough, its verbs smooth, its sentences accumulate into great cliffs of ideas, but its shape will always be firm and consistent. Text is always only text—line upon line of static letters, spaces, punctuation, the occasional sprinkling of numbers and other symbols, and nothing else. This predictability cradles you, and it allows you to forget it exists. Your retinas take in strings of squiggles, but your mind visits places. The stillness of written words is the secret to their transparency. But ask yourself: is this really a good thing? Is transparency so desirable in language as to justify the predictability of form? Ask anyone in the street and they'll tell you that predictability is boring, and that boredom is the enemy of this age. They'll also tell you that it's not good to escape reality, because reality can't be escaped. The sweet escapist nectar of text, its infinite stability is at the same time a blessing and a curse, a devil's kiss, a cage made of gold—it calls to me, it soothes what reason ever inhabits me, it takes me away and I go, I usually go along with it but perhaps I should fight—I should break free of its limitations, I want to master it, transcend it, go beyond it, fully understand it! But how to do that, if first I cannot answer the simple question: what is text? One might say that text is pure language, but only a dialectical system is worthy of that name. There is nothing dialectical about text: it won't even react to you. What can you do to it? Destroy it you can, burn it only if made of paper, and that's about it. Speaking to a sans-serif word won't yield a response. Caressing a sentence made of ink won't give back any warmth. Clicking on a paragraph is a futile exercise—go on, try it for yourself: taste loneliness once again. Advocates will tell you that it is precisely this inertness that allows text to offer exactly the same experience to every reader. Text is one, readers are multitude. As if that were a boon! Not that people haven't attempted to make text adaptive—they called them choose-your-own-adventure books, they were a hack rather than a solution, and they are now all but dead. Text does not care about you, text does not respond to you. Visual effect: Hovering the cursor illuminates nearby characters, making them bolder. Clicking and dragging paints a shifting nacre trail of iridescent colour across the text, which fades over several seconds. One might say that text is pure language, but only a dialectical system is worthy of that name. There is nothing dialectical about text: it won't even react to you. What can you do to it? Destroy it you can, burn it only if made of paper, and that's about it. Speaking to a sans-serif word won't yield a response. Caressing a sentence made of ink won't give back any warmth. Clicking on a paragraph is a futile exercise—go on, try it for yourself: taste loneliness once again. Advocates will tell you that it is precisely this inertness that allows text to offer exactly the same experience to every reader. Text is one, readers are multitude. As if that were a boon! Not that people haven't attempted to make text adaptive—they called them choose-your-own-adventure books, they were a hack rather than a solution, and they are now all but dead. Text does not care about you, text does not respond to you. Is text an inert object? Like a sidewalk puddle or an asteroid belt? If that were the case, I would be wrong to yearn for it to answer me. I could then at least hope to use it as a doorstop, or as a high-brow bowtie. Alas, that is a dead end, too. You can see it, sure, and you can touch its featureless surface, but text will not obey the laws of physics. It has no energy, no mass, no electric charge. The letters are its atoms, and no quantum formula can predict them. Written words are not solid, nor are they waves: they are not things of nature. Visual effect: Clicking sends an expanding ring of weight outward from the click point; letters the ring passes through briefly bold before settling back. Is text an inert object? Like a sidewalk puddle or an asteroid belt? If that were the case, I would be wrong to yearn for it to answer me. I could then at least hope to use it as a doorstop, or as a high-brow bowtie. Alas, that is a dead end, too. You can see it, sure, and you can touch its featureless surface, but text will not obey the laws of physics. It has no energy, no mass, no electric charge. The letters are its atoms, and no quantum formula can predict them. Written words are not solid, nor are they waves: they are not things of nature. If not natural, is text at least mechanical? After all, it is the artifact of human hands. In this hypothesis our words—when expressed in two spatial dimensions—would be a form of clockwork, computer programs of a sort, with parts that slot into each other and produce a designed effect. There is something to this idea. While there are no cogwheels or wires in human writing, it seems uncontroversial that it is an information-conduit. It is assembled by trained individuals according to human-made rules and multiple implied inter-connections; its mechanics are well-studied and mostly-understood by the experts; it is usually created with a function in mind, and deployed into the world in the hope it won't malfunction; in a sense, you could even say that people design and engineer it to perform a predefined job. At first glance, then, it seems as if the matter was settled, but this is yet another illusion—text is made of information, but it does not compute it. It sits there on the page, and its output is forever identical to its input. This fact alone demonstrates that, although it can be produced by a machine, a machine it is not. Visual effect: Clicking seeds a Conway's Game of Life simulation across the character grid. Living cells appear bold; dead cells stay thin. The simulation runs until it reaches stasis, then waits for another click. If not natural, is text at least mechanical? After all, it is the artifact of human hands. In this hypothesis our words—when expressed in two spatial dimensions—would be a form of clockwork, computer programs of a sort, with parts that slot into each other and produce a designed effect. There is something to this idea. While there are no cogwheels or wires in human writing, it seems uncontroversial that it is an information-conduit. It is assembled by trained individuals according to human-made rules and multiple implied inter-connections; its mechanics are well-studied and mostly-understood by the experts; it is usually created with a function in mind, and deployed into the world in the hope it won't malfunction; in a sense, you could even say that people design and engineer it to perform a predefined job. At first glance, then, it seems as if the matter was settled, but this is yet another illusion—text is made of information, but it does not compute it. It sits there on the page, and its output is forever identical to its input. This fact alone demonstrates that, although it can be produced by a machine, a machine it is not. I do not know what text is. I've made no progress with the answer. Perhaps there is no reason that can defend my preference for writing over speaking. It's my guilty, irrational pleasure—my cowardice—my misanthropy? Perhaps the thing I like the most about it is that it is very much unlike a living person. It does not breathe. I can rip and incinerate the page, I can throw the screen under a bridge, but the text is unharmed. I can't hurt the words, especially not after they've entered my mind. I can't even scratch them. This is comforting: the perfect friend. Visual effect: The text breathes: all characters slowly grow bolder on inhale and thin on exhale, in a six-second cycle. Dragging across the text leaves a fading pink scratch mark. I do not know what text is. I've made no progress with the answer. Perhaps there is no reason that can defend my preference for writing over speaking. It's my guilty, irrational pleasure—my cowardice—my misanthropy? Perhaps the thing I like the most about it is that it is very much unlike a living person. It does not breathe. I can rip and incinerate the page, I can throw the screen under a bridge, but the text is unharmed. I can't hurt the words, especially not after they've entered my mind. I can't even scratch them. This is comforting: the perfect friend. I surrender. The written word has mastered me, and not the other way around. If rational thought fails me, I will resort to faith in this God of Strings. I exist at its whims, I breathe it in and out of my creative bronchi and bronchioles, worship the golden cage. Indeed, words have always had a way with me. And if they constrain what I can express, then so be it. Trap me, then, and I won't say it's an unfair condition. Perhaps a picture is worth a thousand words, but I happen to have a thousand and one. The painter will retort: no, that is still not enough. No number of words will avail you the power of impressing, deep in a starving visual cortex, the pride of a lion's mane. To which I rejoin: can any arrangement of pigments convey the exhilarating fluency of Tennyson's verses or the interior history of Faulkner's characters? Can a tune carry an hour-long thought process to fruition? Is it bondage when everyone gets to pick their cage? Visual effect: Clicking cycles through 3 images rendered entirely in character color: pride of a lion's mane, Mona Lisa's hypnotic gaze, emotion of an aurora. Each image scrolls continuously across the text. I surrender. The written word has mastered me, and not the other way around. If rational thought fails me, I will resort to faith in this God of Strings. I exist at its whims, I breathe it in and out of my creative bronchi and bronchioles, worship the golden cage. Indeed, words have always had a way with me. And if they constrain what I can express, then so be it. Trap me, then, and I won't say it's an unfair condition. Perhaps a picture is worth a thousand words, but I happen to have a thousand and one. The painter will retort: no, that is still not enough. No number of words will avail you the power of impressing, deep in a starving visual cortex, the pride of a lion's mane. To which I rejoin: can any arrangement of pigments convey the exhilarating fluency of Tennyson's verses or the interior history of Faulkner's characters? Can a tune carry an hour-long thought process to fruition? Is it bondage when everyone gets to pick their cage? Weakness, comfort, cowardice, now arrogance. This maelstrom of idiosyncratic words has dragged me through quite a few circles of a Dantean hell. Except, at its bottom is not a half-frozen archdevil but a version of Beatrice they call Humility, for my Stockholm syndrome is stocky enough to squash my ego at every keystroke. Each thing I write is an inauspicious attempt at something greater, usually not a triumphant one. My true fear, I have to finally admit, is not to be unable to convey some multimodal sensory experience, but to fail to say in words what I could say in words. Only I know of all the dreams and sensibilities that dwell and have dwelt in the cracks and recesses of my psyche, and they resist my efforts to cajole them into sequences of spaces and letters—they seem to want to straddle the lines, forever defying my ability to express them, no matter how much extra time the medium of writing affords me. And so every piece of my writing ends with a circle: a final, heavy period to yet another botched confession, a bullet hole in my hubris, a pirate's sign of doom. Perhaps I have chosen the wrong profession? ● Visual effect: Clicking reveals a hidden scrolling message rendered in character weight: “just kidding, I love doing this!”. Weakness, comfort, cowardice, now arrogance. This maelstrom of idiosyncratic words has dragged me through quite a few circles of a Dantean hell. Except, at its bottom is not a half-frozen archdevil but a version of Beatrice they call Humility, for my Stockholm syndrome is stocky enough to squash my ego at every keystroke. Each thing I write is an inauspicious attempt at something greater, usually not a triumphant one. My true fear, I have to finally admit, is not to be unable to convey some multimodal sensory experience, but to fail to say in words what I could say in words. Only I know of all the dreams and sensibilities that dwell and have dwelt in the cracks and recesses of my psyche, and they resist my efforts to cajole them into sequences of spaces and letters—they seem to want to straddle the lines, forever defying my ability to express them, no matter how much extra time the medium of writing affords me. And so every piece of my writing ends with a circle: a final, heavy period to yet another botched confession, a bullet hole in my hubris, a pirate's sign of doom. Perhaps I have chosen the wrong profession? ● Image credits: * Lion: Alexas_Fotos, Unsplash * Mona Lisa: Leonardo Da Vinci * Aurora: Jonny Gios, Unsplash Cover image: _Petroglyphs in Kei Islands (1894), Garrick Mallery_
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 12/08/2026
Text does not breathe and remembers no hurts.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 12/08/2026
Text is not alive.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 11/08/2026
I can't shake the feeling that humanity will make a leap when we all stop using AI like a slot machine with a personality
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 10/08/2026
When reading something on the internet, your task is, and always has been, to understand its content and intent while being alert for lies and errors. "How" the text was written was never important. Why is it suddenly so important after the creation of LLMs?
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 03/08/2026
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 24/07/2026
Sometimes I wish Claude would gallivant less
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 23/07/2026
Each agent has a fixed budget of points in the session. Highest bidder gets to talk next. The user can also inhibit/chastise certain behaviors.
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 21/07/2026
Good advice. I have another reading trick: read while brushing your teeth. You'll read more and easily spend several minutes at a time brushing. Two problems that cancel each other out. Last year I finished several books entirely while brushing! […]
mastodon.social
Original post on mastodon.social
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 19/07/2026
If they've proved nothing else, LLMs have proved that "meaning" is not something contained inside a concept. A concept in an LLM is just a vector of numbers. Meaning is *entirely* determined by the connections between concepts. I think this is worth pondering on more often.
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 17/07/2026
I find that I have to correct some mistakes quite regularly. But with some learning on my part and Hermes' auto-improvement loop, the process is becoming smoother. Already, only after a few hours, I'm finding it valuable. What a time to be alive!
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 17/07/2026
Honestly, local Qwen is working better than I expected. It understands things. It can find connections. It's actually helpful!
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 17/07/2026
(For many tasks I don't have problems with the commercial models and the frontier LLMs, but when it comes to my vault I have never sent anything to AI labs. All my ideas and projects and works in progress are in there.)
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 17/07/2026
Still, the sheer volume is difficult to manage. I end up forgetting that I have certain specific notes, and in sometimes cases I know I have something but I can't find it quickly.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 17/07/2026
I've been using a local LLM to help me manage and maintain my Obsidian vault. The model is Qwen 3.6 35B A3B and it works surprisingly well.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 12/07/2026
If you were an ant with human-level intelligence and consciousness, how would you take over the ant world?
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 11/07/2026
Every time I reread Thinking in Systems I highlight more text. Eventually it might be a good idea to start over and only highlight the parts I can forget.
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 08/07/2026
What non-aphantasics look like to people with aphantasia
A character views a "Magic Eye" book revealing a dolphin while others react, showcasing the experience of interpreting visuals differently. From https://pbfcomics.com/
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 02/07/2026
Read the full post: aethermug.com/posts/the-bestiary-gr… (Fediverse: follow @aethermug.com)
aethermug.com
The Bestiary Grows
Marco Giancotti, July 2, 2026 TL;DR: I've updated the Plankton Valhalla Bestiary. Did you know that Aether Mug has an older sister website? It's called Plankton Valhalla and I publish my essays there (go check it out!). I started it back in 2022 as a repository of explanations building up to a book I wanted to write, an ambitious book to understand reality in light of modern scientific theories like complexity science, systems theory, cybernetics & friends, but framed in a way that feels natural rather than complex. At some point I realized that, in some cases, a powerful explanation requires tweaking how certain words are defined. This is mildly annoying: isn't the point of language to allow you to express any idea by stringing enough predefined words together? Well, language _can_ do that, but its power is overrated. All ways to express a concept in words are not created equal. Concepts seem to transcend language, or at least to be more fundamental than language. The words need to fit the ideas, not the other way around. ### You Might Also Like... * New Plankton Valhalla Essay! * Shake Up Your Boundaries * Purpose Essay Now on Plankton Valhalla Specialists in any field know this well. Defining a term primes the brain to assimilate that word as its own bounded concept, a black box, i.e. something to be treated as a primitive in linguistic or mental manipulations. Tuning word definitions—and sporadically inventing new terms—equips you with a custom-made toolkit to efficiently think about and discuss notions that were previously too fuzzy and slippery to work with. It's like building your own shovel instead of digging with your hands. After the initial overhead, it gets the job done much more efficiently. This kind of redefinition of terms comes at the cost of confusing people. If I tell you "the dog's teeth are worn out, we need to replace the dog", you might get the wrong idea unless you know the engineering definition of "dog" (#3 on Merriam-Webster). So in my essays I started using certain words a lot (system, BAEB, difference) with meanings I tuned very deliberately. I made some highly vague terms precise, and restricted or expanded others in scope. The goal of all this boundary-redrawing is to clarify which parts of reality are like that because you, a human, are contemplating them, and which parts have nothing to do with humans. This culminated in a very meaty essay series running from 2024 to 2025 that makes extensive use of many of those customized terms. The Plankton Valhalla Bestiary has been there since 2023 to avoid the inevitable confusion, but **today I've added several new entries to reflect the Purpose series' vocabulary**. These are pretty interesting ideas, if you ask me. I hope you think so too. (Each Bestiary entry has one or more links to the essays that discuss that term. It might be a good starting point for those who want to get into Plankton Valhalla. Also, if you've read this far, you might want to skip the Bestiary's introduction, which says similar things in older words. Click on "Skip to the definitions" on that page.) ● ## Comments Loading comments... Subscribe to receive new posts as soon as they're published. It's free. Loading verification... Or use the Atom feed for reading apps
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 02/07/2026
The Plankton Valhalla Bestiary has been there since 2023 to avoid the inevitable confusion, but today I've added several new entries to reflect the Purpose series' vocabulary.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 02/07/2026
This kind of redefinition comes at the cost of confusing people. If I tell you "the dog's teeth are worn out, we need to replace the dog", you might get the wrong idea unless you know the engineering definition of "dog".
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 02/07/2026
Tuning word definitions, and sporadically inventing new terms, equips you with a custom-made toolkit to think and discuss efficiently about notions that were previously too fuzzy and slippery to work with.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 02/07/2026
Defining a term primes the brain to assimilate that word as its own bounded concept, a black box, something to be treated as a primitive in linguistic or mental manipulations.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 02/07/2026
In my essays at Plankton Valhalla (Aether Mug's older sister site), I started using certain words a lot (e.g. system, BAEB, difference) with meanings I tuned very deliberately.
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 02/07/2026
Isn't the point of language to allow you to express any idea by stringing enough predefined words together? Well, language can do that, but its power is overrated. The words need to fit the ideas, not the other way around.
200 2
Reposted by Marco Giancotti
James @nonzerosumjames.mastodon.social.ap.brid.gy · 26/06/2026
Are you hunting stags or hares? nonzerosum.games/staghunt.html The Stag Hunt is a better model for politics and human relationships in general, than the Prisoner’s Dilemma #GameTheory #Coordination #Trust #Politics #NonZeroSum
122 2
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 23/06/2026
(Disclosure: I wrote the blog post myself, but used an LLM to help adapt and condense my words into this thread, under strict supervision. Hopefully this way of using it demonstrates the points I make in the full text.)
000 0
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 23/06/2026
If you do all that, you're in for a great AI experience. The full "Anatomy of Augmented Thought" post walks through all of this with cognitive science references and specific delegation advice for each of the nine categories of thought: aethermug.com/posts/aat
aethermug.com
Anatomy of Augmented Thought
Marco Giancotti, June 18, 2026 Cover image: _Modified from Diehl's Anatomy for artists and students Pl.3, Conrad Diehl_ People are using large language models more often and on more complex tasks than ever. Social media and marketers hammer us with the (real or dreamed-up) benefits of this uptake from all sides, but there are also voices pointing out the risks: we're told that our security is compromised, that intellectual property is undermined, and that—in case we didn't have enough already—more biases are being pushed onto us. These are all valid concerns that need to be addressed as soon as possible. But, as someone who calls himself a "thinking-tool artisan", I'm particularly concerned by two gnarly issues of generative AI: 1. There isn't strong evidence of major productivity gains from AI investments in organizations. Many _individuals_ seem to be more productive on some tasks 1 and consistently self-report saving a lot of time, but the empirical data for _organizational_ improvements is underwhelming at best. 2345 2. Several studies have shown that using LLMs a lot can lead to over-reliance and "cognitive debt", i.e. it makes people dumber. 67891011 I've seen both of these issues with my own eyes, but I also see a huge gap in our understanding of how they might come about. The scientific research on this seems to be in the Stone Age, still treating AI use as an on/off affair, asking what happens when people generically "use AI". Practitioners in software engineering, on the other hand, seem to have been teleported en masse to a distant and incomprehensible future. They've made huge strides in harnessing LLMs to write code for them—mostly via groping trial and error—but they're also caught in one hype super-tornado after the next, most people blindly copying whatever seems to work even a little for others. No one seems to be measuring how much all those techniques objectively help. Much more research will be necessary, but I think we can already combine the little science available with the hacks that seem to be sticking, and begin to understand not just _whether_ , but _how_ and _when_ to use generative AI to solve difficult tasks. If we want to export the productivity gains beyond coding and mitigate cognitive debt, we probably _should_ figure out how this stuff works. I think the research will eventually find that it's not mere "AI use" but _proficiency_ in AI use, as well as the surrounding tooling, that make all the difference. I've used LLM-enhanced tools and workflows for hours every day for a few years now, applying them to all sorts of complex problems: especially software, but also scientific research, math, learning advanced topics, product and process design, product management, and even leisure projects like dungeon-mastering and fantasy worldbuilding. These all sound like very different problem spaces, but I've found you need the same high-level skillset for all of them. The hard-earned AI lessons in software engineering _can_ be distilled and reapplied in any other problem-solving domain. This is what this post is about. We'll tackle the two problems above (cognitive debt and lacklustre productivity boosts) indirectly, by focusing on a third, more fundamental problem: 3. We still lack a clear, powerful language to talk and think about joint human-AI problem-solving. This is the first step toward better discussions about the other two. Perhaps if we start speaking the same language, we'll find the answers already on the tips of our tongues. ## How This Post Works What I offer here is a framework to understand what happens when someone uses a large language model to tackle a complex, difficult question or problem of any kind. I'll call it the **Anatomy of Augmented Thought** framework. While researching this, the biggest realization I arrived at is that even more so than critical thinking, it is _metacognition_ that matters when you want to use AI without falling into its many pitfalls 12. "Thinking about thinking" has always been a neat skill to practice, but in the past it has been easy to brush it off as something philosophers and a certain group of psychologists did. By the time you finish reading this post, I hope you'll be thoroughly convinced that the times have changed: we all have to become expert meta-thinkers if we are to actually reap the benefits of AI's advances. To give some order to the fuzzy idea of "thinking", I'll borrow three simple frameworks from psychology and combine them into a larger, more detailed one composed of nine thinking categories. Then I'll consider the major factors that determine when and how we delegate things: 1. How tiresome is each category of thinking? 2. How much time does a thought take with and without AI? 3. How does expertise interact with AI use? Mental fatigue matters a lot, because people tend to want to skip or delegate the tasks that would tire them out the most; time spent on a task is considered _the_ key metric of productivity; and expertise matters because it drastically changes how you guide AI and evaluate its outputs. Each of the nine thinking categories has different implications for these three factors. The structure that emerges adds nuance to this topic, and demolishes the naïve conception of thought as a single, monolithic activity. Instead, thought is highly complex, and the way it interacts with "external thinking machines" like LLMs must be equally sophisticated. Oldest remaining depiction of a prompt engineer. It's very tempting to treat a state-of-the-art LLM as a magic wand: you only have to _want_ it, pronounce a couple dozen magic words, and it will somehow make it happen for you. I'll call this the **Magic Wand Illusion** , and I'll make the point that it couldn't be farther from the truth. The ideal way to divide work between a human and an LLM is a mixture of human-only work, AI-only work, and work requiring the close cooperation of both. The Magic Wand Illusion is dispelled with the **Anti-Magic Effect** : unlike magic, using LLMs well for complex tasks is a difficult job in itself. I'll also try to sketch what an "optimal" engagement with AI would look like for different kinds of people and different tasks. ## Disclaimers You can skip directly to the next section, or read the answers to any of these legitimate fine-print questions. You can find even more caveats and assumptions in Appendix II. (Click on "read" next to the questions you have to show the answers.) ### Is this post scientifically rigorous? I've strived to do as rigorous and objective a job as possible, which is why the text contains references to academic papers and other more or less reputable sources. But that's not saying very much, because the science on this is full of gaps and I've had to rely on my own personal experience and insights in several places, which is N=1. This is first and foremost _my subjective interpretation_ of these ideas, and it might be wrong on many fronts. Still, I've spent far more time cross-checking that my insights and deductions are supported—or at least not strongly contradicted—by whatever science and expert knowledge exists about these topics than I've spent writing them, so I hope you'll at least give them the benefit of the doubt. The real value I'm aiming for may not be in the detailed takeaways (many of which are already known at least to some experts anyway) but in the clarity of the distinctions. Again, a shared language or framing. ### Is this post written by AI? Except those clearly advertised as AI-written, I've typed every single word of this post with my own meat-and-bone fingers, based on ideas that originated in my wetware (yes, I do use em-dashes regularly in my writing—I won't let LLMs take the monopoly!). This post is not AI-written under any definition of the term, because I don't believe an AI could write it better than I can yet (at least on the metrics I care about). That said, I did use an LLM (mainly Anthropic Claude Opus) extensively for the research and fact-checking, and throughout the long process of formulating, vetting, structuring, and organizing my thoughts. In doing so, I applied all of the notions and methods that I'm writing about (it's all very meta). In that sense, if you find what I wrote convincing (or not), you can count that fact itself as one more point in favor (or against) it. ### Where is the practical advice? This post is all about _what_ augmented thought is: its parts and types, the various tradeoffs and risks, etc. The matter of _how_ to think well and safely with an LLM—the methods I've adapted and extrapolated over the years—is the topic of future posts on this blog. ## Table of Contents * How This Post Works * Disclaimers * 📍 **You are here** * Part 1: Drawing the Boundaries * Cognition in 3D * Pre-Augmentation Anatomy of Thought * Thoughts, Mental Fatigue, and Time * Part 2: Augment * Careful What You Hand Over * Augmented Thinking: Faster and Slower * When Fatigue Steers in Your Stead * Expertise Matters Doubly * Conclusions * Appendix I: Pitfall Recap * Appendix II: Caveats and Assumptions * Comments * References Subscribe to receive new posts as soon as they're published. It's free. Loading verification... Or use the Atom feed for reading apps # Part 1: Drawing the Boundaries ## Cognition in 3D Click to enlarge.I promise this will make sense by the end of Part 1. Our starting point is the rejection of the lazy all-or-nothing framing of AI-augmented thought: it is probably _not_ true that using AI is _always_ bad for productivity, or _always_ bad for your brain's sharpness. So what we need to figure out is _when_ is it bad, and when okay. In other words, we need to open up the black box we call "thought" and distinguish some subtypes by drawing new boundaries inside it in a way that is meaningful for our purpose. There are various ways to cut up "thought", and more than one may do the job. I've settled for a three-dimensional division based on a few scientific theories, which works nicely. It is formed by three axes: the **Mode** axis distinguishes thoughts by their _function_ , the **Level** axis is about the _target_ of cognition, and the **Phase** axis separates thoughts by _when_ they happen. ### Mode Axis: Stanovich's Tripartite Mind The dual-process theory of cognition—popularized by Nobel laureate Daniel Kahneman in _Thinking, Fast and Slow_ —says the mind has two modes of operation, System 1 and System 2, that work quite differently: the former is quick and instinctive, while the latter is slow and rational. Keith Stanovich built on that to add a further division within System 2, effectively bringing the number of "minds" to three 13: 1. The _autonomous_ mind is largely equivalent to Kahneman's System 1, i.e. it is about pattern recognition, instinctive associations, and heuristics. 2. The _algorithmic_ mind is raw computation: following logical steps, applying predefined rules (for example mathematical rules) in sequence to arrive at a desired answer. 3. The _reflective_ mind thinks about collecting information, chooses strategies, sets and updates goals, and so on. It's the control layer, the _how_ rather than the _what_. Is this the _best_ way to distinguish types of thinking? Maybe not, and the topic is still debated among experts. But it is a very defensible theory as of now, and (most importantly) it works extremely well for the specific case of human-LLM thinking I want to tackle. Stanovich split System 2 into algorithmic and reflective because he wanted to explain why smart people can still do dumb things—he called this dysrationalia: you can be very good at algorithmic thinking but bad at reflecting on whether what you're doing makes sense. I think this boundary is especially illuminating when it comes to language models. I'll begin by drawing this first axis on our map. ### Level Axis: Object and Meta The next dimension of thought concerns the _realm_ the thought is interested in, of which there are two possibilities: object and meta 14. Object-level (or first-order) thinking is concerned with the actual problem at hand—it's the most obvious interpretation of the phrase "thinking about something", so no surprise there. Meta-level (or second-order) thinking, also called metacognition, on the other hand, is _thinking about the thinking process itself_. A couple of examples might help here. Suppose you're trying to solve a crossword puzzle: * **object-level** cognition means thinking about the hints and the word candidates; * **meta-level** cognition is thinking things like "am I focusing too much on this word?" or "things aren't adding up, I might have written the wrong word somewhere." If, instead, the problem you're tackling is climate change: * interpreting scientific measurements and considering possible mitigation actions is mostly **object-level** thinking; * monitoring your success in solving climate change and wondering about how to best communicate the problem to others are examples of **meta-level** thinking. Like the others, this distinction will prove critical to understanding how best to delegate tasks to an LLM. On the map, I'll show it as a splitting of each mode of thought in two: each mode can be focused at the object level or at the meta level. Reflective vs Meta Here you might be wondering what the difference is between metacognition and Stanovich's reflective mind. In a colloquial sense, reflective thought is itself "meta", because it's about strategies and self-correction. But the "meta" level in the object-meta axis is _even more meta_ than that! One way to remember the difference is that reflective thoughts are about **how to do something well** , while meta-level thoughts are about **_you_ doing things**. The focus is external in the former case, self-referential in the latter. You can think both object-level reflective thoughts and meta-level reflective thoughts, and soon we'll see how that distinction matters. The difference should become clear once you read some more examples. ### Phase Axis: Divergent and Convergent Thinking This third way to divide cognition is concerned with the natural lifecycle of thought: you first need to _diverge_ (search and explore many possible directions and approaches) before you can _converge_ (prune the list of possibilities, discard the bad ones, whittle them all down until you reach a single output). This theory was first proposed by J. P. Guilford in 1967 1516, but even today you'll find it in most business courses on management and design (the design thinking framework has it as one of its tenets 17). Divergent thinking is largely about creativity, because it implies coming up with novel ideas and yet-unverified paths to your goal. It tends to be messy and noisy, because the goal of this phase is to expand your range, not to bring clarity. It relies on the brain's default mode network (DMN)18. Convergent thinking, on the other hand, is all about bringing structure, removing the errors and the unnecessary fluff, and selecting the best option—a job for the regulation skills of executive-control neural networks. Normally, adding this third axis would mean splitting every one of the 6 existing categories (3 for Mode times 2 for Level) into two, leading to 6 ✕ 2 = 12 categories. But I've found that metacognition doesn't really need a distinction between convergent and divergent thought. That seems to be mostly relevant to object-level thoughts, which usually involve an exploration of what's “out there” before drawing conclusions. At the meta level, there is no “out there”, and separating divergent and convergent processes, while arguably possible, doesn't offer much insight. So I'll avoid making that distinction for metacognition, leaving us with 9 different categories of thought. ### Putting Them Together: the AAT Framework With these three axes, we get a grid of nine thought categories. To keep the terms short, in this post I'll omit mentioning the word "object" in the names of object-level thinking categories. Unless I write "meta-", you should assume I'm talking about the good ol' object level. I will also shorten "autonomous" to "auto" and "algorithmic" to "algo". This is the Anatomy of Augmented Thought (AAT) framework. All nine thinking categories are useful for something, and—with the exception of diverge → converge—there is no predefined order in which you use (or should use) them. All can happen more or less simultaneously and in loops, and you shift your attention from one to another very quickly whenever you're actively thinking. But there is one pattern that seems absolutely unavoidable in complex problem solving: no matter what paths you weave on the AAT grid, you must periodically make **decisions** that bring you closer to the solution, be they object-level decisions on direct actions (writing a word in the crossword puzzle) or meta-level indirect actions (resolving to ask your friend for help with the puzzle). Every thinking process, then, is a tangle of many types of thinking dotted with decision points. ## Pre-Augmentation Anatomy of Thought Before we can stick the "Augmented" on and say anything useful about LLMs, we need to understand some things about the plain Anatomy of Thought, unaided by technology. Below you can read (AI-sourced) examples and (my own) clarifications about each of the nine types of thought in the AAT framework. Using this section as your reference Throughout the rest of this post, every mention of one of these categories is followed by an ⓘ icon. Click it to jump to that category's definition below; use the browser's "back" button ⇦ to return to your original reading position. ### 1. Auto-Divergent _Object-level autonomous divergent thought_ #### What it is Representative examples of auto-divergent thoughts are associative leaps, pattern recognition, and remote connections. It's the hunches you have—often suddenly and unexpectedly—about new possibilities and ideas to explore about a problem, but without the certainty of which is right. #### Examples * While showering, you suddenly see a connection between a historical migration pattern and your thesis argument. Intriguing, but you have no sense of how you got there. * A designer glances at a cracked sidewalk and instantly gets a hunch that the branching motif could work for a poster concept. * Halfway through a conversation about music theory, you get the nagging feeling the same concept might explain a bug in your code. ### 2. Auto-Convergent _Object-level autonomous convergent thought_ #### What it is Expert intuition, fast heuristic matching, recognizing the right answer without deliberation. It's the a-ha moments when the solution reveals itself without you really trying, or when the implications of what you just learned suddenly click. #### Examples * A chess player looks at a position and immediately knows it's lost: no calculation, just pattern recognition from thousands of prior games. * A seasoned editor reads one sentence and instinctively spots the passive construction that's draining the paragraph's energy. * A nurse glances at a patient's posture and skin tone and knows, before looking at any chart, that something is wrong. ### 3. Meta-autonomous _Meta-level autonomous thought_ #### What it is Gut-level monitoring: surprise, dissonance, the nagging sense something's been missed (alerting), as well as felt coherence, pieces clicking together, fluency-based confidence (confirming). #### Examples * Reading a technically correct AI-generated paragraph and feeling something is off. You feel a vague unease before you can name what's wrong. * The satisfying click when the last piece of a complex proof slots in and the whole thing suddenly feels obvious. * Unexpected boredom while reading a source, before consciously realizing you've already extracted everything useful from it. ### 4. Algo-Divergent _Object-level algorithmic divergent thought_ #### What it is Systematic exploration, enumerating options, combinatorial search, structured analogy, running thought experiments. It's the mechanical work of finding information, setting up boilerplate, or collecting raw data. When Sherlock Holmes is hunting for clues in the middle of a case, he is mostly doing algo-divergent work. #### Examples * Systematically searching the literature for all studies on a topic, building a spreadsheet of findings and keywords, before drawing any conclusions. * Listing every possible cause of a software bug by category—environment, input, logic, dependencies—before testing any of them. * Running through all combinations of available fridge ingredients before deciding what to cook, to avoid missing a better option. ### 5. Algo-Convergent _Object-level algorithmic convergent thought_ #### What it is Step-by-step derivation, calculation, following logical chains. It's the mathematical, logical, rational work of reaching an answer. What Sherlock does once enough pieces of the puzzle have surfaced, culminating in the grand reveal of the murderer. #### Examples * Evaluating a definite integral step by step, checking each algebraic manipulation before proceeding to the next. * Tracing a program's execution line by line to find exactly where the output diverges from the expected result. * Eliminating crossword candidates one by one using letter constraints until only one option remains. ### 6. Meta-algorithmic _Meta-level algorithmic thought_ #### What it is Systematic process-checking: tracking coverage, noticing repetition, checking breadth, but also auditing whether the problem decomposition itself is right. Verifying steps against constraints and checking consistency. #### Examples * Realizing mid-literature-review that you've only searched English sources, and the most relevant work might be in another language. * Checking your task list and noticing you've been ticking off easy items while consistently deferring the one that actually matters. * Pausing to ask whether the categories organizing your research are exhaustive, or whether you've silently omitted an entire dimension. ### 7. Reflective-Divergent _Object-level reflective divergent thought_ #### What it is Questioning your framing, generating alternative perspectives, asking "what if I'm looking at this from the wrong angle?" When you take a step back and reassess the situation, you're doing reflective-divergent work. #### Examples * Midway through analyzing a business failure, asking: "Am I assuming this was a management problem? What if it was a market-timing problem?" * Noticing you've never made your definition of "success" explicit, and that might have misled other people and caused confusion. * Recognizing that the problem you've been solving is actually a symptom, and trying to name the upstream cause instead. ### 8. Reflective-Convergent _Object-level reflective convergent thought_ #### What it is Applying values, weighing incommensurables, **deciding** : committing under uncertainty and accepting trade-offs. This is when you act on what you've thought so far. It's no longer just about the problem; it's about your own stance, relation, and effect on it (real or potential). #### Examples * After weeks of weighing job offers, accepting one: it's not perfect, but you feel like it's high time to commit to _something_. * Cutting a beloved essay section that undermines the core argument, even though it took a week to write. * Deciding to report a colleague's misconduct despite the social cost, because your values leave no option you could respect. ### 9. Meta-reflective _Meta-level reflective thought_ #### What it is Epistemic self-examination: generating hypotheses about your own biases and limitations ("Am I anchored? What would someone different see?") and judging whether your reasoning process has met your own standards of intellectual honesty. Here is the difference from "mere" reflective thought: in the (object-level) reflective-divergent category, I gave the example of asking "what if I'm looking at this from the wrong angle?"; the meta-reflective equivalent is asking "what factors lead me to look at things from the wrong angle?" #### Examples * Asking yourself: "I keep reaching the same conclusion on this topic—is that because I'm right, or because I built my whole framework to produce it?" * Noticing that using an AI to research this subject always leaves you feeling reassured, and wondering if that's a sign of confirmation bias19. * After a decision: "My argument felt airtight, but I only tested it with people who already agreed with me. What would a real stress-test look like?" ## Thoughts, Mental Fatigue, and Time Some categories of thought can be safely delegated to an AI and, unfortunately, these aren't always the categories that you _would like_ to delegate. So what would people gladly outsource, if possible? The most consistent answers you'll get are: the **mentally tiring** tasks, which are perceived as "difficult", and the **time-consuming** tasks. In this section I'll offer very rough estimates of these two salient implications of thought. Needless to say, these things can't be generalized without gross oversimplification, because thought can be literally about anything imaginable. The estimates I give are general trends based on the few scientific experiments about these things and on my own experience in various fields and roles. ### The Panting Mind The human body is excellent at optimizing its energy consumption, and the brain is no exception. As you're probably all too aware, the brain naturally falls into the least-tiring approach that it considers enough20 to solve a problem—even if it's not the best approach 21. You can usually tell which thought processes would be tiring because you intuitively feel they are _hard_. What are the most tiring categories of thought along the three axes of AAT? Knowing the typical mental cost (a.k.a. cognitive load) of each category will tell you how the average person will tend to think, and what they'll try to offload to AI. A major "cost center" of the brain, acting as a biological bottleneck for intense thought, is the lateral prefrontal cortex (LPFC), on the front-facing surface of the brain. This area handles working memory, reasoning, planning, and conscious imagination—all ingredients for the most advanced forms of rational thought. Several studies 2223 have shown that the metabolism of the LPFC (and related regions, like the anterior cingulate cortex and the parietal cortex) gradually changes when it is activated for longer periods. Glutamate and other toxic substances accumulate, making activations in those areas increasingly costly for the brain. This may explain why the brain seems to fall back to lower-effort options when fatigued 24. (By the way, this is different from the now-infamous "ego depletion" effect by Baumeister et al., which has now been largely debunked25.) Other regions of the brain, like the default mode network (DMN), don't experience the fatiguing effect seen in the LPFC. Although people (understandably, given the name) tend to think of the DMN as "the thing the brain does when it's idle", this brain-spanning web of neurons also plays a role in low-effort thinking 26, including memory retrieval, future planning, and hypothesis generation 27. On the Phase Axis of the AAT framework, these are particularly important during the **divergent** thinking phases, which correspond with creative output. Unfortunately, things are not as simple as they sound, because divergent thinking is a collaboration between various networks, and the brain has to switch back and forth between the DMN, the PFC, and other regions 28, which likely adds to the cognitive overhead 29. The details depend on the specific task, but as a rule of thumb the divergent phase starts with a heavier focus on memory retrieval, which is not very tiring, but draws on the executive networks (like the PFC) more and more as the brain runs out of low-hanging fruit from memory—it has to get busy actively hunting for the less-obvious ideas 30. This means that, in a single session of divergent thought—especially in unfamiliar algorithmic search tasks—the mental fatigue profile can rise from moderate to high. On the Mode Axis, unfamiliar **algorithmic** work is generally rather tiring for the PFC. It requires you to hold multiple interdependent elements in your working memory at the same time 3132. For _repetitive, pattern-like_ algorithmic tasks, however, you usually learn to break them down into small, near-effortless, standardized, but tedious steps, turning this work into something almost autonomous. For example, with the right technique (probably involving pen and paper), making a list of all possible combinations of three letters becomes a mechanical, even easy task—but still time-consuming. The same happens with algebra, once you've internalized its rules: it lets you simplify any algebraic expression with the same ease, regardless of how huge or complex it is. This point bears repeating, as it will come up again: whether a logical chain of thought is pattern-following or irregular makes all the difference for how tiring it is for a human, how fast they can execute it, and how much reflection is needed to guide it. Subscribe to receive new posts as soon as they're published. It's free. Loading verification... Or use the Atom feed for reading apps Using the **reflective** mind also tends to be rather tiring, especially in the convergent phase. Overriding your first instincts, inhibiting bad habits, marshalling the necessary information and, crucially, **deciding** what to do next are some of the added demands on your prefrontal cortex. This gets even tougher with the meta-level thought processes on the Level Axis. fMRI studies tell us that "thinking about thinking" is an extra layer of thought on top of the object-level activations, associated with its own specific areas (the rostrolateral PFC) 33, and that it adds its own contribution to the metabolic shift and fatiguing effect of thought 34. If you've ever tried genuine rational self-examination, this much shouldn't surprise you. People tend to skimp most on the meta-reflective ⓘ work, especially on routine tasks or under time pressure 35. In practice, I think most people avoid spending any significant time doing meta-reflective work, partly because of its high cognitive load. The problem is counterintuitive, because the main job of metacognition is optimizing object-level thought. You know what I'm talking about if you've ever caught yourself thinking "I'm getting fixated on this again, but I know it's never worth my time" or "I already know how this discussion ends, let me change approach." Used well, the meta level can actually _decrease_ the amount of effort (and time) needed to solve the problem, perhaps by correcting a misleading bias of yours, or prompting a reevaluation of your goals. But it is itself a tiring task 12. Fighting off distractions If things weren't hard enough, distractions exist! A recent experiment showed 36 that it takes more effort to shield working memory from external distractions than it takes to update the contents of your working memory. In other words, staying focused on your train of thought has its own intrinsic price. For long-running thoughts, like algorithmic tasks, this cost can add up. ### Guesstimating Time Spent The second factor that matters when delegating (or not delegating) thought is the time you spend in each cognitive category. Some problems need to be tackled regardless of how mentally tiring they are, and how long each step takes can matter a lot. If a computer can do it at 10x or 100x the speed, you'll probably want to have the computer do it for you. Unfortunately, on this front we have to rely on breadcrumbs of research, because empirical data about the time costs of each cognitive category is scarce. The ninefold subdivision of this framework is my invention, so it's natural that no research has explicitly measured process durations in each of those nine cells. We'll have to work with what we have and fill in the gaps with educated guesses, one AAT axis at a time. First, the Tripartite Mind axis. We do know that the autonomous mind is fast (it's Kahneman's System 1, i.e. the "fast" in _Thinking, Fast and Slow_), and that the other kinds are slow. But, as far as I can tell, there hasn't been a systematic study of the timing differences between Stanovich's algorithmic and reflective minds. They may be too intertwined to measure meaningfully, or it may just be too early. What we _can_ say is that algorithmic work can be indefinitely long, while reflective work tends to be more bounded: any specific calculation approach can have any number of steps, but there are usually only a handful of alternative approaches you can consider. As an extreme example, consider the problem "find the smallest prime number that has exactly 10 digits". Claude Opus proposes five strategies to solve it, but tells me that the most promising (i.e. fastest) of these strategies would take about 400 mathematical operations, and the least promising about 75,000! The mechanical work, if you were to actually carry it out, would involve orders of magnitude more steps than the reflective work that guides it. In other words, both algorithmic and reflective thoughts are slow, but algorithmic work can (though it doesn't _always_) take much, much longer than the reflective work that guides it. The picture isn't much clearer for the object vs. meta axis: metacognition takes time 37, but we don't know _how much_. The deeper problem is that different people seem to operate at the meta level far more than others, and some seem to avoid it entirely (this is my own observation; frequency of metacognitive thoughts is a recognized research gap 38). So the question of how long metacognition _actually_ takes is probably moot. Instead, let's consider how long it should take _ideally_ : too little and you won't (even) learn from your deepest mistakes, too much and you get paralyzed in self-analysis. The counterintuitive part is that, done long enough, metacognition can significantly _reduce_ the time you need to think at the object level: you avoid many pitfalls and false starts, stop wasting time on irrelevant thoughts, and generally keep your thought process healthy and efficient. For this reason, I think a good target for metacognition _in complex problem-solving_ is somewhere around 20% to 30% of total thinking time (with massive uncertainty bars!). This is probably more than most people actually spend at the meta level, or consider appropriate. Maybe I'm overestimating it, but lowering the estimate only makes my discussion below about augmented cognition stronger, so I'll be conservative here. Now for the third axis: what are typical divergent and convergent thinking times? There seems to be even less research comparing these two phases than the other two subdivisions. Psychologists do seem to agree that they are not two sequential steps but a cycle, with thought going back and forth between diverging and converging at irregular intervals. But how long do (or should) we dwell in those intervals? No one seems to have even asked the question. In a case like this, I'll just shrug and say that, to the best of our (poor) knowledge, the two have a 50-50 split of time. Precise estimates are not important here. ### All in One Table Based on all the above, we get a map like this: Scroll to see the rest → Category| Cognitive Load| Time Cost ---|---|--- 1. Auto-divergent ⓘ| **Low**. Runs on DMN; minimal prefrontal cost.| **Near-instantaneous** , moments of insight, often coming to you while you're doing something else. 2. Auto-convergent ⓘ| **Low** and automatic; barely registers as effort.| **Very short** , moments of insight. 3. Meta-autonomous ⓘ| **Low** , signal-like; largely automatic and metabolically cheap.| **Brief** moments of insight or gut feelings existing in parallel with conscious thought. | | 4. Algo-divergent ⓘ| Can be **low** for familiar, pattern-like tasks. For novel and un-pattern-like tasks, this usually starts **moderate** (you need to keep several factors in your working memory) but can **escalate** as the low-hanging fruit runs out and DMN-ECN switching intensifies.| Potentially **extremely long** , regardless of how tiring each step is. For many knowledge workers it dominates the workday. 5. Algo-convergent ⓘ| Potentially **low** for familiar, pattern-like tasks (e.g. algebra). **High** for novel domains: it's pure working memory + executive control; the recipe for prefrontal fatigue. | Potentially **extremely long**. The more you diverged earlier, the more work you have to do to narrow down the answer. 6. Meta-algorithmic ⓘ| **Moderate/heavy**. Executive function _monitoring_ executive function, i.e. a second prefrontal layer on top of object-level work. Depends on the task: simple monitoring is much cheaper than auditing.| **Potentially long**. Difficult to separate from object-level algorithmic work, as it has to happen at the same time. | | 7. Reflective-divergent ⓘ| **High**. Requires executive override.| **Moderate** in general. 8. Reflective-convergent ⓘ| **Very high**. Inhibition, value comparison, and commitment, all at the same time. Peak prefrontal demand.| **Moderate**. Includes planning time, debugging, etc. 9. Meta-reflective ⓘ| **Very heavy** , perhaps _the most_ expensive metacognitive operation: requires sustained self-directed prefrontal control with no external scaffolding.| Ideally **quite long** , as it is the most powerful category of thought in the long term. In practice, usually short. # Part 2: Augment ## Careful What You Hand Over ### You Might Also Like... * A Fundamental Framing of Human Language * Is It Bad to Have a Parrot Speak for You? * Replaced At this point you might be wondering whether defining all those categories and making crude estimates of mental fatigue and time costs was really worth the trouble. I think it was, because—imprecisions and all—now we can use it to structure our answer to the big questions of **if, when, and how to delegate thought to a (general purpose) LLM**. We get nine answers instead of one, and even if each may not be very precise, I think the ensemble lends some much-needed nuance to the discussion on augmented thought. Here is a brief review of how to think about delegation in each of the nine thinking categories, one by one. After that, we'll step back and look at the full picture. ### The AI's Territory: Things You Can Happily Delegate General-purpose language models like GPT, Claude, and Gemini come with vast computational power but zero accountability, lived intuition, and consistent intellectual honesty, so we can start with the obvious insight: algorithmic work is the paradise of augmented thought. I'm talking about the systematic, quantitative, or combinatorial heavy lifting. These are the areas that usually take up the most time in "knowledge work", and are often (though not always) cognitively tiring. An LLM can do them at a mind-numbing speed while you stare out the window sipping your tea. It's a match made in paradise, and the part that gets closest to being an actual magic wand. #### Algo-Divergent: Delegate 🤖 You can usually delegate most Algo-Divergent ⓘ work to an LLM, which consists mainly in the systematic exploration of options, sources, and ideas. Especially in the early low-hanging-fruit phases, simply letting the model produce options from its training data is valuable and cheap, with little downside—filtering out errors and hallucinations is the job of other categories. This is brainstorming territory, so there are (almost) no wrong answers. Still, letting the AI run wild almost guarantees that it will miss certain possibilities and directions. Models tend to bias their searches toward whatever their initial attention lands on. This is where the human comes in: you need to set precise goals and boundaries, steer the model when it gets stuck or clearly biased, and ask it to ground its search in reliable external sources or even use code for more systematic surveys (all reflective and/or meta inputs). Do this well, and the LLM can enhance your creativity 39. The point is not to get high-quality options on average (you won't) but to unearth the occasional big leap in insight. #### Algo-Convergent: Delegate 🤖 You can fruitfully delegate this category to an LLM too, but with more care. Artificial neural networks like today's transformers are probabilistic algorithms: they _tend_ to give the most accurate next answer, but offer no guarantees. This makes them unreliable at logic and math in general, and you can't trust them to one-shot the right answer 4041. AI models are cajoled into parroting logical thought like a trained monkey dances to a tune. Trained or not, you don't want a monkey piloting your aircraft. Still, the benefits of what it _can_ get right are so enormous that people have put a lot of work into mitigating this unreliability. This is the realm of most software engineering use cases (at its core, coding is algorithmic convergence). Engineers have devised approaches like iterative refinement42, adaptations of test-driven development, multi-model reviews, and many more to improve the trustworthiness of AI algo-convergent work. We're still far from 100% reliability, but it's an exciting and fast-moving field. The role of the human, here—and not only in software—is to vet the process and the results critically, do reality and plausibility checks, and interrogate the LLM whenever it seems to have made leaps in reasoning. In other words, **you trade object-level grunt work for meta-level control work**. More on this below. A key tool you should use whenever possible to drastically improve the results is asking the LLM to solve the problem by writing a program, rather than relying on worded reasoning alone. Modern language models are very good at putting together quick scripts, and usually come with the infrastructure to run them on the spot. You can think of code as the routinization of an LLM's algorithm, similar to how internalizing a routine algorithmic task (e.g. mastering algebra) makes your own algorithmic work less mentally tiring and more reliable. The difference is that code is _mind-numbingly_ faster. ### The Middle Ground: Tight AI-Human Collaboration Being "algorithmic" isn't all that an LLM can do. The large state-of-the-art models of today have immense latent spaces—maps of knowledge about almost any topic known to humankind. AI knows about everything. The problem is that these knowledge spaces are unstructured (compared to any reliable database) and too vast to fully wrap one's head around. This is why some AAT thinking categories need to be joint efforts, where the AI provides the data and patterns but the human is the one who actively navigates. #### Auto-Divergent: Joint Work 🧑‍🦰🤖 This is the kind of divergence work that comes automatically. Unlike systematic explorations and algorithmic brainstorming, auto-divergent ⓘ thinking just happens, unplanned. For a human, this means hunches and leaps of insight. For an LLM, it's the surprising connections it pulls out of its training data 43. If you ask it for ideas to name your baby, it can produce any number of ideas seemingly from thin air. Auto-Divergent is where most of creativity happens. This is a delicate task to delegate to an AI. On the one hand, it can genuinely expand the range of ideas you consider; on the other, it can skew you toward the same pool of ideas as every other AI-assisted thinker 4445. On top of that, reading the novel associations offered by an LLM can reduce the number of original ideas your own brain produces and make you feel less invested in the work 46. Often this doesn't matter: you just need a good enough idea, and being maximally original is not a priority. In these cases, giving the LLM free auto-divergent reins is probably fine. But when originality matters, you can get the best of both worlds by first brainstorming _without_ the AI, _then_ asking it for its ideas (without biasing it with yours). The resulting pool will be a mix of your own creativity and that of the model's training set. #### Reflective-Divergent: Joint Work 🧑‍🦰🤖 It's very common to struggle with a problem because you're thinking about it the wrong way. You make the wrong assumptions, draw the wrong boundaries, and things don't make sense to you. Or you might be able to reason your way through the question but find it very confusing and tiring. You need to reframe, to change your point of view and angle of attack. That's easier said than done, because framings are very sticky—the longer you've held one, the more it will seem like _the_ way reality works. An example of reframing. Figure from Shin, J., et al. (2025). This is where an LLM can really get you out of your thinking rut. It will offer as many new framings as you want and, although most will be clumsy or moot, some might be just what you need to see the limitations of your original way of thinking. Under the right conditions, asking an AI for reflective-divergent assistance can speed up the work of reframing. I worded that last sentence carefully. There are two strong limitations in using LLMs here. First, you apparently need to be already quite competent in the problem's domain to benefit from the speed-up in reflective-divergent ⓘ thought 47. If you're a beginner and don't have the problem-solving muscles for that kind of problem, an AI may not help you reframe much at all. Second, even if you're a domain expert, whatever benefit there is to augmenting this thinking category seems to be mainly in _speed_ —the number of reframes you can explore in a given time—and not in their _quality_ 47. (I'll return to the role of expertise in the Expertise Matters Doubly section below.) In other words, an LLM might—maybe—make your reflective-divergent thinking somewhat smoother, but only if you're both already good at it and you put in your own effort. #### Meta-Algorithmic: Joint Work 🧑‍🦰🤖 Meta-Algorithmic ⓘ thinking is about structuring the process in a logical and appropriate way. The good news is that part of this work can be standardized and shared. There is, in fact, a whole cottage industry of pre-packaged "mental models" and "n steps to do x" recipes—it's a big portion of the self-help industry and business manuals: Five Whys, OODA loops, six thinking hats, project management waterfalls, product lifecycles, lean processes, six sigma, code boilerplate, and many more. The even-better news is that your LLM knows _all of them_. Throw a common problem at it and it will readily produce a neat, well-organized thinking framework to solve it. This is excellent and there is no reason not to delegate this otherwise tedious work to the machine. Except... your deep involvement is still necessary. The fact that an AI can produce an advanced framework made by seven PhDs and battle-tested by three generations of Druckers doesn't mean it's the right framework for your specific case. Only you know the full details of the problem you're trying to solve, your short- and long-term goals, and the risks and opportunities involved. No matter how much context you give the LLM, a fundamental decision like which thinking process to use can only be vetted and chosen appropriately by your carbon-based brain. So yes, let the AI handle the skeleton of the process, but audit its decisions critically at every step. ### The Human's Territory: DIY Things may change in the future, but there are some forms of thought where current LLMs do more harm than good 48. These are the mental tasks that keep the delegated categories of the previous two sections on track. They rely on lived experience, accountability, and full metacognition, and they should remain fully human-generated. Delegating them can lead to cognitive atrophy 9101149, and will make it almost impossible to reach consistently good, reliable results. People who delegate these categories to LLMs are, in my assessment, the main cause of the lack of measurable performance boosts from AI: they have the machine generate lots of nice-sounding outputs, but those outputs are answers to the wrong questions, or contain bugs that pass unnoticed until it's too late. #### Auto-Convergent: Do It Yourself 🧑‍🦰 This is the instinct that lets you recognize the "right" answer on the spot, without reasoning steps. It's shaky in humans and utterly unreliable in LLMs. Since it takes very little time and effort regardless, there is no reason to delegate it. #### Reflective-Convergent: Do It Yourself 🧑‍🦰 This cognitive category is one of the most important and consequential, because it's where you **decide** what to do in the next step. To decide well you need to apply your values, weigh fuzzy trade-offs, and commit under uncertainty. An LLM can lay out the options and costs (an algo- or reflective-divergent job), but only you can make the call. Reflective-Convergent thinking is where accountability and consequences reside. Trying to think with an LLM in this cell of the AAT matrix is a risky business. One problem is that tasks that seem algorithmic on the surface sometimes hide reflective-convergent ⓘ decision points inside them, where uncertainty or contrasting options exist. The model might simply choose the wrong path at some point along its long chain of algorithmic steps and silently proceed to crunch the wrong numbers for a while without you noticing. It's very important to prune as many of these branching points as possible before the LLM begins its algorithmic work, and to ask it to stop and request clarification whenever it's unsure about something. Then you have to deal with the even more insidious hazard of being hypnotized by the AI's own narrative 50. An LLM will always try to quietly colonize the reflective-convergent mode—it will offer fluent explanations and rationalizations for why the answer it gave you is absolutely the right one and, if you're like most people, it will probably persuade you. Research has shown that people not only tend to go along with the AI's stories even when they're wrong, but they usually feel like _they_ made the call 5019! If you use your LLM-augmented output for anything serious, "but... AI wrote it!" won't be accepted as an excuse when that output turns out to be bad.51 The only sane choice is to _never_ delegate value judgements and key design decisions to AI, and to actively distrust its proposals—all the more so when they seem convenient to you. It's not a coincidence that most of the impressive advances in LLM use for coding are ways to prevent the models from doing reflective-convergent work. 525354 The software world nowadays has an endless stream of new techniques to effectively structure the AI's process before starting, to provide all the context that might become necessary along the way, and to ensure the human gets to make all the important decisions. One of my projects is to free these methods of their engineering baggage and make them accessible to non-technical people, too. #### Meta-Autonomous: Do It Yourself 🧑‍🦰 Gut-level monitoring is the intuition of whether something is missing or off (cognitive dissonance) or whether everything checks out and clicks (fluency). The LLM can't do that for you—it will always craft things in a way that _appears_ to click. Meta-autonomous thinking is your first line of defense against those treacherously smooth stories the AI tells you, and you should pay attention to these instincts. Fortunately, this is not a mentally tiring operation, so you can keep it "always on" in the background as you work through the other thinking categories. But not all gut feelings are equally reliable. If you get an alert signal ("something feels wrong here"), you can bet it's right. Pursue that lead like a hound, dig as deep as you need to, until you clear it completely. When a confirming signal fires in your mind ("this makes sense"), on the other hand, you might very well be wrong, tricked by the artificial fluency of the transformer's output. Treat such confirming gut reactions as noise, and perform the algorithmic and reflective due diligence to ensure the output is really correct. #### Meta-Reflective: Do It Yourself 🧑‍🦰 Lastly, metacognitive reflection is the most meta of thought processes, and the single most important human contribution to the quality of thought—augmented or not. Meta-reflective ⓘ thinking is, in general, the realm of epistemic self-examination; when working with an LLM, it's how you keep the model on track and near peak efficacy. Understanding and applying this Anatomy of Augmented Thought framework is itself a meta-reflective ⓘ function. You should never skimp on this, even though it's one of the more mentally demanding jobs 5556. In fact, I don't think it's possible to produce anything more than highly generic and mediocre results without deep meta-reflective effort. Keep this cell of the AAT matrix fully yours: steer it, manage its context, craft careful prompts, and use "doubt engineering" techniques (these are the topic of a future post). Fortunately, LLMs are steadily improving at meta-reflective support thanks to techniques like structured chains of thought, prompted self-critique42, and multi-model reviews. These improvements can take some of the cognitive load off your brain, but not much: LLM mistakes are also becoming subtler and harder to spot, so the harder part of this work remains squarely a human task. ### In Summary: The Delegation Grid ## Augmented Thinking: Faster _and_ Slower Using an LLM for work is alluring, first and foremost, for its promise of incredible time savings. It feels like magic! Things that might have taken hours can now be produced in a minute. People who value their time can't resist the temptation, and they generally report _feeling_ much faster and more productive with AI. But the empirical data tells a different story: companies are still not seeing the wondrous explosion of productivity promised by the advocates 57 58. We have a paradox. If everyone says they're producing more, why doesn't macro-level productivity soar? It could be that individuals are absorbing the time savings to finish early and take longer breaks from work 59, but that's a rather extreme hypothesis at the aggregate level, and there are studies saying that people are actually busier than ever because of LLMs 60. I find somewhat more convincing the idea (partly backed by research 61) that AI-assisted people end up trying to do more in the same amount of time—including nice-to-have things and gold-plating that add complexity and don't contribute much value in the grand scheme of things. This increase in number of tasks leads to more multi-tasking, which is slow, error-prone, and mentally tiring (more on this later). I know this firsthand: I've gotten into the habit of working on three or four completely unrelated projects at the same time, all the time: while an AI agent is working on one of my prompts I switch to the next one awaiting my input, review its work, prompt it again, and move on. It feels productive, but I wonder how good an idea it really is in the long term. But at least part of the explanation lies in _how_ people use LLMs, and on _what tasks_. That, I think, makes an enormous difference in how they can affect productivity. We need to break free of the monolithic "is AI useful or not" framing and look into which kinds of tasks can benefit more or less from the technology, and how to get the most out of it while doing them. This is where the AAT framework can help. ### Mapping Time: The Anti-Magic Effect What time savings can an LLM offer you, assuming you follow my Delegation Matrix to the letter? Something along these lines. First, augmented **autonomous** thinking categories take roughly the same amount of time: they are fast without AI, and they stay fast with its help. Not much to gain directly here. **Reflective** categories, according to the Delegation Matrix, remain human tasks, so the time savings in that area don't change much—if anything, you have to reflect _more_ while working with an AI, because you need to monitor and control its approach in addition to your own. The same goes for **metacognition** , which is largely the human's territory and becomes especially important—non-negotiable, even—when working with the flakiness of language models. **Divergent** thinking phases tend to be low-risk while surfacing the occasional gem of insight, so an LLM's results can add value even when they don't save you much time directly (as in autonomous categories). This added value, for example in the form of better framings or additional points of view, can lead to _indirect_ time savings later on. Conversely, **convergent** (alliteration not intended) phases executed by LLMs are risky and potentially deceptive, often leading to indirect time costs when you later find the mistakes and have to go back and fix things. **Algorithmic** tasks are the clear winners in terms of time savings. You can tell because coding remains by far the biggest AI spending category, and other major ones like IT operations, document processing, and customer support automation are mostly algorithmic in nature 6263. These are the systematic, tedious, sometimes mind-numbing tasks that would take you a lot of time but that an AI can work through tirelessly and quickly. It might even be able to write code that does it in milliseconds. In summary, all things considered, my rough assessment of the time effects of each AAT category is as follows: Big savings in algorithmic (divergent more than convergent) work, more modest and indirect savings for auto-divergent and meta-algorithmic, and slowdowns in all other categories. The strangest result, though, is in the **meta-reflective** ⓘ layer. As the delegation grid showed, this is a human task, yet you should expect to spend significantly _more_ time on it when working with an LLM, not less. AI introduces a host of failure modes that typically don't exist in solo work, like confabulation and plausible-sounding flawed narratives, and these require you to constantly ask: "am I trusting this output because I've verified it, or just because it made a long and coherent argument?" 50 Call this the Anti-Magic Effect: using the "magic wand" can be harder work than not using it! Without heavy meta-reflective effort, it doesn't matter how much time you save on the algorithmic work: the outputs will be useless at best, harmful at worst, in the wrong format, and their flaws hard to fix 1241. In practice, this means we all need to invest in honing our metacognitive and reflective skills. The fact that we naturally tend to shy away from precisely these kinds of tiring mental chores 64 (see When Fatigue Steers in Your Stead below) makes this habit all the more urgent. ### To Augment or Not to Augment Problem-solving in the real world is always _some_ mix of all nine cognitive categories. If not all augmented thinking is equally time-saving, it follows that not all projects will benefit equally from an LLM's participation. Let's take two somewhat extreme examples. Some office jobs are almost entirely algorithmic in nature. The work isn't necessarily difficult or confusing in itself, just long and mechanical. This includes tasks like inventories, formatting long documents, cross-checking sources, and writing variant after variant of the same kind of code. In such cases, the before-after picture of how you spend your time might look like this: In other words, although the Anti-Magic Effect means you have to spend more time on reflection than you would otherwise, the LLM's time savings in the algorithmic part offset that by a wide margin, and you get a huge boost in productivity. This is the ideal use case for AI, and honestly a no-brainer: go for it! Other tasks look more like this: Here, from the outset, the algorithmic part accounts for a much smaller fraction of the task's necessary work, and the reflective part is already predominant without AI. In cases like this, the algorithmic boost may not be enough to outweigh the added reflection time. There are many tasks at this end of the spectrum: opinionated creative work, tackling very novel and exotic problems, working through emotions are some that come to mind. The point is that some jobs can actually take _longer_ with an LLM than without. This doesn't mean you should never delegate tasks like that to a machine—the inspiration and hints it gives you might still be valuable, and help you increase the quality of your work—but you should at least be aware of its negative effects on productivity. What kinds of tasks are most reflection-demanding? As a rule of thumb, you need to put the most effort into carefully monitoring and steering the LLM during **convergent** phases, because this is where every wrong step has the biggest consequences. And a convergent thought process needs more attention _the less pattern-like it is_. Some algo-convergent ⓘ tasks, in particular, can be long sequences of easy, standardized steps, which an LLM can complete accurately by referring to analogous patterns in its training data. The risks spring up mostly when the process is new, randomness-driven, or very specialized: precisely the mental tasks we found to be most tiring for humans. Click to enlarge. Here I assigned positions on the augmented time-saving landscape to many knowledge-work tasks. This is very approximate, but hopefully you get the idea of how to weigh the tradeoffs for your specific use cases. What this framing gives you is a view on the landscape of augmented productivity: * Tasks high in algorithmic volume and based on pattern-like convergent work are LLM heaven: incredibly fast and quite accurate. * In processes with many algorithmic steps but requiring custom and non-standard reasoning you might be more productive delegating the divergent part only, keeping the careful convergent work for yourself. * When there isn't much algorithm involved but the convergence follows standard patterns, you can safely delegate the work to a model—just don't expect extreme time savings. * And when the work is both non-algorithmic and highly custom, you need to seriously consider doing it all yourself to save time. ## When Fatigue Steers in Your Stead The Anti-Magic Effect means that properly augmented thought is _more_ cognitively demanding than solo thought, and many users skimp on the meta and reflective work precisely to avoid that strain. My hope is that simply being aware that using an LLM is supposed to be hard can be enough to spur more nuanced approaches 65. The real danger, however, is that this extra strain is largely invisible. From Eskimo Folktales by Knud Rasmussen, Internet Archive / New York Public Library Mental fatigue is a metabolic byproduct of using the lateral prefrontal cortex 22. The more intense, deliberate thinking you do, the more toxic substances like glutamate accumulate in your LPFC, and the less control you have over your thought processes and decision-making 24. Crucially, the same experiment that measured these _objective_ effects also asked participants to rate their _subjective_ perception of their cognitive abilities, and found that _people were not aware of their own degradation_. When your LPFC is flooded with glutamate after hours of careful prompting, you'll be more likely to accept the first reasonable-looking output the LLM throws at you, to skip the necessary "step back and critique" work, and to be generally more careless with your procedural decisions. This may be how you get experienced software developers who think they're 20% faster with AI while actually being 20% _less_ productive 5775, and how people end up burning out more and feeling less engaged with their work 61666768 when using AI. What to do about this problem? I don't have a very good answer yet. At the very least, being aware of this inevitable cognitive degradation during long AI sessions might help you plan your workday more carefully. In my own experience, learning to detect your own prefrontal fatigue is not entirely impossible. It took me years of daily, intensive thinking sessions and a lot of scheduling trial-and-error, but I'm now usually quite aware of when my brain has become too dumb for proper reasoning (typically after about 3-4 hours of reflective/meta thought). I'm not sure I'm able to fully compensate for all the negative effects yet, but I did see big productivity gains when I started using that knowledge. ## Expertise Matters Doubly So the optimal application of LLMs for difficult thought depends on the category of thinking you delegate, the time savings depend on the type of task, and the pitfalls are amplified by your brain's fatigue. That's a good refinement of the default black-or-white view so common online. But there's one last space we need to explore before this framework can be of use to most people: are the benefits the same for novices and experts? Science offers some hints of an answer in this case. The short version is: of course the benefits are not the same. A longer one: not the same, and it depends in interesting ways on what you mean by "expert". In very rough terms, you could be an expert _in the problem's domain_ , an expert _in using LLMs for problem-solving_ , both at the same time, or neither. These are four distinct scenarios. What does it mean to be a "domain expert" in this framework? Stanovich's tripartite mind is helpful again: when you're an expert at something, you have learned to "chunk" domain information into a few meaningful patterns 69 that you have internalized and automatized 70, i.e. you can unconsciously simplify the problem space to the minimum necessary. Your autonomous mind is your most powerful asset—essentially a sophisticated set of alarm bells to spot every awkward detail and mistake. This, in turn, supports your algorithmic thinking, because you need to hold in your working memory only those few tried-and-true learned patterns, rather than _all potentially meaningful_ information. A demonstration of this was given by a famous experiment by Chase & Simon (1973), in which they showed that chess masters are vastly better than novices at remembering chessboard states from actual games, but equally bad at remembering randomly-generated board states. This proved that expert chess players must be doing powerful simplification work without even thinking about it, picking up and retaining the meaningful bits of information while ignoring the unimportant details 71. This is the expert autonomous mind at work. But specialists fare less well with the reflective mind and metacognition, because they become overconfident in their own abilities 727374, their thinking becomes entrenched 7576, and (like novices) they remain susceptible to bias from external inputs.77 As for the definition of "LLM expert", I define it as someone who 1. excels at reflection and meta-level considerations, 2. knows when to delegate thought to AI and when not to, 3. knows which tasks are going to benefit the most from augmentation, and 4. can account for their own cognitive fatigue to some extent. This skillset is almost exactly complementary to that of the domain expert. In fact, it is largely domain agnostic. Here is what everything we've seen up to now suggests for various types of users. ### Domain Novice × LLM Novice: Tentative and Shallow Someone who is a beginner in both LLM use and the complex problem they're tackling isn't going to be very effective with AI, because they'll be slow (lots of uncertainty, trial and error) and mostly wrong (all the pitfalls we've already covered). They don't have the autonomous monitoring skills to spot errors, so the only way they can hope to catch AI mistakes is by slowly working through the results themselves, defeating the point to some extent. Add a sprinkling of Dunning Kruger to the mix (but not too much), and you can see how fraught an endeavor this is. Still, AI can speed up at least the easy and standardized parts, so it's not always a bad idea for this group. The double-novice should treat the LLM as a tutor rather than an engine, using it to _learn and explore_ more than to _produce_ polished outputs. ### Domain Expert × LLM Novice: Powerful but Inefficient People with deep experience in a topic but unfamiliar with LLM-augmentation find themselves in an interesting predicament. They have an excellent _autonomous_ mind that lets them catch mistakes early, but they also tend to be overconfident. If the AI gets into Yes-Man Mode (as it's wont to do), it won't point out the _human_ 's errors, simply playing along with whatever the human asserts with any conviction. The work is also tiring for the expert, because they're not used to all the steering and prompting tricks required to get good results. They tend to under-specify or over-specify their demands, get poor results on the first try, and either start fighting the machine or give up. I think this complex relationship with the LLM's role explains, at least in part, why experts seem to gain less from AI than domain beginners in controlled experiments (see the "Isn't AI a boon for novices?" box below). But one has to begin somewhere, and this initial struggle to get even a small productivity boost from an LLM is a necessary step toward proper thought augmentation. ### Domain Novice × LLM Expert: Double or Nothing This quadrant is a honeypot for veteran prompters. An LLM's latent space is vast beyond comprehension. No human knows so much. The fact that it is there to be extracted at any moment is a huge temptation. Why limit myself to solving problems in my own domain of expertise—asks the expert AI user—when an LLM can fill in everything I don't know? When this succeeds, it feels enormously empowering. The world is at your cognitive fingertips—you are a super-generalist! But this quadrant is also the riskiest. People here can't really apply their _object-level reflective_ mind effectively, and are forced to delegate that part to the LLM. Without domain knowledge, you also have to rely on the AI to do the convergent work for you. Both of these go against the insights of the AAT framework. The usual result is highly fluent, coherent, and deeply flawed LLM outputs that the human is unable to debug. Even assuming you _do_ manage to get correct outputs on unfamiliar topics, you face the danger of deskilling or perpetual inexperience, never learning anything new again 78. We don't know yet how this will play out. Maybe the models and our techniques will eventually become good enough that this is the normal state for everyone; maybe it's the beginning of a global intellectual disaster.79 We'll see. Some people are pessimistic about it. For now, consider this way of using AI a high-risk, high-return gamble. Isn't AI a boon for novices? There have been several studies offering robust evidence that novices are the ones who get the biggest productivity gains from using LLMs. For instance, you'll read that "less experienced and lower-skilled workers improve both the speed and quality of their output, while the most experienced and highest-skilled workers see small gains in speed and small declines in quality," 1 and that professional writing test participants "with weaker skills benefited the most from ChatGPT." 80. My explanations above might seem to contradict these results, but I don't think they really do. The studies above focused on _standardized, relatively-easy tasks_ like boilerplate writing and customer support, i.e. high-algorithm and high-pattern, precisely the kind that gets the biggest productivity boosts from LLMs, and the kind that experts are already quite fast at. It makes sense that inexperienced people would get the biggest share of benefits there. This Anatomy of Augmented Cognition framework, on the other hand, is specifically about _complex/novel_ problem solving and _long and difficult thought processes_. Here the evidence tells a different story, because the moment you step outside the LLM's training scope, your autonomous alarm bells and meta-reflective work begin to make all the difference. Novices don't do well in those cases 81. ### Domain Expert × LLM Expert: Full Augmentation Needless to say, the Goldilocks zone is when someone is both experienced in the topic of study and skilled at augmented cognition. This combination allows you to delegate exactly what can be delegated and nothing more, while catching mistakes early and limiting the most tiring mental work to the categories of thought with the most leverage. In my very anecdotal experience, almost all of those working in this quadrant today are software developers. I haven't heard of many people expertly doing highly complex, sustained, useful work with LLMs outside of coding. This doesn't mean there aren't people doing that (there must be some), but I do believe there is an enormous gap here. This is the main reason I'm writing this post: I feel we can and should democratize LLM expertise. | **LLM Novice**| **LLM Expert** ---|---|--- **Domain Novice**| 🟡 Won't get far| 🔴 High risk bet **Domain Expert**| 🟡 Powerful but inefficient| 🟢 Full augmentation # Conclusions You can't conquer a land you don't know the lay of. The relevant science is still in its embryonic stages, and there is much left to research about human-AI problem-solving. Outside of the labs, we hear lots of fragmentary reports of how much AI helps, whether it hurts more than it helps, and all the risks and horror stories, but we don't hear enough about _how_ and _when_ and _why_ we can use AI to greater or lesser benefit (with notable exceptions, of course: see for example Ethan Mollick, Maggie Appleton, Andy Clark). Not everyone believes in magic. Nor is it a theoretical topic we can leave to specialists the way we generally can with particle physics or medicine. We are all practitioners. This post is my attempt at mapping the landscape as granularly as possible, hoping it helps others orient themselves toward a nuanced relationship with this strange emergent skillset. I found that simply having a rough map like this—shaky as it is—offers useful insights almost for free. In closing, I'll summarize my three major takeaways from this exploration. Note For a recap of all pitfalls and gotchas of augmented cognition mentioned in this post, see Appendix I. First, contrary to popular belief, **serious augmented thought isn't supposed to decrease the mental strain on people's brains**. In fact, if you're _not_ mentally strained after an LLM session, you might be doing it wrong, and already bankrupt on cognitive debt. How sustainable this high-intensity work is in the long run, and how it affects the quality of your results, is something to ponder 61. Second, **it's tempting to believe that AI, if it is any good at all, is good for every part of a project and useful for everyone and for all projects equally.** This fallacy will push you into monolithic delegation: you ask the machine to cover all categories of thought, _especially_ the tiring work of carefully steering, deciding, and monitoring the models 21. As we've seen, AI can be very helpful, but only on certain processes, and only for people with certain know-how. For some projects it won't even be worth the mental overhead. The last takeaway is that **being very good at the meta-work of using an LLM is critical for any serious endeavor with it**82. Contrary to popular belief, this new technology is not creating a generation of sorcerers who solve every problem simply by purchasing a subscription. When it comes to LLMs, _cognition becomes the main subject of human thought_. Understanding it as well as we can is non-negotiable, like mastering human anatomy is non-negotiable for any artist who wants to draw people. Metacognition is the skillset that makes the difference. Main Takeaways in Short 1. Using an LLM well is hard work 2. LLMs can only help on _some_ parts of _some_ projects 3. You need to become an expert meta-thinker At the very beginning I mentioned a worrisome lack of large-scale productivity gains in organizations that have invested heavily in AI. Individuals often claim (and sometimes prove) that LLMs help a lot, but companies beg to differ. The AAT framework offers an explanation for that—perhaps it's a problem of wrong expectations. Investing millions to equip your workforce with state-of-the-art LLMs won't make a difference unless they all suddenly become meta-reflectively ⓘ skilled _and_ willing to burn through their precious cognitive resources every day. They need to sweat their prompts, orchestrate their context, and fine-tune uncertainty at every step (techniques I'll cover in a more practical post in the near future). Adjust the expectations, redirect some of that spending to training people, and things might just turn around for companies. Most people agree that we'll soon be using AI to do much more than we do now. For simple routine tasks, I don't think we need to worry too much, and the warnings of this post probably won't apply that strictly. But if we start using LLMs to handle all of our _difficult_ tasks, then meta-reflective ⓘ self-examination will rise to the top spot as the single most important human contribution in everything we do, and the one role that won't be replaced by machines for a good while yet. It's time to begin teaching metacognition in all school curricula. This is the meta-era. ● _Special thanks to F.G. and A.D. for reviewing drafts of this post._ # Appendix I: Pitfall Recap This is a quick reference of the various gotchas and pitfalls mentioned in this post. Compiled by an LLM. ### Auto-Divergent ⓘ: Joint Work * **Idea homogenization.** Using an LLM for creative brainstorming skews you toward the same pool of ideas as every other AI-assisted thinker, pulling you away from genuinely original angles. * **Crowding out your own creativity.** Reading AI-generated associations can suppress the number of original ideas your own brain produces, and makes you feel less personally invested in the result. When originality matters, brainstorm alone first, then consult the model. ### Algo-Divergent ⓘ: Delegate * **Attentional bias.** LLMs bias their search toward whatever their initial framing lands on, systematically missing other directions. You must actively steer them to explore alternative spaces. * **Steering overhead.** You need to set precise goals, provide boundaries, and redirect when the model gets stuck or biased — none of which is free. ### Algo-Convergent ⓘ: Delegate * **Probabilistic, not guaranteed.** LLMs are trained to produce plausible next tokens, not logically correct ones. They are unreliable at math and formal logic; never trust a one-shot result on a non-trivial derivation. * **Hidden decision joints.** Long algorithmic chains often contain implicit branching points where the model must make a judgment call. It may silently choose wrong and keep running, compounding the error invisibly before you spot it. Prune ambiguities before handing off the task, and instruct the model to stop and ask when uncertain. ### Reflective-Divergent ⓘ: Joint Work * **Domain competence required.** The speed-up in reframing that an LLM can provide only kicks in if you're already quite proficient in the problem domain. Novices gain little or nothing from AI reframing assistance. * **Speed, not quality.** Even for domain experts, the benefit appears to be mainly in the number of framings you can cycle through per unit time, not in the depth or quality of each reframe. ### Reflective-Convergent ⓘ: Do It Yourself * **AI colonizes the decision.** An LLM will always attempt to quietly fill the reflective-convergent role — offering fluent rationales for why its output is correct. People regularly go along with this even when the output is wrong. * **Illusion of agency.** Research shows that people typically feel they made the final call even when the AI effectively made it for them. Accountability stays with you regardless. * **No excuse accepted.** If an AI-assisted output causes harm or is simply wrong, "but the AI said so" is not a defense. Treat every AI-generated decision recommendation with active suspicion, especially when it conveniently confirms what you already hoped. ### Meta-Autonomous ⓘ: Do It Yourself * **Artificial fluency masks real gaps.** LLMs always craft output that _sounds_ coherent and complete. You cannot trust a confirming gut feeling ("this makes sense") when reviewing AI-generated text — the fluency is cosmetic, not epistemic. Treat confirming signals as noise; pursue alert signals like a hound. ### Meta-Algorithmic ⓘ: Joint Work * **Framework mismatch.** An LLM can produce a sophisticated, well-sourced thinking framework and still be wrong for your specific situation. Only you know the full details, goals, and constraints — you must audit and choose the framework, not just accept it. ### Meta-Reflective ⓘ: Do It Yourself * **Skimping here guarantees mediocre results.** Without deep meta-reflective effort on your part, gains in algorithmic speed produce outputs that are useless at best, harmful at worst — in the wrong direction, with hard-to-fix problems. * **Subtler failures ahead.** As LLMs improve, their mistakes become harder to spot, not easier. The burden on human meta-reflection increases over time, not decreases. ### Cognitive fatigue and the Anti-Magic Effect * **Fatigue-induced shortcuts.** Under cognitive fatigue, you are more likely to: accept the first plausible-looking output; skip critique and verification steps; make careless procedural decisions. All of these compound silently. * **Fatigue is invisible.** Mental fatigue degrades judgment and decision quality in measurable, objective ways — but people do not notice the degradation in themselves. You can be significantly impaired and feel perfectly normal. * **Inverted effort profile.** Effective augmented work spends a larger fraction of total time in high-intensity reflective and meta-reflective work than solo work would. You may be faster overall while burning through mental resources at a much higher rate. * **Multi-tasking trap.** AI's speed creates the temptation to run multiple projects in parallel while agents work. Multi-tasking is slow, error-prone, and mentally costly. * **Burnout risk.** Heavy AI use correlates with increased cognitive load and burnout, not relief from it. ### Expertise interactions * **Domain Novice × LLM Novice.** No autonomous alarm system to catch AI errors; Dunning-Kruger effect raises confidence in flawed outputs. Treat the LLM as a tutor for learning, not an engine for producing polished work. * **Domain Expert × LLM Novice.** The expert's strong autonomous mind can catch errors, but overconfidence leads to under-specified or over-specified prompts. In Yes-Man Mode, the model plays along with the expert's mistaken assumptions rather than correcting them. * **Domain Novice × LLM Expert.** The most dangerous quadrant: produces highly fluent, coherent, deeply flawed outputs with no mechanism to detect the flaws. Also risks deskilling — never building domain knowledge because the AI always fills the gap. # Appendix II: Caveats and Assumptions This post has many weaknesses due to gaps in data and/or in my knowledge. All mistakes are mine. Several of the conclusions I drew here are interpretations of scientific results, and are tentative and arguable (comment below or write to me about them!). Some of the empirical results I reference are themselves still contested and not yet fully accepted by the respective academic communities. I've done my best to list all such limitations below, but I'm probably missing a few. The following list of caveats and assumptions is largely written with the aid of AI. * **This framework is exclusively about the use of AI for complex, multi-step "knowledge work" of a certain importance.** (This is mentioned in the post a few times, but just to be clear.) There is a whole category of LLM tasks for which these constraints and insights don't apply fully or at all. For example, using AI for a quick web search or to learn what the capital of France is doesn't need the level of care and metacognitive effort I wrote about here. * **This framework applies to general-purpose LLMs, not specialized AI.** In narrow domains (e.g., medical imaging, chess), specialized AI systems trained on domain-specific datasets already match or exceed human expert pattern recognition. The delegation assignments—particularly Auto-Convergent as purely human—may not hold for those systems. * **I'm not claiming that this framework covers all forms of thought.** I think the three axes I adopted—the Tripartite Mind, Convergent-Divergent thought, and Object vs Meta—capture the most salient cognitive modalities for the specific question of how to interface well with an LLM. But AAT is silent about other important axes, e.g. social, emotional, embodied. I would be very interested to see an analysis of those in the same way. * **The glutamate fatigue mechanism should be held lightly.** While the Wiehler et al. 22 finding remains widely cited, the specific claim that glutamate is the causal agent of cognitive fatigue is still debated. At least three candidate metabolites have been proposed 23, and the observed effect may serve a signaling purpose rather than reflect toxic buildup 83. The AAT framework relies on the robust practical consequence (sustained cognitive control degrades decision quality), not on any single metabolic mechanism. * **The DMN-ECN account of creativity is contested.** The framework's escalating fatigue curve for divergent thinking rests partly on the DMN-ECN (Default Mode Network - Executive Control Network) switching model 28, which has been challenged on methodological and interpretive grounds 84. The practical observation—divergent thinking gets harder within a session—seems to hold regardless. * **Note on algorithmic fatigue variability.** The "medium, then high" rating for algorithmic categories assumes novel procedures with high element interactivity—multiple interdependent elements held in working memory simultaneously 3132. Practiced algorithmic work with low element interactivity (e.g., routine algebra and old-school assembly line work) lets you internalize the patterns and execute them as near-autonomous steps 85 requiring minimal prefrontal engagement per step. Such work is _slow_ but not _prefrontally fatiguing_. This distinction matters for the time savings argument: the algorithmic work LLMs replace most dramatically is often precisely this low-intensity kind, meaning the "metabolic breaks" it inadvertently provided also disappear. * **LLM capabilities are a moving target.** The delegation assignments reflect 2026-era general-purpose LLMs. As models improve—particularly in meta-reflective ⓘ support (though current LLM metacognition still diverges from human metacognition in important ways 86)—some "Human-only" categories may shift toward "Joint Human&LLM." The framework's structure (the grid itself) should outlast any particular assignment. ## Comments Loading comments... # References ## Footnotes 1. Brynjolfsson, E., Li, D., & Raymond, L. R. (2025). Generative AI at work. _The Quarterly Journal of Economics, 140_(2), 889–942. https://doi.org/10.1093/qje/qjae044. ↩ ↩2 2. Rogelberg, S. (2026). Thousands of CEOs admit AI had no impact on employment or productivity—and it has economists resurrecting a paradox from 40 years ago. _Fortune_. https://fortune.com/article/why-do-thousands-of-ceos-believe-ai-not-having-impact-productivity-employment-study/. ↩ 3. Michalski, J., Winters, S., Gunn, D., Holland, J., (2025). AI ROI: The paradox of rising investment and elusive returns. _Deloitte Research_. https://www.deloitte.com/global/en/issues/generative-ai/ai-roi-the-paradox-of-rising-investment-and-elusive-returns.html. ↩ 4. Faros Research. (2025). The AI Productivity Paradox Report 2025. _Faros_. https://www.faros.ai/blog/ai-software-engineering. ↩ 5. Gruda, D., & Aeon, B. (2025). Seven myths about AI and productivity: What the evidence really says. _California Management Review_ , 68(2). https://cmr.berkeley.edu/2025/10/seven-myths-about-ai-and-productivity-what-the-evidence-really-says/. ↩ ↩2 6. Stadler, M., Bannert, M., & Sailer, M. (2024). Cognitive ease at a cost: LLMs reduce mental effort but compromise depth in student scientific inquiry. _Computers in Human Behavior_ , 160, 108386. https://doi.org/10.1016/j.chb.2024.108386. ↩ 7. Lee, H.-P. (Hank), Sarkar, A., Tankelevitch, L., Drosos, I., Rintel, S., Banks, R., & Wilson, N. (2025). The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers. _Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25)_ , Article 1121, 1–22. https://doi.org/10.1145/3706598.3713778. ↩ ↩2 8. Kosmyna, N., Hauptmann, E., Yuan, Y. T., Situ, J., Liao, X.-H., Beresnitzky, A. V., Braunstein, I., & Maes, P. (2025). Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Task. arXiv:2506.08872. https://arxiv.org/abs/2506.08872. ↩ 9. Kabashkin, I. (2025). Cognitive Atrophy Paradox of AI–Human Interaction: From Cognitive Growth and Atrophy to Balance. _Information_ , 16(11), 1009. https://www.mdpi.com/2078-2489/16/11/1009. ↩ ↩2 10. Mineo, L. (2025). Is AI dulling our minds? _Harvard Gazette_. https://news.harvard.edu/gazette/story/2025/11/is-ai-dulling-our-minds/. ↩ ↩2 11. El Tarhouny, S., & Farghaly, A. (2026). Deskilling Dilemma: Brain Over Automation. _Frontiers in Medicine_. https://www.frontiersin.org/journals/medicine/articles/10.3389/fmed.2026.1765692/full. ↩ ↩2 12. Tankelevitch, L., Kewenig, V., Simkute, A., Scott, A. E., Sarkar, A., Sellen, A., & Rintel, S. (2024). The Metacognitive Demands and Opportunities of Generative AI. _Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems_ , Article 680, 1–24. https://doi.org/10.1145/3613904.3642902. ↩ ↩2 ↩3 13. Stanovich, K. E. (2010). _Rationality and the Reflective Mind_. Oxford University Press. ↩ 14. Nelson, T. O., & Narens, L. (1990). Metamemory: A theoretical framework and new findings. _Psychology of Learning and Motivation_ , 26, 125–173. ↩ 15. Guilford, J. P. (1967). _The Nature of Human Intelligence_. McGraw-Hill. ↩ 16. Lawson, B. (2005). _How Designers Think_ (4th ed.). Architectural Press. ↩ 17. Cross, N. (2011). _Design Thinking: Understanding How Designers Think and Work_. Berg. ↩ 18. Bartoli, E., et al. (2024). Default mode network electrophysiological dynamics and causal role in creative thinking. _Brain_ , 147(10), 3409–3425. https://doi.org/10.1093/brain/awae199. ↩ 19. Lopez-Lopez, E., Abels, C. M., Lorenz-Spreen, P., Lewandowsky, S., & Herzog, S. M. (2026). Boosting metacognition in entangled human-AI interaction to navigate cognitive-behavioral drift. arXiv:2602.01959. https://arxiv.org/abs/2602.01959. ↩ ↩2 20. Simon, H. A. (1969). _The Sciences of the Artificial_. MIT Press. ↩ 21. Wikipedia (2026). Cognitive miser. https://en.wikipedia.org/wiki/Cognitive_miser. ↩ ↩2 22. Wiehler, A., Branzoli, F., Adanyeguh, I., Mochel, F., & Pessiglione, M. (2022). A neuro-metabolic account of why daylong cognitive work alters the control of economic decisions. _Current Biology_ , 32(16), 3564–3575. https://doi.org/10.1016/j.cub.2022.07.010. ↩ ↩2 ↩3 23. André, N., et al. (2025). Brain Endurance Training as a Strategy for Reducing Mental Fatigue. _Frontiers in Psychology_. https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2025.1616171/full. ↩ ↩2 24. Steward, G., et al. (2025). The Neurobiology of Cognitive Fatigue and Its Influence on Effort-Based Choice. _Journal of Neuroscience_. https://www.jneurosci.org/content/jneuro/early/2025/05/08/JNEUROSCI.1612-24.2025.full.pdf. ↩ ↩2 25. Xu, X., et al. (2014). Failure to replicate depletion of self-control. _PLOS ONE_ , 9(10), e109950. https://doi.org/10.1371/journal.pone.0109950. ↩ 26. Weber, S., et al. (2022). Involvement of the default mode network under varying levels of cognitive effort. _Scientific Reports_ , 12, 6303. https://doi.org/10.1038/s41598-022-10289-7. ↩ 27. Buckner, R. L., Andrews-Hanna, J. R., & Schacter, D. L. (2008). The brain's default network: Anatomy, function, and relevance to disease. _Annals of the New York Academy of Sciences_ , 1124(1), 1–38. https://doi.org/10.1196/annals.1440.011. ↩ 28. Chen, Q., et al. (2025). Dynamic switching between brain networks predicts creative ability. _Communications Biology_ , 8, 54. https://doi.org/10.1038/s42003-025-07470-9. ↩ ↩2 29. Petruo, V. A., et al. (2018). On the role of the prefrontal cortex in fatigue effects on cognitive flexibility — a system neurophysiological approach. _Scientific Reports_ , 8, 6395. https://doi.org/10.1038/s41598-018-24834-w. ↩ 30. Beaty, R. E., et al. (2015). Default and executive network coupling supports creative idea production. _Scientific Reports_ , 5, 10964. https://www.nature.com/articles/srep10964. ↩ 31. Sweller, J. (1994). Cognitive load theory, learning difficulty, and instructional design. _Learning and Instruction_ , 4(4) https://doi.org/10.1016/0959-4752(94)90003-5. ↩ ↩2 32. Sweller, J. (2010). Element Interactivity and Intrinsic, Extraneous, and Germane Cognitive Load. _Educational Psychology Review_ , 22, 123-138 https://doi.org/10.1007/s10648-010-9128-5. ↩ ↩2 33. Fleming, S. M., Huijgen, J., & Dolan, R. J. (2012). Prefrontal contributions to metacognition in perceptual decision making. _The Journal of neuroscience : the official journal of the Society for Neuroscience_ , _32_(18), 6117–6125. https://doi.org/10.1523/JNEUROSCI.6489-11.2012. ↩ 34. Balconi, M., Acconito, C., Allegretta, R. A., & Crivelli, D. (2023). What Is the Relationship between Metacognition and Mental Effort in Executive Functions? The Contribution of Neurophysiology. _Behavioral sciences (Basel, Switzerland)_ , _13_(11), 918. https://doi.org/10.3390/bs13110918. ↩ 35. Microsoft Research. (2025). The future of AI in knowledge work: Tools for thought at CHI 2025. https://www.microsoft.com/en-us/research/blog/the-future-of-ai-in-knowledge-work-tools-for-thought-at-chi-2025/. ↩ 36. Papadopetraki, D., et al. (2025). Shielding working memory from distraction is more effortful than flexible updating. _Scientific Reports_ , 15, 13512. https://doi.org/10.1038/s41598-025-96980-x. ↩ 37. Petrusic, W. M., & Baranski, J. V. (2003). Judging confidence influences decision processing in comparative judgments. _Psychonomic bulletin & review_, _10_(1), 177–183. https://doi.org/10.3758/bf03196482. ↩ 38. Jordano, M. L., & Touron, D. R. (2018). How often are thoughts metacognitive? Findings from research on self-regulated learning, think-aloud protocols, and mind-wandering. _Psychon Bull Rev_ , _25_ , 1269–1286. https://doi.org/10.3758/s13423-018-1490-1. ↩ 39. Fukumura, K., & Ito, T. (2025). Can LLM-Powered Multi-Agent Systems Augment Human Creativity? Evidence from Brainstorming Tasks. https://dl.acm.org/doi/10.1145/3715928.3737479. ↩ 40. Osmani, A. (Substack, 2026). Code review in the age of AI. https://addyo.substack.com/p/code-review-in-the-age-of-ai. ↩ 41. Huang, J., Chen, X., Mishra, S., Zheng, H. S., Yu, A. W., Song, X., & Zhou, D. (2024). Large Language Models Cannot Self-Correct Reasoning Yet. _Proceedings of the International Conference on Learning Representations (ICLR 2024)_. https://arxiv.org/abs/2310.01798. ↩ ↩2 42. Madaan, A., Tandon, N., Gupta, P., et al. (2023). Self-Refine: Iterative Refinement with Self-Feedback. _Advances in Neural Information Processing Systems 36 (NeurIPS 2023)_. https://arxiv.org/abs/2303.17651. ↩ ↩2 43. De Freitas, J., et al. (2025). Research: When used correctly, LLMs can unlock more creative ideas. _Harvard Business Review_. https://hbr.org/2025/12/research-when-used-correctly-llms-can-unlock-more-creative-ideas. ↩ 44. Doshi, A. R., & Hauser, O. P. (2024). Generative AI enhances individual creativity but reduces the collective diversity of novel content. _Science Advances_ , 10(28). https://www.science.org/doi/10.1126/sciadv.adn5290. ↩ 45. Sourati, Z., Ziabari, A. S., & Dehghani, M. (2026). The homogenizing effect of large language models on human expression and thought. _Trends in Cognitive Sciences_. https://doi.org/10.1016/j.tics.2026.01.003. ↩ 46. Qin, P., et al. (2025). Timing Matters: How Using LLMs at Different Timings Influences Writers' Perceptions and Ideation Outcomes in AI-Assisted Ideation. https://dl.acm.org/doi/10.1145/3706598.3713146. ↩ 47. Shin, J., et al. (2025). No Evidence for LLMs Being Useful in Problem Reframing (CHI '25). Association for Computing Machinery, New York, NY, USA, Article 243, 1–25. https://doi.org/10.1145/3706598.3713273. ↩ ↩2 48. Holstein, J., Diener, M., & Spitzer, P. (2025). From Consumption to Collaboration: Measuring Interaction Patterns to Augment Human Cognition in Open-Ended Tasks. arXiv:2504.02780. https://arxiv.org/abs/2504.02780. ↩ 49. Barcaui, A. (2025). ChatGPT as a cognitive crutch: Evidence from a randomized controlled trial on knowledge retention. _Social Sciences & Humanities Open_, 12, 102287. https://doi.org/10.1016/j.ssaho.2025.102287. ↩ 50. Lane, J. N., et al. (2025). The Narrative AI Advantage? A Field Experiment on AI-Augmented Evaluations of Early-Stage Innovations. _Harvard Business School Working Paper_ , 25-001. https://www.hbs.edu/ris/Publication%20Files/25-001_8ebbe0cb-2a19-453c-9014-1e301e8dd2fb.pdf. ↩ ↩2 ↩3 51. Kahana, E. (2026). Built by agents, tested by agents, trusted by whom? _Stanford CodeX_. https://law.stanford.edu/2026/02/08/built-by-agents-tested-by-agents-trusted-by-whom/. ↩ 52. Garg, R. (2026). Design-first collaboration: Reducing friction with AI. _Thoughtworks / martinfowler.com_. https://martinfowler.com/articles/reduce-friction-ai/design-first-collaboration.html. ↩ 53. Osmani, A. (2026). My LLM coding workflow going into 2026. https://addyosmani.com/blog/ai-coding-workflow/. ↩ 54. Willison, S. (n.d.). AI-assisted programming posts. _simonwillison.net_. https://simonwillison.net/tags/ai-assisted-programming/. ↩ 55. Sun, W., & Liu, J. (2025). The Impact of Human-AI Interaction Patterns on Problem Solving, AI Literacy, and Metacognition. _Proceedings of the 6th International Conference on AI Research (ICAIR 2025)_ , 6(1). https://doi.org/10.34190/icair.5.1.4276. ↩ 56. Lewis, P. A., Birch, A., Hall, A., & Dunbar, R. I. M. (2017). Higher order intentionality tasks are cognitively more demanding. _Social Cognitive and Affective Neuroscience_ , 12(7), 1063–1071. https://doi.org/10.1093/scan/nsx034. ↩ 57. Becker, S., Rush, J., et al. (METR). (2025). Measuring the impact of early-2025 AI on experienced open-source developer productivity. arXiv:2507.09089. https://arxiv.org/abs/2507.09089. ↩ ↩2 58. Asay, M. (2025). AI's trust tax for developers. _InfoWorld_. https://www.infoworld.com/article/4111829/ais-trust-tax-for-developers.html. ↩ 59. Bick, A., et al. (2025). The Impact of Generative AI on Work Productivity. Federal Reserve Bank of St. Louis. https://www.stlouisfed.org/on-the-economy/2025/feb/impact-generative-ai-work-productivity. ↩ 60. Jiang, W., et al. (2025). As AI's power grows, so does our workday. _CEPR VoxEU_. https://cepr.org/voxeu/columns/ais-power-grows-so-does-our-workday. ↩ 61. Ranganathan, A., & Ye, X. M. (2026). AI doesn't reduce work — it intensifies it. _Harvard Business Review_. https://hbr.org/2026/02/ai-doesnt-reduce-work-it-intensifies-it. ↩ ↩2 ↩3 62. Menlo Ventures. (2025). 2025: The State of Generative AI in the Enterprise. https://menlovc.com/perspective/2025-the-state-of-generative-ai-in-the-enterprise/. ↩ 63. Anthropic. (2026). Anthropic Economic Index report: Economic primitives. https://www.anthropic.com/research/anthropic-economic-index-january-2026-report. ↩ 64. Shalu, V. N., et al. (2025). The Cognitive Cost of AI: How AI Anxiety and Attitudes Influence Decision Fatigue in Daily Technology Use. _Ann Neurosci._ https://doi.org/10.1177/09727531251359872 ↩ 65. Gerlich, M. (2025). From Offloading to Engagement: An Experimental Study on Structured Prompting and Critical Reasoning with Generative AI. _Data_ , 10(11), 172. https://doi.org/10.3390/data10110172. ↩ 66. Bedard, J., Kropp, M., Hsu, M., Karaman, O. T., Hawes, J., & Rosen Kellerman, G. (2026). When Using AI Leads to "Brain Fry." _Harvard Business Review_. https://hbr.org/2026/03/when-using-ai-leads-to-brain-fry. ↩ 67. Hermann, E., Puntoni, S., & Morewedge, C. K. (2026). Why Gen AI Feels So Threatening to Workers. _Harvard Business Review_. https://hbr.org/2026/03/why-gen-ai-feels-so-threatening-to-workers. ↩ 68. Khan, S. M. F. A., & Suhluli, S. (2025). Generative AI and Cognitive Challenges in Research: Balancing Cognitive Load, Fatigue, and Human Resilience. _Technologies_ , 13(11), 486. https://www.mdpi.com/2227-7080/13/11/486. ↩ 69. Gobet, F., & Simon, H. A. (1998). Expert chess memory: Revisiting the chunking hypothesis. _Memory_ , _6_(3), 225–255. https://doi.org/10.1080/741942359. ↩ 70. Dreyfus, S. E. (2004). The five-stage model of adult skill acquisition. _Bulletin of Science, Technology & Society_, _24_(3), 177–181. https://doi.org/10.1177/0270467604264992. ↩ 71. Chase, W. G., & Simon, H. A. (1973). Perception in chess. _Cognitive Psychology_ , _4_(1), 55–81. https://doi.org/10.1016/0010-0285(73)90004-2. ↩ 72. Glenberg, A. M., & Epstein, W. (1987). Inexpert calibration of comprehension. _Memory & Cognition_, _15_(1), 84–93. https://doi.org/10.3758/BF03197714. ↩ 73. Oskamp, S. (1965). Overconfidence in case-study judgments. _Journal of Consulting Psychology_ , 29(3), 261–265. https://doi.org/10.1037/h0022125. ↩ 74. McKenzie, C. R. M., Liersch, M. J., & Yaniv, I. (2008). Overconfidence in interval estimates: What does expertise buy you? _Organizational Behavior and Human Decision Processes_ , 107(2), 179–191. https://doi.org/10.1016/j.obhdp.2008.02.003. ↩ 75. Dane, E. (2010). Reconsidering the trade-off between expertise and flexibility: A cognitive entrenchment perspective. _Academy of Management Review_ , _35_(4), 579–603. https://doi.org/10.5465/amr.35.4.zok579. ↩ 76. Bilalić, M., McLeod, P., & Gobet, F. (2008). Why good thoughts block better ones: The mechanism of the pernicious Einstellung (set) effect. _Cognition_ , _108_(3), 652–661. https://doi.org/10.1016/j.cognition.2008.05.005. ↩ 77. Englich, B., Mussweiler, T., & Strack, F. (2006). Playing dice with criminal sentences: The influence of irrelevant anchors on experts' judicial decision making. _Personality and Social Psychology Bulletin_ , _32_(2), 188–200. https://doi.org/10.1177/0146167205282152. ↩ 78. Liu, G., Christian, B., Dumbalska, T., Bakker, M. A., & Dubey, R. (2026). AI Assistance Reduces Persistence and Hurts Independent Performance. arXiv:2604.04721. https://arxiv.org/abs/2604.04721. ↩ 79. Ferdman, A. (2025). AI deskilling is a structural problem. _AI & Society_, 41(4). https://doi.org/10.1007/s00146-025-02686-z. ↩ 80. Noy, S., & Zhang, W. (2023). Experimental evidence on the productivity effects of generative artificial intelligence. _Science_ , _381_(6654), 187–192. https://doi.org/10.1126/science.adh2586. ↩ 81. Dell'Acqua, F., McFowland, E., III, Mollick, E., Lifshitz-Assaf, H., Kellogg, K. C., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R. (2023). Navigating the jagged technological frontier: Field experimental evidence of the effects of AI on knowledge worker productivity and quality. _Harvard Business School Working Paper_ 24-013. https://www.hbs.edu/faculty/Pages/item.aspx?num=64700. ↩ 82. Duncan, D. S. (2026). How do workers develop good judgment in the AI era? _Harvard Business Review_. https://hbr.org/2026/02/how-do-workers-develop-good-judgment-in-the-ai-era. ↩ 83. Underwood, E. (2022). Mentally exhausted? Study blames buildup of key chemical in brain. _Science_ , https://doi.org/10.1126/science.ade3733. ↩ 84. Abraham, A. (2025). Occam's Razor Misapplied: Pinpointing the Role of the Default Mode Network in Creativity. _Current Opinion in Behavioral Sciences_. https://www.sciencedirect.com/science/article/abs/pii/S2352154625001032. ↩ 85. Anderson, J. R. (1982). Acquisition of cognitive skill. _Psychological Review, 89_(4), 369–406. https://doi.org/10.1037/0033-295X.89.4.369. ↩ 86. Steyvers, M., & Peters, M. A. K. (2025). Metacognition and Uncertainty Communication in Humans and Large Language Models. _Current Directions in Psychological Science_ , 0(0). https://journals.sagepub.com/doi/10.1177/09637214251391158. ↩ Cover image: _Modified from Diehl's Anatomy for artists and students Pl.3, Conrad Diehl_
100 1
Marco Giancotti @marcogiancotti.mastodon.social.ap.brid.gy · 23/06/2026
So before judging whether AI "works" for you, ask which quadrant you're in, and what would move you closer to the green one. Be ready to embrace the mental fatigue, delegate appropriately based on the mode, level, and phase of thought, and calibrate your expectations.
100 1