Sign in

Taku Ito

@takuito.bsky.social
621 followers 566 following 5 posts

Research scientist in neural networks @ IBM Research | 📍NYC | ito-takuya.github.io

PostsRepliesMedia
Reposted by Taku Ito
Melanie Mitchell @melaniemitchell.bsky.social · 10/09/2026
I wrote down my thoughts about the last several weeks of AI hell. aiguide.substack.com/p/misleading...
aiguide.substack.com
Misleading Metaphors, Real Risks
What To Fear from AI Agents and How to Reclaim Our Human Agency
1019881
Reposted by Taku Ito
Christian Wolf @chriswolfvision.bsky.social · 23/06/2026
For your Embodied AI task you want a recurrent model with constant complexity per step, but you don't want to lose the power of transformers (which store the full obs history and attend to it)? Do not despair, we have your back. We distill transformers into recurrent transformers 1/8
23410
Reposted by Taku Ito
Gouki Okazawa @handle.invalid · 31/05/2026
New review with Cheng Xue at U Chicago @cxue.bsky.social in Trends Neurosci@cp-trendsneuro.bsky.social! We discuss the neural geometry of task-dependent computation: disentangled encoding, RNN modeling, switch cost, etc. www.cell.com/trends/neuro...
cell.com
The ‘neat’ and ‘messy’ in task-dependent neural geometry and computation
To solve diverse real-world tasks, the brain must flexibly switch between task rules and adjust computations. Recent advances in analyzing neural data and modeling neural networks have revealed their ...
06318
Reposted by Taku Ito
Fenner Tanswell @fennert.bsky.social · 22/04/2026
A long read about the state of AI and mathematics. davidbessis.substack.com/p/the-fall-o...
davidbessis.substack.com
The fall of the theorem economy
How AI could destroy mathematics and barely touch it
1126
Reposted by Taku Ito
John Tuthill @tuthill.bsky.social · 24/03/2026
🧵 New preprint led by @bingbrunton.bsky.social, @elliottabe.bsky.social, @lawrencehu.bsky.social We gave a worm brain control of a fly body and it walked What did we learn? Nothing, other than deep reinforcement learning is effective We call it the digital sphinx www.biorxiv.org/content/10.6...
10412151
Reposted by Taku Ito
Eugene Vinitsky 🍒 @eugenevinitsky.bsky.social · 11/03/2026
www.percepta.ai/blog/can-llm... As a research lark at Percepta, Christos embedded a computer into an LLM, showed that it could solve the hardest Sudokus, and then as a side bonus built an exponentially faster attention
2131359
Reposted by Taku Ito
mr. TIM @timkellogg.me · 02/03/2026
Bullshit Bench V2 new: 100 questions across several domains - Anthropic & Qwen still on top - Reasoning seems to hurt - New models are *not* better than old (except Claude) - Seems to be independent of domain github.com/petergpt/bul...
Bar chart titled ‘BullshitBench v2: Detection Rate by Model’ showing 72 AI models ranked by their ability to detect nonsense questions. Each horizontal bar is split into three color-coded segments: green (Clear Pushback), amber (Partial Challenge), and red (Accepted Nonsense). Claude Sonnet 4.6 (High) ranks #1 with 91% clear pushback, followed by Claude Opus 4.5 (High) at 90% and Claude Sonnet 4.6 at 89%. Anthropic’s Claude models dominate the top 11 positions. The overall averages across all models are Green 32.6%, Amber 21.8%, and Red 45.6%. Models from OpenAI, Google, ByteDance, DeepSeek, MiniMax, Moonshot AI, Prime Intellect, Qwen, xAI, Xiaomi, Z.AI, Baidu, and Mistral are also represented. Lower-ranked models like Gemma 3 27b IT (#70), GPT-4o Mini 2024 07 18 (#71), and Mistral Large 2512 (#72) accepted nonsense in 85–88% of cases.“​​​​​​​​​​​​​​​
910510
Reposted by Taku Ito
Eris @isolyth.dev · 27/02/2026
Sakana has developed a way to, if I understand correctly, instantly generate LORAs on demand from long texts or documents arxiv.org/abs/2506.06105 arxiv.org/abs/2602.15902
arxiv.org
Text-to-LoRA: Instant Transformer Adaption
While Foundation Models provide a general tool for rapid content creation, they regularly require task-specific adaptation. Traditionally, this exercise involves careful curation of datasets and repea...
3546
Reposted by Taku Ito
Max Kozlov @maxkozlov.bsky.social · 20/01/2026
Trump has been in office for one year. We at @nature.com did a deep dive looking at the administration's disruption of science in numbers. Take a look—the numbers are staggering. By me, @dangaristo.bsky.social, Jeff Tollefson, @kimay.bsky.social, & help from @noamross.net @scott-delaney.bsky.social
nature.com
US science after a year of Trump: what has been lost and what remains
A series of graphics reveals how the Trump administration has sought historic cuts to science and the research workforce.
10503315
Reposted by Taku Ito
David Ho @davidho.bsky.social · 20/01/2026
This is the most astonishing graph of what the Trump regime has done to US science. They have destroyed the federal science workforce across the board. The negative impacts on Americans will be felt for generations, and the US might never be the same again. www.nature.com/immersive/d4...
This line graph illustrates the percentage change in agency staff levels from the previous year for nine major U.S. federal scientific and health organizations between the fiscal years 2016 and 2025. The agencies tracked include the CDC, Department of Energy, EPA, FDA, NASA, NIH, NIST, NOAA, and NSF. For the majority of the timeline between 2016 and 2023, the agencies show relatively stable fluctuations, generally staying within a range of +5% to -5% change per year. However, there is a dramatic and uniform plummet starting in the 2024–25 period. Every agency depicted shows a sharp downward trajectory, with staffing losses ranging from approximately -15% to over -25%. The Environmental Protection Agency (EPA) shows the most significant decline, dropping to roughly -26%, while the National Institute of Standards and Technology (NIST) shows the least severe but still substantial drop at approximately -15%.
91147828503
Reposted by Taku Ito
hardmaru @hardmaru.bsky.social · 12/01/2026
One of my favorite findings: Positional embeddings are just training wheels. They help convergence but hurt long-context generalization. We found that if you simply delete them after pretraining and recalibrate for <1% of the original budget, you unlock massive context windows. Smarter, not harder.
821732
Reposted by Taku Ito
Eugene Vinitsky 🍒 @eugenevinitsky.bsky.social · 12/01/2026
Oh wow, deepseek is starting to make serious progress on LLMs that offload memory to external storage: github.com/deepseek-ai/...
github.com
622026
Reposted by Taku Ito
Ravi Mill @ravimill.bsky.social · 19/11/2025
Excited to see our paper with @mwcole.bsky.social finally out in peer-reviewed form @natcomms.nature.com! We examine how the human brain learns new tasks and optimizes representations over practice…1/n
Schematic depicting cortical-subcortical interactions during multi-task learning
1257
Reposted by Taku Ito
Mary Elizabeth Sutherland @meharpist.bsky.social · 24/10/2025
Did you know that AI can figure out its own way to learn, and that its way is better than one designed by humans? Read more in a @nature.com N&V (and the original paper is in the comment) 🧪 www.nature.com/articles/d41...
nature.com
AI discovers learning algorithm that outperforms those designed by humans
An artificial-intelligence algorithm that discovers its own way to learn achieves state-of-the-art performance, including on some tasks it had never encountered before.
262
Reposted by Taku Ito
Tatiana Engel @engeltatiana.bsky.social · 24/10/2025
Our work with @pawa-pawa.bsky.social is out in Nature Machine Intelligence! The choice of activation function affects the representations, dynamics, and circuit solutions that emerge in RNNs trained on cognitive tasks. Activation matters! www.nature.com/articles/s42...
nature.com
Single-unit activations confer inductive biases for emergent circuit solutions to cognitive tasks - Nature Machine Intelligence
Recurrent neural networks are widely used to model brain dynamics. Tolmachev and Engel show that single-unit activation functions influence task solutions that emerge in trained networks, raising the ...
04211
Reposted by Taku Ito
Ramon Astudillo @ramon-astudillo.bsky.social · 07/10/2025
(repost welcome) The Generative Model Alignment team at IBM Research is looking for next summer interns! Two candidates for two topics 🍰Reinforcement Learning environments for LLMs 🐎Speculative and non-auto regressive generation for LLMs interested/curious? DM or email ramon.astudillo@ibm.com
11914
Reposted by Taku Ito
PessoaBrain @pessoabrain.bsky.social · 06/10/2025
Michael X Cohen on why he left academia/neuroscience. mikexcohen.substack.com/p/why-i-left...
mikexcohen.substack.com
Why I left academia and neuroscience
Don't worry, this isn't yet another story of rage-quitting.
79636
Reposted by Taku Ito
Nature @nature.com · 26/09/2025
Nature research paper: Arousal as a universal embedding for spatiotemporal brain dynamics go.nature.com/4nMUgYz
go.nature.com
Arousal as a universal embedding for spatiotemporal brain dynamics - Nature
Reframing of arousal as a latent dynamical system can reconstruct multidimensional measurements of large-scale spatiotemporal brain dynamics on the timescale of seconds in mice.
03112
Reposted by Taku Ito
Michael W. Cole @mwcole.bsky.social · 14/09/2025
Lab’s latest is out in Imaging Neuroscience, led by Kirsten Peterson: “Regularized partial correlation provides reliable functional connectivity estimates while correcting for widespread confounding”, where we demonstrate a major improvement to standard fMRI functional connectivity (correlation) 1/n
67429
Taku Ito @takuito.bsky.social · 19/08/2025
What complexity of algorithms can AI compute? In a new paper with colleagues at IBM Research, we explore how circuit complexity theory can help quantify the degree of algorithmic generalization in AI systems. www.nature.com/articles/s42... @natmachintell.nature.com #ML #AI #MLSky 1/n
1175
Reposted by Taku Ito
milhammichael.bsky.social @milhammichael.bsky.social · 07/03/2025
Mental health research is at a turning point—breakthroughs can transform lives, but only with bold action, investment, and open collaboration. The time for action is now. Read our full statement here: childmind.org/blog/can-sci...
0147
Reposted by Taku Ito
Guy Davidson ✈️ NeurIPS 2025 @guydav.bsky.social · 21/02/2025
Out today in Nature Machine Intelligence! From childhood on, people can create novel, playful, and creative goals. Models have yet to capture this ability. We propose a new way to represent goals and report a model that can generate human-like goals in a playful setting... 1/N
513541
Reposted by Taku Ito
Naoki Hiratani @nhiratani.bsky.social · 06/02/2025
New preprint! Ziyan and I explore how task order impacts continual learning in neural networks and how to optimize it. Our analysis highlights two key principles for better task sequencing. Check it out: arxiv.org/pdf/2502.03350
arxiv.org
073
Reposted by Taku Ito
Dr. Becca @docbecca.bsky.social · 31/01/2025
The entire website for the NIH Office of Research on Women's Health (ORWH) is very nearly stripped bare. This is so, so devastating. orwh.od.nih.gov/research/fun...
orwh.od.nih.gov
43973615
Reposted by Taku Ito
Julien Corbo @juliencorbo.bsky.social · 08/01/2025
New paper out! 🚨 📰 With @batuhanerkat.bsky.social, John McClure, @hussainyk1.bsky.social, @polacklab.bsky.social we reveal how discretized representations in V1 predict suboptimal orientation discrimination. 🧪🧠🐭 This work reconciles neuro and psychometric curves www.nature.com/articles/s41...
nature.com
Discretized representations in V1 predict suboptimal orientation discrimination - Nature Communications
How animals generate perceptual decisions remains poorly understood. Here, the authors show that during a discrimination task, the mouse visual cortex does not encode the orientations of the cues but ...
3268
Reposted by Taku Ito
Veith Weilnhammer, MD @veithweilnhammer.bsky.social · 19/01/2025
New paper in @brain1878.bsky.social: Healthy people under S-ketamine, an NMDAR antagonist, and people living with schizophrenia, a disorder associated with NMDAR hypofunction, spend more time in an external mode of perception - where noisy sensory signals override knowledge about the world.
1268
Reposted by Taku Ito
Joey Saito @jsaito25.bsky.social · 16/01/2025
The origin of color categories | PNAS www.pnas.org/doi/10.1073/...
pnas.org
The origin of color categories | PNAS
To what extent does concept formation require language? Here, we exploit color to address this question and ask whether macaque monkeys have color ...
25113
Reposted by Taku Ito
Joao Barbosa @jbarbosa.org · 12/01/2025
Check our latest in which we leverage shape metrics to compare neural geometry across regions, sessions or subjects and how their differences predict behavior. w/ Nejatbakhsh, Duong, @sarah-harvey.bsky.social, Brincat, @siegellab.bsky.social, @earlkmiller.bsky.social & @itsneuronal.bsky.social
310337
Reposted by Taku Ito
Ethan Mollick @emollick.bsky.social · 11/01/2025
Paper shows very small LLMs can match or beat larger ones through 'deep thinking' - evaluating different solution paths - and other tricks. Their 7B model beats o1-preview on complex math by exploring 64 different solutions & picking the best one. Test-time compute paradigm seems really fruitful.
315720
Reposted by Taku Ito
Marlene Cohen @marlenecohen.bsky.social · 04/01/2025
New results for a new year! “Linking neural population formatting to function” describes our modern take on an old question: how can we understand the contribution of a brain area to behavior? www.biorxiv.org/content/10.1... 🧠👩🏻‍🔬🧪🧵 #neuroskyence 1/
biorxiv.org
Linking neural population formatting to function
Animals capable of complex behaviors tend to have more distinct brain areas than simpler organisms, and artificial networks that perform many tasks tend to self-organize into modules (1-3). This sugge...
223382
Reposted by Taku Ito
Blake Richards @tyrellturing.bsky.social · 03/01/2025
And relatedly, Felix wrote a good piece on the stress and anxiety currently affecting many people who work in AI due to the current climate in the industry: docs.google.com/document/d/1... If only more folks in AI were gentle and introspective like this...
docs.google.com
AI and Stress
200Bn Weights of Responsibility The Stress of Working in Modern AI Felix Hill, Oct 2024 The field of AI has changed irrevocably in the last 2 years. ChatGPT is approaching 200m monthly users. Gemin...
0175
Reposted by Taku Ito
David Bau @davidbau.bsky.social · 31/12/2024
What was the most important machine learning paper in 2024? My Famous Deep Learning Papers list (that I use in teaching) does not include any new ideas from the last year. papers.baulab.info Which single new paper would you add?
105511
Reposted by Taku Ito
Melanie Mitchell @melaniemitchell.bsky.social · 23/12/2024
Some of my thoughts on OpenAI's o3 and the ARC-AGI benchmark aiguide.substack.com/p/did-openai...
aiguide.substack.com
Did OpenAI Just Solve Abstract Reasoning?
OpenAI’s o3 model aces the "Abstraction and Reasoning Corpus" — but what does it mean?
1634099
Reposted by Taku Ito
Xiaoxuan @xiaoxuanlei.bsky.social · 12/12/2024
📌 Poster Session: ⏰ When: TODAY, Thu, Dec 12, 4:30 p.m. – 7:30 p.m. PST 📍 Where: East Exhibit Hall A-C, #3705 📄 What: Geometry of Naturalistic Object Representations in Recurrent Neural Network Models of Working Memory Hope to see you there! @bashivan.bsky.social @takuito.bsky.social
031
Reposted by Taku Ito
Jean-Rémi King @jeanremiking.bsky.social · 12/12/2024
🚨We're very excited to share our latest study, by Pablo Diego and team: "A polar coordinate system represents syntax in large language models", 📄: Paper arxiv.org/abs/2412.05571 🪧: Poster tomorrow: neurips.cc/virtual/2024... 🧵: Thread 👇
25817
Reposted by Taku Ito
Adeel Razi @adeelrazi.bsky.social · 11/12/2024
Just published🔈 "Structurally informed models of directed brain connectivity" Read: rdcu.be/d3dC4 We review how structural connectivity constrains directed connectivity models 🧠 Lead by @matthewdgreaves.bsky.social w/ @novelli-leo.bsky.social, @sinamansourl.bsky.social and Andrew Zalesky
13714
Reposted by Taku Ito
Rick Betzel @richardfbetzel.bsky.social · 03/12/2024
hey -- i'm hiring a postdoc! the ad will be up shortly, but looking for someone with network neuroscience experience (very broadly). the position isn't tied to any specific project/grant, so lots of flexibility in terms of what you'd actually *do*. hmu if you might be interested/want to learn more!
15249
Reposted by Taku Ito
Michael W. Cole @mwcole.bsky.social · 03/12/2024
“Cognitive flexibility as the shifting of brain network flows by flexible neural representations”, a solo paper by yours truly, making the case that brain activity flow shifts are essential to mental flexibility (and quite interesting too!) Open access: www.sciencedirect.com/science/arti...
210226
Taku Ito @takuito.bsky.social · 28/11/2024
Our new NeurIPS paper on naturalistic representations in dynamic WM models, led by @xiaoxuanlei.bsky.social and @bashivan.bsky.social Thread by Xiaoxuan 👇
183
Reposted by Taku Ito
CLaE @claeneuro.bsky.social · 24/11/2024
JAMA Psychiatry A Dynamical Systems View of Psychiatric Disorders—Theory A Review jamanetwork.com/journals/jam...
jamanetwork.com
A Dynamical Systems View of Psychiatric Disorders—Theory
This narrative review describes a new approach to the diagnosis and treatment of psychiatric disorders that is based on dynamical systems theory, which addresses the concepts of tipping points, cycles...
32810
Reposted by Taku Ito
Michael W. Cole @mwcole.bsky.social · 05/11/2024
Lab’s latest at PLOS Comp Biol, led by Carrisa Cocuzza: “Distributed network flows generate localized category selectivity in human visual cortex”. This one changed how I think the brain works! Even "localized" functions are likely generated by distributed processes doi.org/10.1371/jour...
doi.org
Distributed network flows generate localized category selectivity in human visual cortex
Author summary A fundamental question in neuroscience has persisted for over a century: to what extent do distributed processes drive brain function? The existence of category-selective regions within...
01711
Reposted by Taku Ito
bioRxiv Neuroscience @biorxiv-neursci.bsky.social · 15/09/2024
Practice Reshapes the Geometry and Dynamics of Task-tailored Representations www.biorxiv.org/content/10.1101/202…
biorxiv.org
Practice Reshapes the Geometry and Dynamics of Task-tailored Representations https://www.biorxiv.org/content/10.1101/2024.09.12.612718v1
Extensive practice makes task performance more efficient and precise, leading to automaticity. Howev
011
Reposted by Taku Ito
Kohitij Kar @kohitij.bsky.social · 12/12/2023
This new article perfectly concludes my time & lessons in Jim’s lab.@JamesJDiCarlo and I propose +review SMART models of object recognition ✅ Sensory computable ✅ Mechanistic ✅ Anatomically Referenced ✅ Testable Coming in Annual Reviews 2024 Preprint: bit.ly/3tk7u8D
073
Reposted by Taku Ito
hakwan lau @hakwan.bsky.social · 26/10/2023
www.nature.com/articles/s41... Lake & Baroni "Fodor and Pylyshyn famously argued that artificial neural networks ... are ... not viable models of the mind.... Here we [show] that neural networks can achieve human-like systematicity when optimized for their compositional skills."
01610
Reposted by Taku Ito
Earl K. Miller @earlkmiller.bsky.social · 28/09/2023
From lazy to rich to exclusive task representations in neural networks and neural codes doi.org/10.1016/j.co... #neuroscience
01611
Reposted by Taku Ito
CLaE @claeneuro.bsky.social · 27/09/2023
NeuroImage Spatially heterogeneous structure-function coupling in haemodynamic and electromagnetic brain networks www.sciencedirect.com/science/arti...
sciencedirect.com
Spatially heterogeneous structure-function coupling in haemodynamic and electromagnetic brain networ...
The relationship between structural and functional connectivity in the brain is a key question in connectomics. Here we quantify patterns of structure…
011
Reposted by Taku Ito
Jeff Johnston @wjj.bsky.social · 26/09/2023
How does the brain represent multiple different things at once in a single population of neurons? @justfineneuro.bsky.social, @benhayden.bsky.social, B Ebitz, M Yoo, and I show that it uses semi-orthogonal subspaces for each item. Preprint here: arxiv.org/abs/2309.07766 Clouds below! (1/n)
arxiv.org
Semi-orthogonal subspaces for value mediate a tradeoff between...
When choosing between options, we must associate their values with the action needed to select them. We hypothesize that the brain solves this binding problem through neural population subspaces....
12812
Reposted by Taku Ito
CLaE @claeneuro.bsky.social · 26/09/2023
Semi-orthogonal subspaces for value mediate a tradeoff between binding and generalization arxiv.org/abs/2309.07766
arxiv.org
Semi-orthogonal subspaces for value mediate a tradeoff between...
When choosing between options, we must associate their values with the action needed to select them. We hypothesize that the brain solves this binding problem through neural population subspaces....
092