Sign in

Marco Cuturi

@marcocuturi.bsky.social
827 followers 58 following 30 posts

machine learning researcher @ Apple machine learning research

PostsRepliesMedia
Reposted by Marco Cuturi
szilviaujvary.bsky.social @szilviaujvary.bsky.social · 13/02/2026
Small Language Models (SLMs) don’t have the capacity to remember everything in their training data. Which tokens should they learn to predict, and when should they ask for help? We tackle this question in our new preprint. You can check it out on arxiv: arxiv.org/abs/2602.12005 🧵1/7
1467
Marco Cuturi @marcocuturi.bsky.social · 06/01/2026
With other folks at 🍏, @brunokm.bsky.social has worked on a complete(d) parameterisation for NNs that can *transfer* locally tuned hyperparameters: tune optimizers' parameters (e.g. LR) *per module/depth* using an evolutionary search on small models → they transfer perf. gains to much larger models
051
Reposted by Marco Cuturi
davidgrangier.bsky.social @davidgrangier.bsky.social · 02/12/2025
I am at #NeurIPS2025. We can chat about data mixing, efficient training, ML@Apple and more.
021
Marco Cuturi @marcocuturi.bsky.social · 01/12/2025
To me, a simple and cheap fix could be an automatic reveal of the names of everyone involved in the review process 5 years after decision. This would be opt-in by authors. Reviewers/AC/SACs would be more careful when writing.
050
Marco Cuturi @marcocuturi.bsky.social · 01/12/2025
I understand it's a challenge to implement this, but when bad actors do not pay a price for cheating, the folks that pay the steepest price end up being the authors who spend endless hours writing rebuttals. I feel AI conferences have prioritized growth over fairness to authors.
120
Marco Cuturi @marcocuturi.bsky.social · 01/12/2025
namely, it's impossible, when PCs see abuse/collusions or very poor quality work (submissions/reviews), to ban momentarily or permanently bad players. So every year/conference is again up for grabs if you're one of those bad actors.
120
Marco Cuturi @marcocuturi.bsky.social · 01/12/2025
my 2 cents on the ICLR drama: It's been years that the system has been under attack. But it's also been years that we hear, year after year, that there is no way to enforce protection mechanisms (e.g. deny lists for dishonest authors or reviewers etc..) for legal reasons.
161
Reposted by Marco Cuturi
sineadwilliamson.bsky.social @sineadwilliamson.bsky.social · 07/11/2025
📢 We’re looking for a researcher in in cogsci, neuroscience, linguistics, or related disciplines to work with us at Apple Machine Learning Research! We're hiring for a one-year interdisciplinary AIML Resident to work on understanding reasoning and decision making in LLMs. 🧵
1105
Marco Cuturi @marcocuturi.bsky.social · 05/11/2025
We also introduce two coupling approaches advocated this summer to improve FM training: using either very large sharp Sinkhorn couplings (arxiv.org/abs/2506.05526) or, even better, semidiscrete couplings (arxiv.org/abs/2509.25519), as proposed with Alireza Mousavi-Hosseini and @syz.bsky.social
arxiv.org
On Fitting Flow Models with Large Sinkhorn Couplings
Flow models transform data gradually from one modality (e.g. noise) onto another (e.g. images). Such models are parameterized by a time-dependent velocity field, trained to fit segments connecting pai...
011
Marco Cuturi @marcocuturi.bsky.social · 05/11/2025
We have been working with Michal Klein on pushing a module to train *flow matching* models using JAX. This is shipped as part of our new release of the OTT-JAX toolbox (github.com/ott-jax/ott) The tutorial to do so is here: ott-jax.readthedocs.io/tutorials/ne...
1147
Reposted by Marco Cuturi
Rocío Mercado Oropeza @rociomer.bsky.social · 29/10/2025
Afternoon talks by: @marcocuturi.bsky.social Elena Agliari Jan Gerken Thanks all for the great talks, conversations, and engagement! Fingers crossed we get to host this event a 4th time next year and see many of you back in Gothenburg 🤞🇸🇪
051
Reposted by Marco Cuturi
Pau Rodriguez @paurodriguez.bsky.social · 21/10/2025
🚀 Excited to share LinEAS, our new activation steering method accepted at NeurIPS 2025! It approximates optimal transport maps e2e to precisely guide 🧭 activations achieving finer control 🎚️ with ✨ less than 32 ✨ prompts! 💻https://github.com/apple/ml-lineas 📄https://arxiv.org/abs/2503.10679
121
Marco Cuturi @marcocuturi.bsky.social · 17/10/2025
It's that time of the year! 🎁 The Apple Machine Learning Research (MLR) team in Paris is hiring a few interns, to do cool research for ±6 months 🚀🚀 & work towards publications/OSS. Check requirements and apply: ➡️ jobs.apple.com/en-us/detail... More❓→ ✉️ mlr_paris_internships@group.apple.com
074
Marco Cuturi @marcocuturi.bsky.social · 09/10/2025
While working on semidiscrete flow matching this summer (➡️ arxiv.org/abs/2509.25519), I kept looking for a video illustrating that the velocity field solving the Benamou-Brenier OT problem is NOT constant w.r.t. time ⏳... so I did it myself, take a look! ott-jax.readthedocs.io/tutorials/th...
0111
Reposted by Marco Cuturi
Michael Kirchhof @mkirchhof.bsky.social · 06/10/2025
LLMs are currently this one big parameter block that stores all sort of facts. In our new preprint, we add context-specific memory parameters to the model, and pretrain the model along with a big bank of memories. 📑 arxiv.org/abs/2510.02375 [1/10]🧵
1134
Reposted by Marco Cuturi
David Picard @davidpicard.eurosky.social · 04/10/2025
Wow! Finally OT done on the entire training set to train a diffusion model!
0123
Marco Cuturi @marcocuturi.bsky.social · 04/10/2025
Then there's always 𝜀 regularization. When 𝜀=∞, we recover vanilla FM. At this point we're not completely sure whether 𝜀=0 is better than 𝜀>0, they both work! 𝜀=0 has a minor edge in larger scales (sparse gradients, faster assignment, slightly better metrics), but 𝜀>0 is also useful (faster SGD)
010
Marco Cuturi @marcocuturi.bsky.social · 04/10/2025
Thanks for the nice comments! my interpretation is that we're using OT to produce pairs (x_i,y_i) to guide FM. With that, it's up to you to provide an inductive bias (a model) that gets f(x)~=y while generalizing. The hard OT assignment could be that model, but it would fail to generalize.
150
Marco Cuturi @marcocuturi.bsky.social · 04/10/2025
for people that like OT, IMHO the very encouraging insight is that we have evidence that the "better" you solve your OT problem, the more flow matching metrics improve, this is Figure 3
130
Marco Cuturi @marcocuturi.bsky.social · 04/10/2025
Thanks @rflamary.bsky.social! yes, exactly. We try to summarize this tradeoff in Table 1, in which we show that for a one-off preprocessing cost, we now get all (noise,data) pairings you might need during flow matching training for "free" (up to the MIPS lookup for each noise).
110
Marco Cuturi @marcocuturi.bsky.social · 03/10/2025
the paper is out: arxiv.org/abs/2509.25519 Michal also did a fantastic push to open source the semidiscrete solver prepared by Stephen and Alireza in the OTT-JAX library. We plan to open source the flow pipeline in JAX soon. Please reach out if interested!
arxiv.org
Flow Matching with Semidiscrete Couplings
Flow models parameterized as time-dependent velocity fields can generate data from noise by integrating an ODE. These models are often trained using flow matching, i.e. by sampling random pairs of noi...
070
Marco Cuturi @marcocuturi.bsky.social · 03/10/2025
This much faster than using Sinkhorn, and generates with higher quality. As a bonus, you can forget about entropy regularization (set ε=0), apply things like correctors to guidance, and use it on consistency-type models, or even with conditional generation.
120
Marco Cuturi @marcocuturi.bsky.social · 03/10/2025
the great thing with SD-OT is that this only needs to be computed once. You only need to store a real number per data sample. You can precompute these numbers once & for all using stochastic convex optimization. When training a flow model, you assign noise to data using these numbers.
110
Marco Cuturi @marcocuturi.bsky.social · 03/10/2025
In practice, however, this idea only begins to work when using massive batch sizes (see arxiv.org/abs/2506.05526). The problem is that the costs of running Sinkhorn on millions of points can quickly balloon... Our solution? rely on semidiscrete OT at scales that were never considered before.
110
Marco Cuturi @marcocuturi.bsky.social · 03/10/2025
Our two phenomenal interns, Alireza Mousavi-Hosseini and Stephen Zhang @syz.bsky.social have been cooking some really cool work with Michal Klein and me over the summer. Relying on optimal transport couplings (to pick noise and data pairs) should, in principle, be helpful to guide flow matching 🧵
2307
Reposted by Marco Cuturi
Peter Gray @peteryugray.bsky.social · 21/08/2025
New Apple #ML Research Highlight: The "Super Weight:" How Even a Single Parameter can Determine an #LLM's Behavior machinelearning.apple.com/research/the...
machinelearning.apple.com
The
A recent paper from Apple researchers,
142
Marco Cuturi @marcocuturi.bsky.social · 29/08/2025
you're right that the PCs' message uses space as a justification to accept less papers, but it does not explicitly mention that the acceptance rate should be lower than the historical standard of 25%. In my SAC batch, the average acceptance before their email was closer to 30%, but that's just me..
240
Marco Cuturi @marcocuturi.bsky.social · 29/08/2025
I see it a bit differently. The new system pushed reviewers aggressively to react to rebuttals. I think this is a great change, but this has clearly skewed results, creating many spurious grade upgrades. Now the system must be rebalanced in the other direction by SAC/AC for results to be fair..
150
Marco Cuturi @marcocuturi.bsky.social · 01/08/2025
scaling up the computation of optimal transport couplings to hundreds of thousands of 3k dimensional vectors made easy using sharding and OTT-JAX! check this notebook, it only takes a few lines of code thanks to JAX's native sharding abilities ott-jax.readthedocs.io/en/latest/tu...
ott-jax.readthedocs.io
Sharded Sinkhorn — ott 0.5.1.dev34+g3462f28 documentation
0142
Reposted by Marco Cuturi
Peter Gray @peteryugray.bsky.social · 23/07/2025
New Apple #ML Research Highlight: "FastVLM: Efficient Vision Encoding for Vision Language Models" machinelearning.apple.com/research/fas...
machinelearning.apple.com
FastVLM: Efficient Vision Encoding for Vision Language Models
Vision Language Models (VLMs) enable visual understanding alongside textual inputs. They are typically built by passing visual tokens from a…
161
Reposted by Marco Cuturi
Pauline Luc @paulineluc.bsky.social · 08/07/2025
So pleased and proud to share with you what our team has been up to, on an ambitious journey to build a video foundation model for scientific domains ! ✨ 🚀 🎞️ 🧪 #ICCV2025 #AI4Science
0112
Reposted by Marco Cuturi
Ben Recht @beenwrekt.bsky.social · 03/07/2025
The NeurIPS paper checklist corroborates the bureaucratic theory of statistics.
argmin.net
Standard error of what now?
The NeurIPS checklist corroborates the bureaucratic theory of statistics.
46413
Reposted by Marco Cuturi
Michael Kirchhof @mkirchhof.bsky.social · 03/07/2025
Can LLMs access and describe their own internal distributions? With my colleagues at Apple, I invite you to take a leap forward and make LLM uncertainty quantification what it can be. 📄 arxiv.org/abs/2505.20295 💻 github.com/apple/ml-sel... 🧵1/9
1236
Reposted by Marco Cuturi
λ³🎲 @cubiclogic.bsky.social · 29/06/2025
www.kyotoprize.org/en/laureates...
kyotoprize.org
Shun-ichi Amari | Kyoto Prize
Shun-ichi Amari
021
Reposted by Marco Cuturi
λ³🎲 @cubiclogic.bsky.social · 20/06/2025
Shunichi Amari has been awarded the 40th (2025) Kyoto Prize in recognition of his pioneering research in the fields of artificial neural networks, machine learning, and information geometry www.riken.jp/pr/news/2025...
riken.jp
甘利 俊一 栄誉研究員が「京都賞」を受賞
甘利 俊一栄誉研究員(本務:帝京大学 先端総合研究機構 特任教授)は、人工ニューラルネットワーク、機械学習、情報幾何学分野での先駆的な研究が評価され、第40回(2025)京都賞(先端技術部門 受賞対象分野:情報科学)を受賞しました。
23512
Reposted by Marco Cuturi
silingao.bsky.social @silingao.bsky.social · 23/06/2025
NEW PAPER ALERT: Recent studies have shown that LLMs often lack robustness to distribution shifts in their reasoning. Our paper proposes a new method, AbstRaL, to augment LLMs’ reasoning robustness, by promoting their abstract thinking with granular reinforcement learning.
163
Reposted by Marco Cuturi
Maureen de Seyssel @maureendeseyssel.bsky.social · 27/05/2025
Now that @interspeech.bsky.social registration is open, time for some shameless promo! Sign-up and join our Interspeech tutorial: Speech Technology Meets Early Language Acquisition: How Interdisciplinary Efforts Benefit Both Fields. 🗣️👶 www.interspeech2025.org/tutorials ⬇️ (1/2)
interspeech2025.org
https://www.interspeech2025.org/tutorials
Your cookies are disabled, please enable them.
195
Reposted by Marco Cuturi
Cem Koç @cemkoch.bsky.social · 07/05/2025
Today we have released the code and a demo iOS application for FastVLM - our extremely efficient and fast vision language model which runs on your device using MLX! You can check out the code and the app here: github.com/apple/ml-fas...
143
Reposted by Marco Cuturi
davidgrangier.bsky.social @davidgrangier.bsky.social · 22/04/2025
#ICLR #TrainBetterLM I am at ICLR, come to our posters for improved language model training! Recycle gradients for faster neural net training with AdEMAmix iclr.cc/virtual/2025... (Fri Apr 25, 10 am). 1/3
123
Reposted by Marco Cuturi
Peter Gray @peteryugray.bsky.social · 21/04/2025
New post: "Apple Machine Learning Research at #ICLR 2025" - highlighting a selection of the many Apple #ML research papers to be presented at @iclr-conf.bsky.social this week: machinelearning.apple.com/research/icl...
machinelearning.apple.com
Apple Machine Learning Research at ICLR 2025
Apple researchers are advancing machine learning (ML) and AI through fundamental research that improves the world’s understanding of this…
063
Reposted by Marco Cuturi
Pau Rodriguez @paurodriguez.bsky.social · 10/12/2024
Thrilled to share the latest work from our team at @Apple where we achieve interpretable and fine-grained control of LLMs and Diffusion models via Activation Transport 🔥 📄 arxiv.org/abs/2410.23054 🛠️ github.com/apple/ml-act 0/9 🧵
34715
Reposted by Marco Cuturi
Unusual Whales @unusualwhales.bsky.social · 10/04/2025
The trader made millions. Why was this unusual? For a few reasons: - Firstly new opening volume on chain, minutes after market open - IVR of +80 on $QQQ, with iv percentile of medium. - happened at once, at ask -otm - market was bearish, across the board Unusual. Come learn: unusualwhales.com
1125448
Reposted by Marco Cuturi
Elizabeth Warren @warren.senate.gov · 09/04/2025
I'm calling for an investigation into whether President Trump manipulated the market to benefit his Wall Street donors—all while working people and small businesses paid the price. Did Trump help insiders cash in on his tariff flip-flopping? It sure looks like corruption.
youtu.be
Did Trump help insiders cash in on his tariff flip-flopping?
YouTube video by Senator Elizabeth Warren
812154773924
Reposted by Marco Cuturi
Peter Gray @peteryugray.bsky.social · 10/04/2025
Accepted as a Spotlight at @iclr-conf.bsky.social the work shares a new method for fine-grained control over #genAI output - without the computational overhead, complexity, and volume of data needed by #RLHF or fine-tuning, and with more reliable results than prompt engineering.
041
Reposted by Marco Cuturi
Preetum Nakkiran @preetumnakkiran.bsky.social · 11/02/2025
Paper🧵 (cross-posted at X): When does composition of diffusion models "work"? Intuitively, the reason dog+hat works and dog+horse doesn’t has something to do with independence between the concepts being composed. The tricky part is to formalize exactly what this means. 1/
Left Image: A shaggy dog-horse hybrid standing in a rural landscape.
Right Image: A golden dog wearing a red beret against a blurred outdoor background.
23915
Reposted by Marco Cuturi
kyunghyuncho.bsky.social @kyunghyuncho.bsky.social · 28/01/2025
because "attention is all you need"
071
Reposted by Marco Cuturi
Samira @samiraabnar.bsky.social · 28/01/2025
🚨 One question that has always intrigued me is the role of different ways to increase a model's capacity: parameters, parallelizable compute, or sequential compute? We explored this through the lens of MoEs:
1188
Marco Cuturi @marcocuturi.bsky.social · 26/01/2025
Hi Yassine! thanks for asking, for now we don't have a Cifre program @ Apple MLR in Paris, we're prioritizing internships
120
Reposted by Marco Cuturi
Pierre Ablin @pierreablin.bsky.social · 24/01/2025
Excited to see Sigmoid Attention accepted at ICLR 2025 !! Make attention ~18% faster with a drop-in replacement 🚀 Code: github.com/apple/ml-sig... Paper arxiv.org/abs/2409.04431
arxiv.org
Theory, Analysis, and Best Practices for Sigmoid Self-Attention
Attention is a key part of the transformer architecture. It is a sequence-to-sequence mapping that transforms each sequence element into a weighted sum of values. The weights are typically obtained as...
1285
Reposted by Marco Cuturi
Josh Susskind @kindsuss.bsky.social · 23/01/2025
Here's a really cool cross-institution study leveraging optimal transport techniques developed by my Apple ML Research colleagues! It's great to see basic research in machine learning translate into scientific tools like this. Cuts into the AI hype a bit ;)
021