Sign in

Valentin De Bortoli

@vdebortoli.bsky.social
751 followers 376 following 15 posts

messing up with gaussians

PostsRepliesMedia
Reposted by Valentin De Bortoli
David Pfau @davidpfau.com · 28/01/2025
Remember how, when the lockdowns started, every organization said "we only have two weeks of cash on hand and will shut down if we don't get assistance"? That's basically happening to every single lab and NGO right now, except for no actual reason.
0356
Reposted by Valentin De Bortoli
lebellig @lebellig.bsky.social · 20/01/2025
For the French-speaking audience, S. Mallat's courses at the College de France on Data generation in AI by transport and denoising have just started. I highly recommend them, as I've learned a lot from the overall vision of his courses. Recordings are also available: www.youtube.com/watch?v=5zFh...
youtube.com
Génération de données en IA par transport et débruitage (1) - Stéphane Mallat (2024-2025)
YouTube video by Mathématiques et informatique - Collège de France
0103
Reposted by Valentin De Bortoli
Gabriel Peyré @gabrielpeyre.bsky.social · 15/01/2025
Slides for a general introduction to the use of Optimal Transport methods in learning, with an emphasis on diffusion models, flow matching, training 2 layers neural networks and deep transformers. speakerdeck.com/gpeyre/optim...
312427
Reposted by Valentin De Bortoli
Pierre Alquier @pierrealquier.bsky.social · 05/01/2025
😍😍😍 lmbp.uca.fr/stflour/
1255
Reposted by Valentin De Bortoli
Peyman Milanfar @docmilanfar.bsky.social · 19/12/2024
I'm delighted to note that our paper InDI has been selected as one of two Outstanding Paper awardees by the Transactions on Machine Learning @tmlr-pub.bsky.social We sincerely thank the expert reviewers, Action Editors, the Outstanding Paper Committee, and the Editors for this honor 1/3
2281
Reposted by Valentin De Bortoli
Arnaud Doucet @arnauddoucet.bsky.social · 15/12/2024
The slides of my NeurIPS lecture "From Diffusion Models to Schrödinger Bridges - Generative Modeling meets Optimal Transport" can be found here drive.google.com/file/d/1eLa3...
drive.google.com
BreimanLectureNeurIPS2024_Doucet.pdf
932868
Valentin De Bortoli @vdebortoli.bsky.social · 15/12/2024
I love a good illustration 😍
040
Reposted by Valentin De Bortoli
Alex Thiery @alexxthiery.bsky.social · 14/12/2024
After watching this beautiful keynote by @arnauddoucet.bsky.social , I *had* to give these Schrodinger bridges a try! Very interesting to be able to "straighten" a basic flow-matching approach. Super cool work by @vdebortoli.bsky.social & co-author!
3579
Reposted by Valentin De Bortoli
Surya Ganguli @suryaganguli.bsky.social · 14/12/2024
Speaking at this #NeurIPS2024 workshop on a new analytic theory of creativity in diffusion models that predicts what new images they will create and explains how these images are constructed as patch mosaics of the training data. Great work by @masonkamb.bsky.social scienceofdlworkshop.github.io
scienceofdlworkshop.github.io
SciForDL'24
0433
Valentin De Bortoli @vdebortoli.bsky.social · 14/12/2024
Don't miss it!
010
Reposted by Valentin De Bortoli
Sander Dieleman @sedielem.bsky.social · 14/12/2024
I've been getting a lot of questions about autoregression vs diffusion at #NeurIPS2024 this week! I'm speaking at the adaptive foundation models workshop at 9AM tomorrow (West Hall A), about what happens when we combine modalities and modelling paradigms. adaptive-foundation-models.org
adaptive-foundation-models.org
NeurIPS 2024 Workshop on Adaptive Foundation Models
2466
Reposted by Valentin De Bortoli
Alex Thiery @alexxthiery.bsky.social · 13/12/2024
Fantastic #neurips keynote by Arnaud Doucet! Really like this slide tracing back many of the modern flow-matching / stochastic interpolants ideas to a 1986 result by probabilist Istvan Gyongy describing how to "Markovianize" a diffusion process (eg. having coefficients depending on all the past)
1494
Valentin De Bortoli @vdebortoli.bsky.social · 13/12/2024
yeah we tried to make it more accessible in arxiv.org/abs/2303.16852 and arxiv.org/abs/2409.09347 but we should definitely work on an easier intro, cc. @jamesthornton.bsky.social 👀
arxiv.org
Diffusion Schrödinger Bridge Matching
Solving transport problems, i.e. finding a map transporting one given distribution to another, has numerous applications in machine learning. Novel mass transport methods motivated by generative model...
150
Valentin De Bortoli @vdebortoli.bsky.social · 13/12/2024
🔥You enjoyed @arnauddoucet.bsky.social talk but want even more Schrodinger Bridge? Come talk to me at our poster! 🔷Schrodinger Bridge Flow for Unpaired Data Translation 🔊 East Exhibit Hall A-C #2504 Work done with my amazing collaborators Ira Korshunova Andriy Mnih and @arnauddoucet.bsky.social
0172
Reposted by Valentin De Bortoli
Sander Dieleman @sedielem.bsky.social · 12/12/2024
When a bunch of diffusers sit down and talk shop, their flow cannot be matched😎 It's time for the #NeurIPS2024 diffusion circle! 🕒Join us at 3PM on Friday December 13. We'll meet near this thing, and venture out from there and find a good spot to sit. Tell your friends!
It's located near the west entrance to the west side of the conference center, on the first floor, in case that helps!
1427
Valentin De Bortoli @vdebortoli.bsky.social · 05/12/2024
100% agree. OT is not (or rarely) a goal in itself but rather a mean to enforce useful properties
030
Reposted by Valentin De Bortoli
Anubhav Jain @anubhavj480.bsky.social · 04/12/2024
Have you ever wondered why diffusion models memorize and all initializations lead to the same training sample? As we show, this is because like in dynamic systems, the memorized sample acts as an attractor and a corresponding attraction basin is formed in the denoising trajectory.
34710
Reposted by Valentin De Bortoli
Gabriel Peyré @gabrielpeyre.bsky.social · 04/12/2024
Optimal transport, convolution, and averaging define interpolations between probability distributions. One can find vector fields advecting particles that match these interpolations. They are the Benamou-Brenier, flow-matching, and Dacorogna-Moser fields.
17711
Reposted by Valentin De Bortoli
James Thornton @jamesthornton.bsky.social · 04/12/2024
Iterated RF with conservative vector fields should get to OT, though training remains a challenge arxiv.org/abs/2209.14577
arxiv.org
Rectified Flow: A Marginal Preserving Approach to Optimal Transport
We present a flow-based approach to the optimal transport (OT) problem between two continuous distributions $π_0,π_1$ on $\mathbb{R}^d$, of minimizing a transport cost $\mathbb{E}[c(X_1-X_0)]$ in the ...
121
Reposted by Valentin De Bortoli
Gabriel Peyré @gabrielpeyre.bsky.social · 03/12/2024
Hellinger and Wasserstein are the two main geodesic distances on probability distributions. While both minimize the same energy, they differ in their interpolation methods: Hellinger focuses on density, whereas Wasserstein emphasizes position displacements.
110715
Reposted by Valentin De Bortoli
emielhoogeboom.bsky.social @emielhoogeboom.bsky.social · 03/12/2024
This is a really nice blogpost by @RuiqiGao and team that I enjoyed being a part of. My favorite key learnings are: - DDIM sampler == flow matching sampling - (Not) straight? - SD3 weighting (Esser, Rombach, et al) is very similar to the EDM weighting (Karras, et al). 👇
2102
Valentin De Bortoli @vdebortoli.bsky.social · 02/12/2024
ahah yeah apologies for this, I am slowly learning how to write for non-theoretical proba crowd but it's a process 😅
020
Valentin De Bortoli @vdebortoli.bsky.social · 02/12/2024
Yeah I was referring to the coupling obtained after the flow matching operation (or "Reflow"). It's an interesting object in itself which is not exactly OT but still exhibit *some* level of straightness.
010
Reposted by Valentin De Bortoli
Flatiron Institute @flatironinstitute.org · 02/12/2024
New datasets from @polymathicai.bsky.social available on @hf.co will train AI models to think like scientists. Read more: www.simonsfoundation.org/2024/12/02/n... #science #AI #machinelearning
simonsfoundation.org
New Datasets Will Train AI Models To Think Like Scientists
New Datasets Will Train AI Models To Think Like Scientists on Simons Foundation
0297
Valentin De Bortoli @vdebortoli.bsky.social · 02/12/2024
I am a broken record but yeah totally agree. If you iterate FM on that coupling though you get OT though (If you add a bit of noise). In the case of noisy FM we showed that the only coupling that is left invariant by noisy FM is the EOT one in arxiv.org/abs/2311.06978
arxiv.org
Augmented Bridge Matching
Flow and bridge matching are a novel class of processes which encompass diffusion models. One of the main aspect of their increased flexibility is that these models can interpolate between arbitrary d...
120
Reposted by Valentin De Bortoli
ruiqigao.bsky.social @ruiqigao.bsky.social · 02/12/2024
A common question nowadays: Which is better, diffusion or flow matching? 🤔 Our answer: They’re two sides of the same coin. We wrote a blog post to show how diffusion models and Gaussian flow matching are equivalent. That’s great: It means you can use them interchangeably.
625459
Valentin De Bortoli @vdebortoli.bsky.social · 02/12/2024
What you are showing is the coupling *before* the flow matching procedure though, right? After the flow matching procedure the coupling is modified (image from arxiv.org/abs/2209.03003)
250
Valentin De Bortoli @vdebortoli.bsky.social · 30/11/2024
(Specific to diffusion models) but goes in the direction of what Sander was suggesting: i.e. these models learn a somewhat robust coupling data/Gaussian
140
Valentin De Bortoli @vdebortoli.bsky.social · 30/11/2024
What about arxiv.org/abs/2310.05264
160
Valentin De Bortoli @vdebortoli.bsky.social · 30/11/2024
Yeah in the sense of RF. Although RF wont get you to OT (Qiang Liu himself has a counterexample). But if you consider noisy flow matching (a la stochastic interpolant) then this procedure converges to EOT. Shameless plug + concurrent paper arxiv.org/abs/2303.16852 + arxiv.org/abs/2304.00917
arxiv.org
Diffusion Schrödinger Bridge Matching
Solving transport problems, i.e. finding a map transporting one given distribution to another, has numerous applications in machine learning. Novel mass transport methods motivated by generative model...
193
Valentin De Bortoli @vdebortoli.bsky.social · 30/11/2024
But if you iterate your flow matching (with noise) you might just get to (E)OT 👀
120
Reposted by Valentin De Bortoli
Gabriel Peyré @gabrielpeyre.bsky.social · 30/11/2024
I wrote a summary of the main ingredients of the neat proof by Hugo Lavenant that diffusion models do not generally define optimal transport. github.com/mathematical...
523845
Valentin De Bortoli @vdebortoli.bsky.social · 28/11/2024
This is really mind blowing. I have been staring at the examples on the project page for longer than I'm willing to admit.
020
Valentin De Bortoli @vdebortoli.bsky.social · 27/11/2024
Nice blogpost and very cool illustrations 😍. I will die on the hill that most of the FM ideas where introduced back in 2021 by Stefano Peluchetti in his underappreciated paper openreview.net/forum?id=oVf...
2111
Reposted by Valentin De Bortoli
Gabriele Corso @gcorso.bsky.social · 17/11/2024
Thrilled to announce Boltz-1, the first open-source and commercially available model to achieve AlphaFold3-level accuracy on biomolecular structure prediction! An exciting collaboration with Jeremy, Saro, and an amazing team at MIT and Genesis Therapeutics. A thread!
18610204