Reposted by MarioEthan Mollick @emollick.bsky.social · 21/11/2025Ruining great art with the nano banana pro command “Make this much more cheerful with as few changes as possible” 1118227
Reposted by Mariolebellig @lebellig.bsky.social · 28/10/2025"The Principles of Diffusion Models" by Chieh-Hsin Lai, Yang Song, Dongjun Kim, Yuki Mitsufuji, Stefano Ermon. arxiv.org/abs/2510.21890 It might not be the easiest intro to diffusion models, but this monograph is an amazing deep dive into the math behind them and all the nuancesarxiv.orgThe Principles of Diffusion ModelsThis monograph presents the core principles that have guided the development of diffusion models, tracing their origins and showing how diverse formulations arise from shared mathematical ideas. Diffu... 13713
Reposted by MarioAhmad Beirami @abeirami.bsky.social · 09/08/2025The main ingredient that led to GRPO's performance leap is the calibration of the reward/value via multiple rollouts per prompt. Let me elaborate on what I mean by that and a cheaper way of doing it offline. 2317
Mario @mnslarcher.bsky.social · 15/08/2025To understand PPO, GRPO, or any policy-gradient algorithm, you first need to understand REINFORCE. I’ve written my notes here.open.substack.comNotes on REINFORCEDeep dive into the first policy gradient method. 000
Reposted by MarioGrant Sanderson @3blue1brown.com · 25/07/2025New video on the details of diffusion models: youtu.be/iv-5mZ_9CPY Produced by Welch Labs, this is the first in a short series of 3b1b this summer. I enjoyed providing editorial feedback throughout the last several months, and couldn't be happier with the result.youtu.beBut how do AI videos actually work? | Guest video by @WelchLabsVideoYouTube video by 3Blue1Brown 214413
Reposted by MarioEugene Vinitsky 🍒 @eugenevinitsky.bsky.social · 10/07/2025Well, a single week was enough to provide a convincing case that a Wikipedia equivalent for LLMs is necessary i.e. decentralized LLM training and serving 410117
Mario @mnslarcher.bsky.social · 10/07/2025This explanation of PPO and GRPO is SUPER clear.yugeten.github.ioA vision researcher’s guide to some RL stuff: PPO & GRPO 000
Reposted by MarioSander Dieleman @sedielem.bsky.social · 05/07/2025Diffusion models have analytical solutions, but they involve sums over the entire training set, and they don't generalise at all. They are mainly useful to help us understand how practical diffusion models generalise. Nice blog + code by Raymond Fan: rfangit.github.io/blog/2025/op... 2343
Mario @mnslarcher.bsky.social · 30/06/2025Sharing what I like in case you do too. Great book, @natolambert.bsky.social. It’s exactly what I was looking for. rlhfbook.comrlhfbook.comRLHF Book by Nathan LambertThe Reinforcement Learning from Human Feedback Book 051
Mario @mnslarcher.bsky.social · 15/06/2025Any intuition on using max_period=10k for t sinusoidal PE in, e.g, Flux? Since t enters via AdaLN and range is fixed, would linear interpol. two high dim vec work too? Does PE 10k make it easier to distinguish small t and harder for large t? Maybe @sedielem.bsky.social @stefanabaumann.bsky.social 100
Reposted by MarioElle Cordova @ellecordova.bsky.social · 13/06/2025No, in this country we don’t tolerate senators being forced to the ground and cuffed for asking questions. We don’t tolerate masked agents rounding people up on the streets and disappearing them in unmarked vans. And we sure as hell don’t tolerate 854449
Reposted by MarioSara Hooker @sarahooker.bsky.social · 30/04/2025It is critical for scientific integrity that we trust our measure of progress. The @lmarena.bsky.social has become the go-to evaluation for AI progress. Our release today demonstrates the difficulty in maintaining fair evaluations on the Arena, despite best intentions. 19569
Reposted by MarioMelanie Mitchell @melaniemitchell.bsky.social · 22/04/2025Harvard is Dancing Guy. Who is the first follower? m.youtube.com/watch?v=fW8a...m.youtube.comFirst Follower: Leadership Lessons from Dancing GuyYouTube video by Derek Sivers 0235
Reposted by MarioSenator Bernie Sanders @sanders.senate.gov · 21/04/2025Workers are not asking to get rich. They just want to afford three meals a day. In the richest country in the history of the world, no one should work for starvation wages. It is time to raise the disgraceful $7.25/hr federal minimum wage to a living wage of AT LEAST $17/hr. 306103402197
Reposted by MarioNathan Lambert @natolambert.bsky.social · 18/04/2025rlhfbook also available on arxiv for SEO 😀 happy friday arxiv.org/abs/2504.12501arxiv.orgReinforcement Learning from Human FeedbackReinforcement learning from human feedback (RLHF) has become an important technical and storytelling tool to deploy the latest machine learning systems. In this book, we hope to give a gentle… 36913
Reposted by MarioSander Dieleman @sedielem.bsky.social · 15/04/2025New blog post: let's talk about latents! sander.ai/2025/04/15/l...sander.aiGenerative modelling in latent spaceLatent representations for generative models. 37518
Reposted by MarioDavid Picard @davidpicard.eurosky.social · 03/03/2025🚨 New preprint! How far can we go with ImageNet for Text-to-Image generation? w. @arrijitghosh.bsky.social @lucasdegeorge.bsky.social @nicolasdufour.bsky.social @vickykalogeiton.bsky.social TL;DR: Train a text-to-image model using 1000 less data in 200 GPU hrs! 📜https://arxiv.org/abs/2502.21318 🧵👇 26516
Mario @mnslarcher.bsky.social · 22/02/2025I think the problem with visual art is that you see it immediately. Then you move on to the next piece, and once again, you’ve taken it in within seconds. It’s like opening a book, reading a few sentences here and there, and then closing it. 1/2 100
Reposted by MarioMelanie Mitchell @melaniemitchell.bsky.social · 30/01/2025Very good (technical) explainer answering "How has DeepSeek improved the Transformer architecture?". Aimed at readers already familiar with Transformers. epoch.ai/gradient-upd...epoch.aiHow has DeepSeek improved the Transformer architecture?This Gradient Updates issue goes over the major changes that went into DeepSeek’s most recent model. 627763
Reposted by MarioFull Metal NAFO Fella🌈🇫🇮🇺🇦 @esky2023.eurosky.social · 21/01/2025Hard to say... /s 922340
Reposted by MarioMelanie Mitchell @melaniemitchell.bsky.social · 04/01/2025Shame on the @washingtonpost.com, which at one time was beacon of the free press. anntelnaes.substack.com/p/why-im-qui...anntelnaes.substack.comWhy I'm quitting the Washington PostDemocracy can't function without a free press 27712
Mario @mnslarcher.bsky.social · 22/12/2024Enraging. youtu.be/2sdBEV8zVPU?...youtu.beAmazon Bosses Squirm Under QuestioningYouTube video by Trades Union Congress (TUC) 030
Reposted by MarioSander Dieleman @sedielem.bsky.social · 16/12/2024Here's Veo 2, the latest version of our video generation model, as well as a substantial upgrade for Imagen 3 🧑🍳🚢 (Did I mention we are hiring on the Generative Media team, btw 👀) blog.google/technology/g...blog.googleState-of-the-art video and image generation with Veo 2 and Imagen 3We’re rolling out a new, state-of-the-art video model, Veo 2, and updates to Imagen 3. Plus, check out our new experiment, Whisk. 06017
Reposted by MarioKashyap Chitta @kashyap7x.bsky.social · 15/12/2024Link to the talk: youtu.be/1yvBqasHLZs?...youtu.beIlya Sutskever: "Sequence to sequence learning with neural networks: what a decade"YouTube video by seremot 152
Reposted by MarioBirchlabs @birchlabs.co.uk · 14/12/2024Meta releases flow-matching code github.com/facebookrese...github.comGitHub - facebookresearch/flow_matching: A PyTorch library for implementing flow matching algorithms, featuring continuous and discrete flow matching implementations. It includes practical examples fo...A PyTorch library for implementing flow matching algorithms, featuring continuous and discrete flow matching implementations. It includes practical examples for both text and image modalities. - fa... 2133
Mario @mnslarcher.bsky.social · 12/12/2024It wouldn’t be so bitter if we didn’t constantly fall into thinking it’s over 010
Mario @mnslarcher.bsky.social · 07/12/2024When I was a child I watched each Indiana Jones at least four times. This looks great! 010
Reposted by MarioEugene Vinitsky 🍒 @eugenevinitsky.bsky.social · 04/12/2024They did it again. This is absurd. The sim-to-real pipeline continues to gets more powerful 1311
Mario @mnslarcher.bsky.social · 30/11/2024This is very cool! I love this kind of blog post. iIt’s the kind of stuff that inspires me to dig deeper.post.xn--its-so0a 020
Mario @mnslarcher.bsky.social · 30/11/2024Regardless of what one thinks about this, it’s quite scary. WTF is this repression of free speech? This is a terrible mistake—I really hope it’s reverted quickly. 010
Reposted by MarioPhilipp Marquetand @marquetand.bsky.social · 29/11/20243. Join my team at Canva if you are a senior ML researcher in the domain of Generative AI: www.lifeatcanva.com/en/jobs/6000...lifeatcanva.comSenior Machine Learning Researcher (GenAI) - Canva Austria (f/m/x)Join the team redefining how the world experiences design. Servus, hey, g'day, mabuhay, kia ora, 你好, hallo, vítejte! Thanks for stopping by. We know job hunting can be a little time consuming and you'... 011
Reposted by MarioStella Biderman @stellaathena.bsky.social · 28/11/2024OpenAI doesn't want this dataset. Any company that wants Bluesky data will press a button and go get all posts on Bluesky. The very design of the website makes that trivial to do. This doesn't help OpenAI *at all*. 1431
Mario @mnslarcher.bsky.social · 23/11/2024I attended an exhibition of Akseli Gallen-Kallela (1865–1931), and aside from the fact that his paintings are magnificent, it’s incredible how his women are more emancipated, full of character, and less subordinate to men compared to other artists of his time and even later. 010
Mario @mnslarcher.bsky.social · 23/11/2024Paper summary. Title: Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Models Link: arxiv.org/html/2409.10... 🧵 (1/15)arxiv.org 110
Reposted by MarioEthan @ethansmith2000.com · 23/11/2024probably the best in-depth explanation i've seen on FSDP at the most granular levels, props to the authors dev-discuss.pytorch.org/t/fsdp-cudac... 193
Mario @mnslarcher.bsky.social · 22/11/2024Like I was doing on X, I'll post here paper summaries from time to time. This is one of the first design generation papers I read. Title: LayoutDM: Discrete Diffusion Model for Controllable Layout Generation. Link: arxiv.org/abs/2303.08137 🧵 (1/10)arxiv.orgLayoutDM: Discrete Diffusion Model for Controllable Layout GenerationControllable layout generation aims at synthesizing plausible arrangement of element bounding boxes with optional constraints, such as type or position of a specific element. In this work, we try to s... 110
Reposted by MarioDmytro Mishkin @ducha-aiki.bsky.social · 22/11/2024Stable Flow: Vital Layers for Training-Free Image Editing Omri Avrahami, Or Patashnik, Ohad Fried, Egor Nemchinov, Kfir Aberman, Dani Lischinski, Daniel Cohen-Or tl;dr: embedding insertion into specific DiT layers for object replacement arxiv.org/abs/2411.14430 0203
Mario @mnslarcher.bsky.social · 21/11/2024I remember Jack Gallagher (MJ) saying that rectified flow is just slightly better than EDM. The PGv3 paper says they still use EDM. Is there any consensus on whether they’re ~the same or if one should switch to flow matching? 000
Reposted by MarioSander Dieleman @sedielem.bsky.social · 15/11/2024In a gratuitous attempt to acquire more followers myself 😁, I've made a start on a "starter pack". Hopefully as more people from 🐦 make it over to 🦋, we can extend this a bit. Suggestions welcome! I've noticed not all accounts seem to be eligible to be added, anyone know what's up with that? 🤔 3412836