Reposted by Jesse RusakOpen Athena @openathena.ai · 01/10/2026Marin's 535B-parameter hero run was originally planned as a 360B model. A new blog from Rafal Wojdyla, MTS, explains how a change in sharding strategy, Expert Parallelism, made room for a ~50% larger model at the same ~23B active parameters, and what it costs. 🔗 openathena.ai/blog/expert-... 0136
Jesse Rusak @jder.bsky.social · 18/09/2026You might enjoy this from one of our PI collaborators about the work we've been doing together: medium.com/@lz1955/samu... We're now working on making use of other data sources to train models to go from observational data (e.g. satellite) to future predictions of the ocean.github.comGitHub - m2lines/SamudraContribute to m2lines/Samudra development by creating an account on GitHub. 010
Reposted by Jesse RusakOpen Athena @openathena.ai · 18/09/2026We've only been observing the ocean directly for a few decades, and mostly at the surface. However, climate projections need to cover decades or centuries. Closing that gap is a machine learning problem, and it's the one Jesse Rusak @jder.bsky.social works on. Meet Jesse, MTS: bit.ly/oa-jesse 143
Reposted by Jesse RusakRecurse Center @recurse.com · 17/07/202615 years + 3,000 alums later, what started as a 6-person experiment is now a community of curious, kind programmers: engineers, artists, scientists, hobbyists, all united by a love of programming. If 6 or 12 weeks to focus on what truly interests you sounds appealing, apply! www.recurse.com/apply 14918
Reposted by Jesse RusakOpen Athena @openathena.ai · 04/06/2026In our latest blog post, Marin team member Larry Dial describes the pretraining techniques we're using as we transition from dense models to more efficient Mixture of Experts (MoE) models. This demos the stability and predictability of MoEs, giving us a promising direction for our next training runopenathena.aiOpen Athena | Improving our LLM Pretraining EfficiencyOpen Athena is a nonprofit that accelerates academia with capabilities from the AI frontier 1103
Reposted by Jesse RusakPlaydate @play.date · 12/05/2026① Will lovable rogue Beampunk manage to save humanity? Jump from system to system and charge your giant laser cannon to fight off a fleet of invading ships with some acrobatic crank-piloted combat! 👨🎤 play.date/games/beamp... 1173
Reposted by Jesse RusakWill Held @williamheld.com · 11/05/2026To train better open models, we need predictable scaling. Delphi is Marin’s first step: we pretrained many small models with one recipe, then extrapolated 300× to predict a 25B-param / 600B-token run with just 0.2% error. Getting there took some work 🧵 2389
Reposted by Jesse RusakWill Oremus @willoremus.com · 19/12/2025this is a good reminder of how things that are shitty but have been accepted as normal and inevitable can actually turn out to be abnormal and evitable with some science, time, education and political will 305158253962
Reposted by Jesse Rusak💥Alex.W💪🏾💥 @jokeb0i.bsky.social · 18/12/2025if tumblr dies I need this video to make it's seasonal rotation here instead just in case, Happy holidays 🎄 299131925310
Reposted by Jesse RusakSteve Schwinghamer🇨🇦 @sschwinghamer.bsky.social · 06/12/2025An excellent thread on the explosion 042
Reposted by Jesse RusakSKELLYTON @pizzalawyer420.bsky.social · 03/12/2025Idk if this is the quintessential Onion headline but I've thought of this at least once a week for almost a decade 393708911
Reposted by Jesse RusakBill Mudron @mudron.bsky.social · 27/11/2025Okay, the crowd going nuts like someone just scored a touchdown at the Super Bowl all *through* the KDH performance is a hell of a thing to see hear/see: 7480832523
Reposted by Jesse RusakSimon Willison @simonwillison.net · 06/07/2025We ditched CGI in the late 1990s because of the overhead of starting, executing and stopping a process for every incoming request... turns out modern servers (plus languages like Go or Rust with a fast startup time) mean CGI isn't such a bad idea any more! simonwillison.net/2025/Jul/5/c...simonwillison.netServing 200 million requests per day with a cgi-binJake Gold tests how well 90s-era CGI works today, using a Go + SQLIte CGI program running on a 16-thread AMD 3700X. Using CGI on modest hardware, it’s possible to … 1013021
Reposted by Jesse RusakAlondra Nelson @alondra.bsky.social · 13/05/2025"For me, the answer now lies in refusal, the withdrawal of participation from systems that require dishonesty as the price of belonging." Today I am resigning from the National Science Board and the Library of Congress Scholars Council. I wrote about my decision in TIME. time.com/7285045/resi...time.comWhy I’m Resigning from the NSF and Library of CongressI cannot participate in systems that require dishonesty as the price of belonging. 471171185921
Reposted by Jesse RusakStefan Baumgartner @deadparrot.dev · 13/05/2025The movie buff in me and the Rust developer in me approve. #rustweek 0256
Reposted by Jesse RusakSteve Paluch @brewcitychaser.com · 19/03/2025Underrated joke of the year right here. 1495
Reposted by Jesse RusakSteve Klabnik @steveklabnik.com · 05/03/2025A happy day for #rustlang steveklabnik.com/writing/a-ha...steveklabnik.comA Happy Day for RustI’m not sure where we go from here, and I’m not sure what we could have done to prevent this from happening. But I feel like this is a failure, and it’s set Rust back a bit, and I’m just plain sad. 418522
Reposted by Jesse RusakBen Ewen-Campen @benforward3.bsky.social · 04/03/2025In one of the first Council meetings I ever chaired, we advocated for the creation of a single consolidated waitlist for people in need of affordable housing - instead of separately applying to every new opportunity. Thrilled to see it launching! Info sessions: forms.office.com/pages/respon... 05910
Reposted by Jesse RusakSenator Bernie Sanders @sanders.senate.gov · 23/01/2025In the new Trump presidency, we have got to remain focused. We can’t panic. No matter how many executive orders he signs or statements he issues, our goal is the same: We must fight to create an America based on economic, social & environmental justice. www.theguardian.com/commentisfre...theguardian.comWhat Trump didn’t say in his inauguration speech | Bernie SandersThe simple truth is that Trump ignored almost every major issue facing this country’s working families in his first speech 1654779707
Reposted by Jesse RusakPhil Hawksworth @philhawksworth.dev · 16/01/2025Hitting the ↑ key 50 times to save myself from typing a 6 character command. After 5 taps, I can't back out. I'm committed until the very end of my command history or the very end of time. Whichever arrives first. 4624
Reposted by Jesse RusakBen Ewen-Campen @benforward3.bsky.social · 19/12/2024🏁Looking back at 2024 and ahead to next year - my latest newsletter is up! eepurl.com/i6wqOgeepurl.comBen Ewen-Campen's Somerville NewsletterLooking back on 2024, and ahead to the work in 2025 1114