iiinova — where your digital self keeps evolving

Josh Susskind @kindsuss.bsky.social · 07/11/2025

Cogsci peeps! This is a great opportunity! @sineadwilliamson.bsky.social is a great mentor and scientist, along with a wonderful team :)

030

Reposted by Josh Susskind

Marco Cuturi @marcocuturi.bsky.social · 05/11/2025

We have been working with Michal Klein on pushing a module to train *flow matching* models using JAX. This is shipped as part of our new release of the OTT-JAX toolbox (github.com/ott-jax/ott) The tutorial to do so is here: ott-jax.readthedocs.io/tutorials/ne...

1147

Reposted by Josh Susskind

Marco Cuturi @marcocuturi.bsky.social · 01/08/2025

scaling up the computation of optimal transport couplings to hundreds of thousands of 3k dimensional vectors made easy using sharding and OTT-JAX! check this notebook, it only takes a few lines of code thanks to JAX's native sharding abilities ott-jax.readthedocs.io/en/latest/tu...

ott-jax.readthedocs.io

Sharded Sinkhorn — ott 0.5.1.dev34+g3462f28 documentation

0142

Josh Susskind @kindsuss.bsky.social · 08/06/2025

Wow. Thank you for your bravery whoever you are.

030

Josh Susskind @kindsuss.bsky.social · 11/04/2025

Check out our Apple research work on scaling laws for native multimodal models! Combined with mixtures of experts, native models develop both specialized and multimodal representations! Lots of rich findings and opportunists for follow up research!

065

Josh Susskind @kindsuss.bsky.social · 24/03/2025

My colleagues in #Apple ML Research posted a fun paper investigating how autoregressive design choices affect reasoning (in this case, multi-choice question answering), showing a benefit to R2L ordering. Reminds me of similar findings for reverse order addition in arxiv.org/abs/2310.16028!

arxiv.org

What Algorithms can Transformers Learn? A Study in Length Generalization

Large language models exhibit surprising emergent generalization properties, yet also struggle on many simple reasoning tasks such as arithmetic and parity. This raises the question of if and when Tra...

193

Josh Susskind @kindsuss.bsky.social · 25/02/2025

My colleague Shuangfei Zhai is looking for a summer research intern to work on improving TarFlow at Apple. If interested, send your CV to szhai at apple.com by this week.

apple.com

Apple

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

040

Josh Susskind @kindsuss.bsky.social · 14/02/2025

Here's a great paper on scaling laws for teacher-student neural network distillation led by @dbusbridge.bsky.social and Apple colleagues. I've often seen people struggle to get distillation working well enough in practical settings, and I expect the insights in this paper can really help!

040

Josh Susskind @kindsuss.bsky.social · 12/02/2025

Here's a fun Apple research paper seeking to understand when/why diffusion models can be composed to generate images containing multiple independent concepts. For example, composing images from a model trained on Preetum's dog and a model trained on hats. Because why wouldn't you want to do that?!!

010

Josh Susskind @kindsuss.bsky.social · 11/02/2025

If you are interested in doing an internship in ML research at Apple, I highly recommend talking with Etai Littwin (and Vimal Thilak is pretty awesome too!)

010

Josh Susskind @kindsuss.bsky.social · 29/01/2025

This work was born from an Apple internship with Harshay Shah. Samira provided excellent direction and technical contributions along with Vimal, and the entire team was incredibly helpful! I'm intrigued reading comprehension tasks do not follow pre-training scaling curves -- gotta follow this up!

110

Josh Susskind @kindsuss.bsky.social · 23/01/2025

Too disgusted by the Twitter/X vomit and could not justify keeping my account there. Hoping this platform steers clear of disinformation and hate -- and remains a positive place to share science and other good things.

010

Josh Susskind @kindsuss.bsky.social · 23/01/2025

Here's a really cool cross-institution study leveraging optimal transport techniques developed by my Apple ML Research colleagues! It's great to see basic research in machine learning translate into scientific tools like this. Cuts into the AI hype a bit ;)

021

Reposted by Josh Susskind

Cem Koç @cemkoch.bsky.social · 19/12/2024

Excited about vision-language models? 🚀 Check out our latest work on FastVLM, a new family of efficient vision-language models that balances the tradeoff between high-resolution image understanding and latency without compromising accuracy! arxiv.org/abs/2412.13303

611

Josh Susskind @kindsuss.bsky.social · 18/12/2024

If you're looking for research scientist roles in Europe, check out Marco's post! The Paris team is fantastic, and does diverse idea-driven and impactful research. In addition, MLR is highly collaborative across timezones, so you'd have a chance to work with many others too.

021

Josh Susskind @kindsuss.bsky.social · 10/12/2024

Cross-posting from that other place: I’m really proud of Apple ML research and wanted to share a summary that may be useful for #NeurIPS2024 attendees (and everyone else)! I’m particularly excited about code and model releases and will highlight some here. 1/n

150

Josh Susskind @kindsuss.bsky.social · 10/12/2024

Hello Bluesky! I'm a machine learning (aka AI these days) researcher at Apple, and my main interests these days are open science, flatpicking guitar, and rock climbing (and maybe the intersection of all of the above). I'll occasionally highlight some of the research going on in my group here.

040