Sign in

Jonathan Frankle

@jfrankle.com
2.9K followers 183 following 33 posts

Chief AI Scientist at Databricks. Founding team at MosaicML. MIT/Princeton alum. Lottery ticket enthusiast. Working on data intelligence.

PostsRepliesMedia
Reposted by Jonathan Frankle
Ryan Goodman @rgoodlaw.bsky.social · 28/03/2025
This is how it's done. A strong and principled response by WilmerHale to the illegal Executive Order attack - a form of attempted government intimidation declared unconstitutional by a federal judge. This is how to guard the rule of law.
438262076624
Jonathan Frankle @jfrankle.com · 25/03/2025
The hardest part about finetuning is that people don't have labeled data. Today, @databricks.bsky.social introduced TAO, a new finetuning method that only needs inputs, no labels necessary. Best of all, it actually beats supervised finetuning on labeled data. www.databricks.com/blog/tao-usi...
databricks.com
TAO: Using test-time compute to train efficient LLMs without labeled data
LIFT fine-tunes LLMs without labels using reinforcement learning, boosting performance on enterprise tasks.
0346
Reposted by Jonathan Frankle
Prithviraj "Raj" Ammanabrolu @rajammanabrolu.bsky.social · 27/02/2025
Join @kumarde.bsky.social Bryan, and me in CSE tomorrow as we do Hot Ones for Academics. My normally spicy research takes will get even spicier
A poster with three professor's pictures with the text "can your professors handle the heat"
182
Reposted by Jonathan Frankle
Tian Jin @tjin.bsky.social · 27/02/2025
Excited to share our work with friends from MIT/Google on Learned Asynchronous Decoding! LLM responses often contain chunks of tokens that are semantically independent. What if we can train LLMs to identify such chunks and decode them in parallel, thereby speeding up inference? 1/N
1179
Reposted by Jonathan Frankle
Andrew Drozdov @mrdrozdov.com · 26/02/2025
We're probably a little too obsessed with zero-shot retrieval. If you have documents (you do), then you can generate synthetic data, and finetune your embedding. Blog post lead by @jacobianneuro.bsky.social shows how well this works in practice. www.databricks.com/blog/improvi...
databricks.com
Improving Retrieval and RAG with Embedding Model Finetuning
Fine-tune embedding models on Databricks to enhance retrieval and RAG accuracy with synthetic data—no manual labeling required.
195
Reposted by Jonathan Frankle
James Grimmelmann @jtlg.bsky.social · 28/01/2025
In case it is not clear from my reposts, the Trump administration is engaged in an illegal AND unconstitutional to seize power over the federal government away from Congress and the courts. "Pausing" payment on the government's bills is just one part of it, but it is among the worst.
1247
Jonathan Frankle @jfrankle.com · 27/01/2025
All the more convinced that the markets don't understand AI. Both the irrational hype and the irrational pessimism. DeepSeek is incredibly bullish for GPU sales...
2101
Jonathan Frankle @jfrankle.com · 22/01/2025
Very excited that our Series J is complete. Especially thrilled to have our friends at Meta on board!
cnbc.com
Meta backs Databricks as the data analytics startup inches toward IPO
Meta rarely invests in startups, but it works with Databricks on the Llama open-source models that Meta trains.
1121
Jonathan Frankle @jfrankle.com · 22/01/2025
Gives a new meaning to "Infrastructure Week"
140
Reposted by Jonathan Frankle
Joshua J. Friedman @joshuajfriedman.com · 20/01/2025
This is so bad
Tweet from the Anti-Defamation League, or ADL:

This is a delicate moment. It's a new day and yet so many are on edge.
Our politics are inflamed, and social media only adds to the anxiety.
It seems that @elonmusk made an awkward gesture in a moment of enthusiasm, not a Nazi salute, but again, we appreciate that people are on edge.
In this moment, all sides should give one another a bit of grace, perhaps even the benefit of the doubt, and take a breath. This is a new beginning.
Let's hope for healing and work toward unity in the months and years ahead.
5:52 PM • Jan 20, 2025
10068149895
Reposted by Jonathan Frankle
Eugene Vinitsky 🍒 @eugenevinitsky.bsky.social · 20/01/2025
I wasn’t expecting a nazi salute on day 1 but here we are. I of course understand that due to the palm on heart there’s plausible deniability but we all understand the intent
3432
Jonathan Frankle @jfrankle.com · 20/01/2025
Impressed by those able to talk about Deepseek right now.
2402
Jonathan Frankle @jfrankle.com · 18/01/2025
Interesting Friday evening code drop from @rajammanabrolu.bsky.social and Brandon Cui at @databricks.bsky.social. That's all I'm allowed to say for now... github.com/databricks/c...
github.com
GitHub - databricks/Compose-RL
Contribute to databricks/Compose-RL development by creating an account on GitHub.
0131
Reposted by Jonathan Frankle
Metropolitan Transportation Authority @mta.info · 05/01/2025
Congestion Relief Zone tolling is now in effect. Learn more: congestionreliefzone.mta.info
congestionreliefzone.mta.info
Congestion Pricing Program in New York - MTA
231029192
Reposted by Jonathan Frankle
🐘 @pkydrm.bsky.social · 19/12/2024
🧵 Super proud to finally share this work I led last quarter - the @databricks.bsky.social Domain Intelligence Benchmark Suite (DIBS)! TL;DR: Academic benchmarks ≠ real performance and domain intelligence > general capabilities for enterprise tasks. 1/3
454
Reposted by Jonathan Frankle
Prithviraj "Raj" Ammanabrolu @rajammanabrolu.bsky.social · 17/12/2024
Databricks raises $10b Series J at $62b valuation, the largest venture round ever. www.databricks.com/company/news...
Price of the brick going up
1112
Jonathan Frankle @jfrankle.com · 17/12/2024
The world needs data intelligence, and @databricks.bsky.social is delivering. Thank you to the investors who continue to support us on this journey. 🧱🧱🧱 www.databricks.com/company/news...
databricks.com
Databricks is Raising $10B Series J Investment at $62B Valuation
Funding led by new investor Thrive Capital Company expects to cross $3B in revenue run rate and achieve positive free cash flow in fourth quarter
1143
Jonathan Frankle @jfrankle.com · 13/12/2024
Reflections on NeurIPS: There's always a big theme people seem to be preoccupied with. This year, it was the continuation of scaling/progress. Will it continue? What will the next generation of models hold? I even got to sass Dylan Patel (not on bsky) over it. Here are my personal thoughts 🧵
35911
Reposted by Jonathan Frankle
Nikhil Thorat @nst.bsky.social · 11/12/2024
We just released the Databricks synthetic evals SDK! 🎉 We’ve found that synthesizing evals is a great way to hill climb your AI system before you’re able to get labels from domain experts. We’ve also recently release a new diff UI that lets you both qualitatively and quantitatively view results!
152
Reposted by Jonathan Frankle
Permanence AI @permanence.ai · 10/12/2024
Interested in massively reducing the toil of code maintenance? Permanence AI is at #NeurIPS2024 this week! Tyler Holloway and Ethan Elenberg will be presenting work at the ML For Systems workshop, and our Founder/CEO Joseph Hackman is attending the conference as well. Let's catch up! #AI #ML
022
Jonathan Frankle @jfrankle.com · 08/12/2024
See you at NeurIPS! I'll be there Tuesday to Friday. Find me at the @databricks.bsky.social booth at the expo.
0150
Reposted by Jonathan Frankle
Cody Blakeney ✈️ NeurIPS 2024 @codestar.bsky.social · 26/11/2024
Checking some great work my team did on continued pretraining of LLMs!
2152
Reposted by Jonathan Frankle
Ofir Press @ofirpress.bsky.social · 25/11/2024
I wrote some thoughts on how to build good LM benchmarks: ofir.io/How-to-Build...
ofir.io
How to Build Good Language Modeling Benchmarks
Building benchmarks is important because they shine a spotlight on the weaknesses of existing language models and so can guide the community on how to improve them.
5778
Reposted by Jonathan Frankle
Pratyush Maini @pratyushmaini.bsky.social · 25/11/2024
1/5 Earlier this year, I joined @datologyai.com to give wings to the data research I had been doing in academia. Today, I am absolutely thrilled to share what we’ve been working on! Techvember Ep 2: How we made the #1 LLM Pre-training Data Recipe. Blog: 👉 tinyurl.com/best-llm-data 🧵
1154
Reposted by Jonathan Frankle
Andrew Drozdov @mrdrozdov.com · 20/11/2024
Mat is not on 🦋—posting on his behalf! It's time to revisit common assumptions in IR! Embeddings have improved drastically, but mainstream IR evals have stagnated since MSMARCO + BEIR. We ask: on private or tricky IR tasks, are rerankers better? Surely, reranking many docs is best?
A plot showing that reranking improves recall as we increase the number of reranked docs, but with increasing docs we diminishing returns and eventually a performance dip.
48224
Jonathan Frankle @jfrankle.com · 15/11/2024
Incredibly excited for the team at @datologyai.bsky.social for huge progress on data efficiency for CLIP model training. I'm a big fan of lines that go up and to the left, and this is a really substantial improvement.
290
Jonathan Frankle @jfrankle.com · 14/11/2024
Hi AI friends - I'm trying to find everyone again. Please let me know if you're here so I can follow you!
3214
Jonathan Frankle @jfrankle.com · 13/11/2024
👋
370