Reposted by jeffcarpSung Kim @sungkim.bsky.social · 06/03/2025A Waymo vehicle was driving in a 25mph zone in LA when an oncoming car swerved into its lane while speeding up to over 70mph… 3x the speed means 9x the destructive energy. Waymo vehicle reacted safely. Source: Dmitri Dolgov (Co-CEO at waymo) 0388
Reposted by jeffcarpSung Kim @sungkim.bsky.social · 04/03/2025Awesome LLM Post-training This repository is a curated collection of the most influential papers, code implementations, benchmarks, and resources related to Large Language Models (LLMs) Post-Training Methodologies. github.com/mbzuai-oryx/... 14610
jeffcarp @jeffcarp.bsky.social · 03/03/2025Thanks for reposting my video. I think Waymo also solves the critical urban problem of literally not having people dying every day for no reason 130
Reposted by jeffcarpSung Kim @sungkim.bsky.social · 04/02/2025How to Scale Your Model This book aims to demystify the science of scaling language models on TPUs: how TPUs work and how they communicate with each other, how LLMs run on real hardware, and how to parallelize your models during training and inference so they run efficiently at massive scale. 1122
Reposted by jeffcarpEugene Vinitsky 🍒 @eugenevinitsky.bsky.social · 01/02/2025That immigrants, from China, India, Iran, Latin America, and so many places choose to come here is a blessing and a gift. That this needs to be said and that politicians ever make them feel otherwise is an eternal disappointment. 2311
Reposted by jeffcarpSung Kim @sungkim.bsky.social · 31/01/2025A vision researcher’s guide to some RL stuff: PPO & GRPO by Yuge (Jimmy) Shi This is a deep dive into Proximal Policy Optimization (PPO), which is one of the most popular algorithm used in RLHF for LLMs, as well as Group Relative Policy Optimization (GRPO) proposed by the DeepSeek folks. 1225
Reposted by jeffcarpKuan Hoong @kuanhoong.bsky.social · 10/01/2025The PyTorch developer's guide to JAX fundamentals cloud.google.com/blog/product...cloud.google.comA guide to JAX for PyTorch developers | Google Cloud BlogPyTorch users can learn about JAX in this tutorial that connects JAX concepts to the PyTorch building blocks that they’re already familiar with. 0165
Reposted by jeffcarpJenn Sydeski 🧬 📈 🩺 ⛑️ @jennifersydeski.com · 31/12/2024#2025 is the sum of the first 9 cubes 🤩 1+8+27+64+125+216+343+512+729 🥂 🎉 🎆 🎇 🧮 98019
Reposted by jeffcarpEugene Vinitsky 🍒 @eugenevinitsky.bsky.social · 31/12/2024Would be fascinated to learn how this paper came into being given the authors on it: arxiv.org/abs/2412.05747arxiv.orgCharting the Shapes of Stories with Game TheoryStories are records of our experiences and their analysis reveals insights into the nature of being human. Successful analyses are often interdisciplinary, leveraging mathematical tools to extract str... 1448
Reposted by jeffcarpMinsuk Chang @minsuk.bsky.social · 22/12/2024Applications open on Dec 20 for the #Research Scholar program, which aims to strengthen long-term collaboration with the academic community by supporting early-career professors pursuing research in fields relevant to #Google. Learn more & apply by Jan 27 ↓ research.google/programs-and...research.googleResearch scholar programOverview 13810
Reposted by jeffcarpEugene Vinitsky 🍒 @eugenevinitsky.bsky.social · 18/12/2024A short list of tips for keeping a clean, organized ML codebase for new researchers: eugenevinitsky.com/posts/quick-...eugenevinitsky.comEugene Vinitsky 1213830
jeffcarp @jeffcarp.bsky.social · 12/12/2024If machine learning is the high-interest credit card of technical debt, quantization is the back alley predatory loan 000
Reposted by jeffcarpSimon Willison @simonwillison.net · 11/12/2024Gemini 2.0 is out, and there's a ton of interesting stuff about it. From my testing it looks like Gemini 2.0 Flash may be the best currently available multi-modal model - I upgraded my LLM plugin to support that here: github.com/simonw/llm-g... Gemini 2.0 announcement: blog.google/technology/g...github.comRelease 0.7 · simonw/llm-geminiNew Gemini 2.0 Flash model: llm -m gemini-2.0-flash-exp 'prompt goes here'. #28 312917
jeffcarp @jeffcarp.bsky.social · 09/12/2024Going full circle: in 2019 Waymo made an April Fools video about a dog-only robotaxi service. Now people are actually sending their dogs in Waymo unattended. youtu.be/ljbeFpOHvEA?... 030
Reposted by jeffcarpSung Kim @sungkim.bsky.social · 09/12/2024Reinforcement Learning: An Overview This manuscript gives a big-picture, up-to-date overview of the field of (deep) reinforcement learning and sequential decision making, covering value-based RL, policy-gradient methods, model-based methods, and various other topics. arxiv.org/abs/2412.05265 0548
Reposted by jeffcarpGus @gusthema.bsky.social · 07/12/2024Happy Birthday to Gemini! ✨🎂 Around this time last year, I was working on the Gemini Launch and it was exciting to have access to such models After one year I've learned a lot and I'm still amazed of what can be done! best feature: 2M context window 🤯 developers.googleblog.com/en/looking-b...developers.googleblog.comLooking back at the first year of the Gemini eraGoogle's Gemini family of AI models has empowered developers to build innovative applications and explore its journey over the first year. 3242
jeffcarp @jeffcarp.bsky.social · 08/12/2024I’m late to the game here, but super impressed this UI is an open source React Native app, the framework has come a long way! 020
Reposted by jeffcarpMinsuk Chang @minsuk.bsky.social · 06/12/2024Derek Sivers once said “Mastery is the best goal because the rich can’t buy it, the impatient can’t rush it, the privileged can’t inherit it, and nobody can steal it. You can only earn it through hard work. Mastery is the ultimate status.” Does it still hold in the age of LLMs? 😎 2113
Reposted by jeffcarpAlexander Kolesnikov @handle.invalid · 05/12/2024Paligemma2 is out! Bigger models, better results. For the best experience, do not forget to finetune. Congrats Paligemma2 team! 0131
Reposted by jeffcarpChristian Wolf @chriswolfvision.bsky.social · 01/12/2024Is this a correct description of how fields cross-pollinated each other? - CV and speech jump-started deep learning - NLP innovated with transformers, which were then copied by CV and others - Robotics and CV embraced RL early on - NLP now discovers RL, first through RLHF and now for planning. 7364