Sign in

Sweta Karlekar

@swetakar.bsky.social
2.7K followers 1.2K following 33 posts

Machine learning PhD student @ Blei Lab in Columbia University Working in mechanistic interpretability, nlp, causal inference, and probabilistic modeling! Previously at Meta for ~3 years on the Bayesian Modeling & Generative AI teams. 🔗 www.sweta.dev

PostsRepliesMedia
Sweta Karlekar @swetakar.bsky.social · 31/01/2026
For those in NYC working in AI, ML-NYC is a free monthly speaker series co-organized by the Flatiron Institute, Columbia, and NYU. Past speakers include Bin Yu, Christos Papadimitriou, Léon Bottou (and many more). Talks are followed by a catered reception. Join us Feb 11th @ 4pm for Romain Lopez!
020
Reposted by Sweta Karlekar
Blei Lab @bleilab.bsky.social · 03/12/2025
Excited to highlight recent work from the lab at NeurIPS! If you’re interested in understanding why uncertainty estimates often break under distribution shift — and how we can do better — check out Yuli’s poster tomorrow.
041
Sweta Karlekar @swetakar.bsky.social · 02/12/2025
The ML in NYC Speaker Series + Happy Hour is excited to host Professor Daniel Björkegren as our December speaker as he speaks about AI for Low-Income Countries! Registration: www.eventbrite.com/e/ml-nyc-spe...
eventbrite.com
ML-NYC Speaker Series and Happy Hour: Daniel Björkegren
AI for Low-Income Countries
020
Reposted by Sweta Karlekar
Nicolas Beltran-Velez @velezbeltran.bsky.social · 12/12/2024
Hello! We will be presenting Estimating the Hallucination Rate of Generative AI at NeurIPS. Come if you'd like to chat about epistemic uncertainty for In-Context Learning, or uncertainty more generally. :) Location: East Exhibit Hall A-C #2703 Time: Friday @ 4:30 Paper: arxiv.org/abs/2406.07457
0234
Reposted by Sweta Karlekar
Andrew Jesson @anndvision.bsky.social · 13/12/2024
fun @bleilab.bsky.social x oatml collab come chat with Nicolas , @swetakar.bsky.social , Quentin , Jannik , and i today
1101
Reposted by Sweta Karlekar
Blei Lab @bleilab.bsky.social · 02/12/2024
Check out our new paper from the Blei Lab on probabilistic predictions with conditional diffusions and gradient boosted trees! #Neurips2024
0326
Reposted by Sweta Karlekar
Blei Lab @bleilab.bsky.social · 10/12/2024
Check out our new paper about hypothesis testing the circuit hypothesis in LLMs! This work previously won a top paper award at the ICML mechanistic interpretability workshop, and we’re excited to share it at #Neurips2024
071
Reposted by Sweta Karlekar
Ben Burtenshaw @benburtenshaw.bsky.social · 03/12/2024
For anyone interested in fine-tuning or aligning LLMs, I’m running this free and open course called smol course. It’s not a big deal, it’s just smol. 🧵>>
932363
Sweta Karlekar @swetakar.bsky.social · 02/12/2024
Very happy to share some recent work by my colleagues @velezbeltran.bsky.social, @aagrande.bsky.social and @anazaret.bsky.social! Check out their work on tree-based diffusion models (especially the website—it’s quite superb 😊)!
1151
Sweta Karlekar @swetakar.bsky.social · 29/11/2024
Just learned about @andrewyng.bsky.social's new tool, aisuite (github.com/andrewyng/ai...) and wanted to share! It's a standardized wrapper around chat completions that lets you easily switch between querying different LLM providers, including OpenAI, Anthropic, Mistral, HuggingFace, Ollama, etc.
github.com
GitHub - andrewyng/aisuite: Simple, unified interface to multiple Generative AI providers
Simple, unified interface to multiple Generative AI providers - GitHub - andrewyng/aisuite: Simple, unified interface to multiple Generative AI providers
1223
Reposted by Sweta Karlekar
Jakub M. Tomczak @jmtomczak.bsky.social · 27/11/2024
Test of Time Paper Awards are out! 2014 was a wonderful year with lots of amazing papers. That's why, we decided to highlight two papers: GANs (@ian-goodfellow.bsky.social et al.) and Seq2Seq (Sutskever et al.). Both papers will be presented in person 😍 Link: blog.neurips.cc/2024/11/27/a...
blog.neurips.cc
Announcing the NeurIPS 2024 Test of Time Paper Awards  – NeurIPS Blog
110914
Reposted by Sweta Karlekar
Martin Wattenberg @wattenberg.bsky.social · 23/11/2024
The Gini coefficient is the standard way to measure inequality, but what does it mean, concretely? I made a little visualization to build intuition: www.bewitched.com/demo/gini
Many circles of different sizes, representing a visualization of inequality
1020157
Reposted by Sweta Karlekar
Christoph Molnar @christophmolnar.bsky.social · 15/11/2024
Interested in machine learning in science? Timo and I recently published a book, and even if you are not a scientist, you'll find useful overviews of topics like causality and robustness. The best part is that you can read it for free: ml-science-book.com
712929
Reposted by Sweta Karlekar
Jake Handy @jakehandy.com · 22/11/2024
new paper from Anthropic on LLM evaluation recommendations www.anthropic.com/research/sta...
anthropic.com
A statistical approach to model evaluations
A research paper from Anthropic on how to apply statistics to improve language model evaluations
0131
Reposted by Sweta Karlekar
Christoph Molnar @christophmolnar.bsky.social · 22/11/2024
Just realized BlueSky allows sharing valuable stuff cause it doesn't punish links. 🤩 Let's start with "What are embeddings" by @vickiboykis.com The book is a great summary of embeddings, from history to modern approaches. The best part: it's free. Link: vickiboykis.com/what_are_emb...
Book outlineOver the past decade, embeddings — numerical representations of
machine learning features used as input to deep learning models — have
become a foundational data structure in industrial machine learning
systems. TF-IDF, PCA, and one-hot encoding have always been key tools
in machine learning systems as ways to compress and make sense of
large amounts of textual data. However, traditional approaches were
limited in the amount of context they could reason about with increasing
amounts of data. As the volume, velocity, and variety of data captured
by modern applications has exploded, creating approaches specifically
tailored to scale has become increasingly important.
Google’s Word2Vec paper made an important step in moving from
simple statistical representations to semantic meaning of words. The
subsequent rise of the Transformer architecture and transfer learning, as
well as the latest surge in generative methods has enabled the growth
of embeddings as a foundational machine learning data structure. This
survey paper aims to provide a deep dive into what embeddings are,
their history, and usage patterns in industry.Cover image
22647101
Sweta Karlekar @swetakar.bsky.social · 20/11/2024
(Shameless) plug for David Blei's lab at Columbia University! People in the lab currently work on a variety of topics, including probabilistic machine learning, Bayesian stats, mechanistic interpretability, causal inference and NLP. Please give us a follow! @bleilab.bsky.social
1203
Reposted by Sweta Karlekar
Nicolas Beltran-Velez @velezbeltran.bsky.social · 20/11/2024
We created an account for the Blei Lab! Please drop a follow 😊 @bleilab.bsky.social
031
Reposted by Sweta Karlekar
Carlos E. Perez (IntuitMachine) @ceperez.bsky.social · 20/11/2024
Almost 3x faster than FlashAttentiion2 github.com/thu-ml/SageA...
github.com
GitHub - thu-ml/SageAttention: Quantized Attention that achieves speedups of 2.1x and 2.7x compared to FlashAttention2 and xformers, respectively, without lossing end-to-end metrics across various mod...
Quantized Attention that achieves speedups of 2.1x and 2.7x compared to FlashAttention2 and xformers, respectively, without lossing end-to-end metrics across various models. - thu-ml/SageAttention
061
Reposted by Sweta Karlekar
Martyn Plummer @martynplummer.bsky.social · 19/11/2024
📢 Post-Bayesian online seminar series coming!📢 To stay posted, sign up at tinyurl.com/postBayes We'll discuss cutting-edge methods for posteriors that no longer rely on Bayes Theorem. (e.g., PAC-Bayes, generalised Bayes, Martingale posteriors, ...) Pls circulate widely!
tinyurl.com
Mailing list contact information
Information to be added to the post-Bayes mailing list.
0166
Reposted by Sweta Karlekar
Catherine Breslin @catherinebreslin.bsky.social · 19/11/2024
Starter packs I found: AI (*about* AI, not *for* an AI) go.bsky.app/SipA7it Spoken Language Processing bsky.app/starter-pack... Diversify Tech's pack bsky.app/starter-pack... Women in Tech bsky.app/starter-pack... Great UK Commentators bsky.app/starter-pack... Linguistics bsky.app/starter-pack...
3203
Sweta Karlekar @swetakar.bsky.social · 19/11/2024
I'm TAing for a class and wanted to put together a (short) list of papers that are a good, accessible intro for students to get started in mech interp. An ask for the community: what papers would you add / which papers am I missing? (1/n)
transformer-circuits.pub
A Mathematical Framework for Transformer Circuits
3324
Sweta Karlekar @swetakar.bsky.social · 19/11/2024
If you’re interested in mechanistic interpretability, I just found this starter pack and wanted to boost it (thanks for creating it @butanium.bsky.social !). Excited to have a mech interp community on bluesky 🎉 go.bsky.app/LisK3CP
3368
Sweta Karlekar @swetakar.bsky.social · 18/11/2024
For anyone looking for climate-related data for ML projects, I recently learned about www.saildrone.com/technology/d.... Saildrone builds ocean drones that collect a ton of oceanic and climate data. And they have some publicly-available datasets on their website for researchers :) 🌊 #mlsky
saildrone.com
Browse Sample Data Sets – Saildrone
Browse publicly available sample data sets from completed Saildrone missions, available for download in NetCDF format.
2131
Reposted by Sweta Karlekar
Mark Rubin @markrubin.bsky.social · 18/11/2024
Nice article by @nedpotter.bsky.social includes a link to a BlueSky Directory of Starter Packs... #AcademicSky #PhDSky
blueskydirectory.com
All - Bluesky Directory
A curated collection of all things relating to the Blue Sky social media platform.
1179
Reposted by Sweta Karlekar
Tim G. J. Rudner @timrudner.bsky.social · 17/11/2024
I made a starter pack for researchers in probabilistic machine learning. DM/reply if you want to be added! go.bsky.app/DuCtJqC
6610536