Sign in

Andrew Drozdov

@mrdrozdov.com
5.4K followers 611 following 185 posts

Search and Agents @ Databricks

PostsRepliesMedia
Andrew Drozdov @mrdrozdov.com · 23/09/2026
not me :)
000
Andrew Drozdov @mrdrozdov.com · 23/09/2026
not me!
000
Andrew Drozdov @mrdrozdov.com · 23/09/2026
lol not me
000
Andrew Drozdov @mrdrozdov.com · 23/09/2026
So many cool papers this week, and it's only Tuesday.
020
Andrew Drozdov @mrdrozdov.com · 22/09/2026
This week I'll have a long talk with @yacinemahdid.bsky.social about KARL and all things retrieval, and couldn't be looking forward to it more. substack.com/@yacinelearn...
substack.com
Yacine Mahdid (@yacinelearning)
I'll have the pleasure this week to interview andrew drozdov senior research scientist at databricks on all things retrievals like: - RL for knowledge agents (see KARL) - learning representation pro...
010
Andrew Drozdov @mrdrozdov.com · 19/08/2025
We built a thing! The Databricks Reranker is now in Public Preview. It's as easy as changing the arguments to your vector search call, and doesn't require any additional setup. Read more: www.databricks.com/blog/reranki...
databricks.com
Reranking in Mosaic AI Vector Search for Faster, Smarter Retrieval in RAG Agents
Boost RAG agent quality with reranking—deliver more relevant answers in less time with a single parameter in Mosaic AI Vector Search.
051
Reposted by Andrew Drozdov
Mark Riedl @markriedl.bsky.social · 12/04/2025
The transformer was invented in Google. RLHF was not invented in industry labs, but came to prominence in OpenAI and DeepMind. I took 5 of the most influential papers (black dots) and visualized their references. Blue dots are papers that acknowledge federal funding (DARPA, NSF).
210924
Reposted by Andrew Drozdov
Florina Piroi @flrp.bsky.social · 11/04/2025
LongEval is turning three this year! This is a Call for Participation to our CLEF 2025 Lab - try out how your IR system does in the long term. Check the details on our page: clef-longeval.github.io
clef-longeval.github.io
LongEval 2025
Conference Template
083
Andrew Drozdov @mrdrozdov.com · 13/04/2025
The PhD is pretraining. Interview prep is alignment. Take this to heart. :)
030
Reposted by Andrew Drozdov
Marzena Karpinska @markar.bsky.social · 02/04/2025
We have updated #nocha, a leaderboard for reasoning over long-context narratives 📖, with some new models including #Gemini 2.5 Pro which shows massive improvements over the previous version! Congrats to #Gemini team 🪄 🧙 Check 🔗 novelchallenge.github.io for details :)
Leaderboard showing performance of language models on claim verification task over book-length input. o1-preview is the best model with 67.36% accuracy followed by Gemini 2.5 Pro with 64.17% accuracy.
0114
Andrew Drozdov @mrdrozdov.com · 28/03/2025
I think ARR used to do this? Seems like it’s missing in the recent cycle(s). stats.aclrollingreview.org/iterations/2...
stats.aclrollingreview.org
ARR Dashboard
030
Andrew Drozdov @mrdrozdov.com · 22/03/2025
A corollary here is that a relevant context might not improve the probability of the right answer.
000
Andrew Drozdov @mrdrozdov.com · 22/03/2025
Perhaps the most misunderstood aspect of retrieval: For a context to be relevant, it is not enough for it to improve the probability of the right answer.
110
Reposted by Andrew Drozdov
Daniel Liden @danliden.com · 14/03/2025
MLflow is on BlueSky! Follow @mlflow.org to keep up to date on new releases, blogs and tutorials, events, and more.
bsky.app
041
Andrew Drozdov @mrdrozdov.com · 12/03/2025
ris.utwente.nl/ws/portalfil...
ris.utwente.nl
000
Andrew Drozdov @mrdrozdov.com · 12/03/2025
---Born To Add, Sesame Street ---(sung to the tune of Bruce Springsteen’s Born to Run)
100
Andrew Drozdov @mrdrozdov.com · 12/03/2025
One, and two, and three police persons spring out of the shadows Down the corner comes one more And we scream into that city night: “three plus one makes four!” Well, they seem to think we’re disturbing the peace But we won’t let them make us sad ’Cause kids like you and me baby, we were born to add
100
Andrew Drozdov @mrdrozdov.com · 11/03/2025
"How Claude Code is using a 50-Year-Old trick to revolutionize programming"
020
Andrew Drozdov @mrdrozdov.com · 11/03/2025
Somehow my most controversial take of 2025 is that agents relying on grep are a form of RAG.
020
Andrew Drozdov @mrdrozdov.com · 26/02/2025
Embedding finetuning is not a new idea, but it's still overlooked IMO. The promptagator work is one of the more impactful papers that show finetuning with synthetic data is effective. arxiv.org/abs/2209.11755
arxiv.org
Promptagator: Few-shot Dense Retrieval From 8 Examples
Much recent research on information retrieval has focused on how to transfer from one task (typically with abundant supervised data) to various other tasks where supervision is limited, with the impli...
020
Andrew Drozdov @mrdrozdov.com · 26/02/2025
Search is the key to building trustworthy AI and will only be more important as we build more ambitious applications. With that in mind, there's not nearly enough energy spent improving the quality of search systems. Follow the link for the full episode: www.linkedin.com/posts/data-b...
linkedin.com
Data Brew by Databricks on LinkedIn: Join us on the latest Data Brew episode for a deep dive on Retrieval…
Join us on the latest Data Brew episode for a deep dive on Retrieval, rerankers, and RAG tips and tricks with our very own Andrew Drozdov, Research Scientist…
030
Andrew Drozdov @mrdrozdov.com · 26/02/2025
It was a real pleasure talking about effective IR approaches with Brooke and Denny on the Data Brew podcast. Among other things, I'm excited about embedding finetuning and reranking as modular ways to improve RAG pipelines. Everyone should use these more!
180
Andrew Drozdov @mrdrozdov.com · 26/02/2025
We're probably a little too obsessed with zero-shot retrieval. If you have documents (you do), then you can generate synthetic data, and finetune your embedding. Blog post lead by @jacobianneuro.bsky.social shows how well this works in practice. www.databricks.com/blog/improvi...
databricks.com
Improving Retrieval and RAG with Embedding Model Finetuning
Fine-tune embedding models on Databricks to enhance retrieval and RAG accuracy with synthetic data—no manual labeling required.
195
Andrew Drozdov @mrdrozdov.com · 01/02/2025
I do want to see aggregate stats about the model’s generation and total reasoning tokens is perhaps the least informative one.
020
Andrew Drozdov @mrdrozdov.com · 26/01/2025
"All you need to build a strong reasoning model is the right data mix." The pipeline that creates the data mix:
1131
Andrew Drozdov @mrdrozdov.com · 23/01/2025
After frequent road runs during a Finland visit I tend to feel the same
030
Andrew Drozdov @mrdrozdov.com · 22/01/2025
Using 100+ tokens to answer 2 + 3 =
1180
Andrew Drozdov @mrdrozdov.com · 27/12/2024
It’s pretty obvious we’re in a local minima for pretraining. Would expect more breakthroughs in the 5-10 year range. Granted, it’s still incredibly hard and expensive to do good research in this space, despite the number of labs working on it.
1100
Reposted by Andrew Drozdov
Susie Dent @susiedentwords.bsky.social · 23/12/2024
Word of the day (of course) is ‘scurryfunging’, from US dialect: the frantic attempt to tidy the house just before guests arrive.
1073260563
Reposted by Andrew Drozdov
kyunghyuncho.bsky.social @kyunghyuncho.bsky.social · 21/12/2024
... didn't know this would be one of the hottest takes i've had ... for more on my thoughts, see drive.google.com/file/d/1sk_t...
3497
Reposted by Andrew Drozdov
kyunghyuncho.bsky.social @kyunghyuncho.bsky.social · 21/12/2024
feeling a but under the weather this week … thus an increased level of activity on social media and blog: kyunghyuncho.me/i-sensed-anx...
kyunghyuncho.me
i sensed anxiety and frustration at NeurIPS’24 – Kyunghyun Cho
1917836
Reposted by Andrew Drozdov
Sumit @reachsumit.com · 20/12/2024
Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference Introduces ModernBERT, a bidirectional encoder advancing BERT-like models with 8K context length. 📝 arxiv.org/abs/2412.13663 👨🏽‍💻 github.com/AnswerDotAI/...
arxiv.org
Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference
Encoder-only transformer models such as BERT offer a great performance-size tradeoff for retrieval and classification tasks with respect to larger decoder-only models. Despite being the workhorse of n...
0173
Reposted by Andrew Drozdov
Sumit @reachsumit.com · 20/12/2024
State Space Models are Strong Text Rerankers Shows Mamba-based models achieve comparable reranking performance to transformers while being more memory efficient, with Mamba-2 outperforming Mamba-1. 📝 arxiv.org/abs/2412.14354
arxiv.org
State Space Models are Strong Text Rerankers
Transformers dominate NLP and IR; but their inference inefficiencies and challenges in extrapolating to longer contexts have sparked interest in alternative model architectures. Among these, state spa...
041
Reposted by Andrew Drozdov
Matthew Kollmer @matthewkollmer.com · 19/12/2024
I’m being facetious, but the truth behind the joke is that OCR correction opens up the possibility (and futility) of language much like drafting poetry. For every interpreted pattern for optimizing OCR correction, exceptions arise. So, too, with patterns in poetry.
121
Andrew Drozdov @mrdrozdov.com · 19/12/2024
Wait can you say more
100
Andrew Drozdov @mrdrozdov.com · 17/12/2024
Reasoning is fascinating but confusing. Is reasoning a task? Or is reasoning a method for generating answers, for any task?
440
Reposted by Andrew Drozdov
Will Whitney @wfwhitney.bsky.social · 14/12/2024
The future of AI is models that generate graphical interfaces. Instead of the linear, low-bandwidth metaphor of conversation, models will represent themselves to us as computers: rich visuals, direct manipulation, and instant feedback. willwhitney.com/computing-in...
willwhitney.com
Computing inside an AI | Will Whitney
67215
Reposted by Andrew Drozdov
Science News @scinews.bsky.social · 24/11/2024
Three must read papers for PhD students. #scisky #PhD #science #research #academicsky 1. The importance of stupidity in scientific research Open Access journals.biologists.com/jcs/article/...
551236466
Andrew Drozdov @mrdrozdov.com · 14/12/2024
In any given year there are between one and three Friday the 13ths. This year there are two. 👻
040
Reposted by Andrew Drozdov
Jonathan Frankle @jfrankle.com · 13/12/2024
Reflections on NeurIPS: There's always a big theme people seem to be preoccupied with. This year, it was the continuation of scaling/progress. Will it continue? What will the next generation of models hold? I even got to sass Dylan Patel (not on bsky) over it. Here are my personal thoughts 🧵
35911
Reposted by Andrew Drozdov
Cody Blakeney ✈️ NeurIPS 2024 @codestar.bsky.social · 11/12/2024
The databricks have arrived
1182
Andrew Drozdov @mrdrozdov.com · 09/12/2024
Yep! Slides are linked on the tutorial site: retrieval-enhanced-ml.github.io/sigir-ap2024...
retrieval-enhanced-ml.github.io
SIGIR-AP 2024 Tutorial: Retrieval-Enhanced Machine Learning: Synthesis and Opportunities
SIGIR-AP 2024 Tutorial: Retrieval-Enhanced Machine Learning: Synthesis and Opportunities
110
Andrew Drozdov @mrdrozdov.com · 09/12/2024
Slides are up! I presented on "Presentation & Consumption in the context of REML" The full deck is here. There's a lot of gems if you're interested in this space! retrieval-enhanced-ml.github.io/sigir-ap2024...
0156
Reposted by Andrew Drozdov
Andrew Drozdov @mrdrozdov.com · 09/12/2024
Today we'll be presenting the Tutorial on Retrieval-Enhanced Machine Learning (REML). Come by to learn about the emerging design patterns in this space and see how to use retrieval beyond RAG. In collaboration w/ the amazing @841io.bsky.social @teknology.bsky.social Alireza Salemi and Hamed Zamani.
1223
Andrew Drozdov @mrdrozdov.com · 09/12/2024
Today we'll be presenting the Tutorial on Retrieval-Enhanced Machine Learning (REML). Come by to learn about the emerging design patterns in this space and see how to use retrieval beyond RAG. In collaboration w/ the amazing @841io.bsky.social @teknology.bsky.social Alireza Salemi and Hamed Zamani.
1223
Andrew Drozdov @mrdrozdov.com · 07/12/2024
I guess it's not an official ad. bsky.app/profile/why....
000
Andrew Drozdov @mrdrozdov.com · 07/12/2024
You should checkout dspy! The correct answer is not to do a grid search at all, but treat this like an optimization problem.
020
Andrew Drozdov @mrdrozdov.com · 06/12/2024
Few things that are revolutionizing retrieval research right now: 1. content-based models have gotten much better 2. synthetic data has increased the value of small specialized datasets 3. retrieval is becoming a more important component in a variety of AI applications
030
Andrew Drozdov @mrdrozdov.com · 06/12/2024
Reading articles that 🦋 might get into advertising, and I'm not sure this is what they meant 😅
120
Andrew Drozdov @mrdrozdov.com · 06/12/2024
Seen in NYC
3211