Sign in

Doug Turnbull

@softwaredoug.bsky.social
889 followers 138 following 566 posts

Search at Reddit, formerly Shopify and OpenSource Connections. Helped write Relevant Search / AI Powered Search softwaredoug.com

PostsRepliesMedia
Reposted by Doug Turnbull
turbopuffer @turbopuffer.bsky.social · 5h
we're changing tpuf's storage architecture so we can keep pushing the search frontier the new engine (v3) now passes CI, but we have to make it fast before we ship it to prod we're grinding query plans in public until v3 wins on everything follow along: turbopuffer.com/v3
011
Doug Turnbull @softwaredoug.bsky.social · 29/09/2026
000
Doug Turnbull @softwaredoug.bsky.social · 29/09/2026
Hang out with me and Mr. Tunkelang at 1PM ET today :) maven.com/p/1f1f46/ir-...
maven.com
IR Today: Theory, Practice, and Agents
LLMs and agentic search have dominated search in 2026. Daniel will give his observations after attending SIGIR, the world’s leading conference on search and information retrieval, as well as reflectin...
010
Doug Turnbull @softwaredoug.bsky.social · 29/09/2026
My talk today: Embeddings Don't Solve RAG www.youtube.com/watch?v=kBFs...
youtube.com
Embeddings Don't Solve RAG
YouTube video by Doug Turnbull
000
Doug Turnbull @softwaredoug.bsky.social · 28/09/2026
Next weeks training should be fun, hope you can make it
100
Doug Turnbull @softwaredoug.bsky.social · 28/09/2026
In one week, I'm going to be giving the last Cheat at Search w/ Agents in 2026. Hope you can make it! maven.com/softwaredoug...
maven.com
Cheat at Search with Agents by Doug Turnbull on Maven
Rethink search to put tireless agents at work for human users
000
Doug Turnbull @softwaredoug.bsky.social · 27/09/2026
OK it's a little more than a week until I teach people about modern Agentic RAG. Then I have to go past shitposting and get hands on. maven.com/softwaredoug...
maven.com
Cheat at Search with Agents by Doug Turnbull on Maven
Rethink search to put tireless agents at work for human users
000
Doug Turnbull @softwaredoug.bsky.social · 25/09/2026
We'll hear from Adam Hevenor an 1.5 hours on his fun work with agentic memory at Retrieval Augmented Gathering, hope you can make it! maven.com/lls/f27953
maven.com
RAG: Retrieval Augmented Gathering | Maven
Live courses with real-world experts in AI, Product, Leadership, Design, Data & engineering, Marketing & sales, and Business & finance.
001
Doug Turnbull @softwaredoug.bsky.social · 24/09/2026
Allow commercial-in-residential to support your local taco shop
010
Doug Turnbull @softwaredoug.bsky.social · 24/09/2026
We're finally building more housing, tell Council you support it www.reddit.com/r/Charlottes...
reddit.com
From the Charlottesville community on Reddit: We're finally building more housing. Tell Council you support it.
Posted by softwaredoug - 1 vote and 0 comments
010
Doug Turnbull @softwaredoug.bsky.social · 24/09/2026
This is so cool to see for Charlottesville City, but its going to be under threat in 2027 if housing skeptics get elected to Council fred.stlouisfed.org/series/BPPRI...
fred.stlouisfed.org
New Private Housing Structures Authorized by Building Permits for Charlottesville City, VA
New Private Housing Structures Authorized by Building Permits for Charlottesville City, VA
120
Doug Turnbull @softwaredoug.bsky.social · 23/09/2026
Cheat at Search starts in 1.5 weeks You: A search developer that wants to understand LLMs, Agents, and RAG Me: Someone who has built production AI search agents at Reddit, Shopify, and various startups I want to help :) maven.com/softwaredoug...
000
Doug Turnbull @softwaredoug.bsky.social · 23/09/2026
See everyone in 35 minutes :) maven.com/p/2acdeb/ten...
maven.com
Tensors in the Search Engine (Why?)
RAG and Agentic search requires vector search. And increasingly multi-vector retrieval. Vespa's tensor feature implements vector search. "How are tensors better than vectors?" is a common follow-up q...
010
Doug Turnbull @softwaredoug.bsky.social · 23/09/2026
All hail our lord and savior Jevus softwaredoug.com/blog/2026/09...
softwaredoug.com
Cheating at search with jev
Kicking the tires of jev for a very basic query understanding task
161
Doug Turnbull @softwaredoug.bsky.social · 22/09/2026
Next up in Retrieval Augmented Gathering This afternoon (1PM ET) we'll hear from Kumar Shivendu of @qdrant.bsky.social on doing neural search with no query-time inference
111
Doug Turnbull @softwaredoug.bsky.social · 21/09/2026
Price going up to $1450 in a few hours maven.com/softwaredoug...
maven.com
Cheat at Search with Agents by Doug Turnbull on Maven
Rethink search to put tireless agents at work for human users
000
Doug Turnbull @softwaredoug.bsky.social · 21/09/2026
Career Q&A recap from Friday www.youtube.com/watch?v=N8Gn...
youtube.com
Employers don't know how to hire for search
YouTube video by Doug Turnbull
000
Doug Turnbull @softwaredoug.bsky.social · 21/09/2026
In 24 hours I increase price for October's Cheat at Search It's an important class: I explore how LLMs and retrieval intersect. From query understanding with LLMs to LLM as a judge, to exploring whether all search is now agentic maven.com/softwaredoug...
maven.com
Cheat at Search with Agents by Doug Turnbull on Maven
Rethink search to put tireless agents at work for human users
000
Doug Turnbull @softwaredoug.bsky.social · 19/09/2026
I think a lot about the quote "A computer can never be held accountable, therefore a computer must never make a management decision" these days Except I think it applies to any 'decision', not just management. It's your code, not the AI's code
052
Doug Turnbull @softwaredoug.bsky.social · 17/09/2026
I read Brian Pedersen's data on what Search hiring teams are looking for and wrote about my own pointers for job seekers. One big danger for search professionals: keeping your head in the sand. Participate in community, in whatever form that can take for you. softwaredoug.com/blog/2026/09...
softwaredoug.com
Pointers for your search career in 2026
What you should be thinking of as you consider search + retrieval roles
000
Doug Turnbull @softwaredoug.bsky.social · 17/09/2026
Retrieval Augmented Gathering starting tomorrow with a search career Q&A. Hope you can make it! maven.com/lls/f27953
maven.com
RAG: Retrieval Augmented Gathering | Maven
Live courses with real-world experts in AI, Product, Leadership, Design, Data & engineering, Marketing & sales, and Business & finance.
010
Doug Turnbull @softwaredoug.bsky.social · 16/09/2026
Price will increase to $1450 on Friday for October's cohort. Hope you can make it maven.com/softwaredoug...
maven.com
Cheat at Search with Agents by Doug Turnbull on Maven
Rethink search to put tireless agents at work for human users
000
Doug Turnbull @softwaredoug.bsky.social · 15/09/2026
Over the next few weeks, we'll have a series of talks on retrieval, RAG, agentic memory, agentic search and more - come hang out! maven.com/lls/f27953
maven.com
RAG: Retrieval Augmented Gathering | Maven
Live courses with real-world experts in AI, Product, Leadership, Design, Data & engineering, Marketing & sales, and Business & finance.
040
Doug Turnbull @softwaredoug.bsky.social · 14/09/2026
It's 2026 and this still needs to be said :) maven.com/p/74f7ed/emb...
maven.com
Embeddings don't solve RAG
You've been fed a false narrative. That RAG means embeddings. Ask a retrieval engineer they'll only be one small piece of a good RAG solution. By questioning embeddings as a search solution, we'll tak...
010
Doug Turnbull @softwaredoug.bsky.social · 11/09/2026
On the road to my Cheat at Search w/ Agents course we'll have Brian Pedersen of The Search Bar with a Q&A on search + AI career Bring your tough questions! maven.com/p/2b0df3/sea...
maven.com
Search and AI Career Q&A
It's scary out there. Skills we thought would be timeless are being brought into question. We're all being asked to relearn our career as agentic coding continues to eat software development. Search r...
012
Reposted by Doug Turnbull
Livable Cville @livablecville.bsky.social · 03/09/2026
Good morning everyone - here’s some good housing news to start your day!
0195
Reposted by Doug Turnbull
dman-os @dman-os.bsky.social · 31/08/2026
first time I came across this verdik.substack.com/p/how-to-get...
verdik.substack.com
How to Get Consistent Classification From Inconsistent LLMs?
A technique for deterministic labeling from stochastic models, with benchmarked Golang implementation.
132
Doug Turnbull @softwaredoug.bsky.social · 31/08/2026
It's down to the wire folks, Hugo and I are teaching in 1 hour! maven.com/softwaredoug...
maven.com
Build Production-Ready AI Agents for the Enterprise by Doug Turnbull and Hugo Bowne-Anderson on Maven
Build and reason about enterprise agents grounded in your team's knowledge base
030
Doug Turnbull @softwaredoug.bsky.social · 31/08/2026
My course with @hugobowne starts in 9 hours! maven.com/softwaredoug...
maven.com
Build Production-Ready AI Agents for the Enterprise by Doug Turnbull and Hugo Bowne-Anderson on Maven
Build and reason about enterprise agents grounded in your team's knowledge base
000
Reposted by Doug Turnbull
Holly Jones @hollyjones1.bsky.social · 30/08/2026
"Don’t think about chunks think how do I represent a unit of information and its provenance to an LLM. and how do I let LLMs navigate that information architecture.”
011
Doug Turnbull @softwaredoug.bsky.social · 29/08/2026
As a search person, I get a front row seat to AI team problems. Honestly they look like search team mistakes from 10 years ago * Ignoring evals * Thinking retrieval is 'one thing' (in this case RAG) * Thinking in chunks, not metadata softwaredoug.com/blog/2026/08...
softwaredoug.com
Three mistakes of new AI teams
My biased search expert perspective on where new AI teams run into expensive and unfortunate mistakes
042
Reposted by Doug Turnbull
Ken Collins 🦾 ⛅️ @unremarkable.ai · 11/08/2026
Never occurred to me to use a fixed set of embeddings in application memory.
031
Reposted by Doug Turnbull
Sungbin Jo @goranmoomin.dev · 14/08/2026
this feels so simple and so intuitive that i now feel dumb… tldr: for a llm classification task, ofc you can use constrained decoding (a.k.a. structured output) but you can also have the llm hallucinate a class, pick the actual class by running text embedding on it and picking the closest one.
softwaredoug.com
Don’t classify. Hallucinate!
A useful pattern for LLM classification at scale is to let it hallucinate plausible, fake entities. Then resolve to real ones.
012
Doug Turnbull @softwaredoug.bsky.social · 13/08/2026
Last call for "Build Your Own Vector Database". Happening tomorrow maven.com/softwaredoug...
maven.com
Build your own vector database by Doug Turnbull on Maven
Make embedding retrieval an asset, not a headache
000
Doug Turnbull @softwaredoug.bsky.social · 10/08/2026
This pattern of asking a cheap LLM to generate hypothetical / fake classifications that we then later resolve to real ones is one of the dominant way I'm doing query understanding these days softwaredoug.com/blog/2026/08...
softwaredoug.com
The hallucinating classifier pattern
A useful pattern for LLM classification at scale is to let it hallucinate plausible, fake entities. Then resolve to real ones.
3476
Doug Turnbull @softwaredoug.bsky.social · 09/08/2026
WOMORROW WECTOR WEEK WEGINS! maven.com/p/59a7d9/how...
maven.com
How to choose a vector database
Choosing a vector database is an expensive, sticky decision often made using feature lists and generic benchmarks. Teams commit, load their real corpus, then discover costs far above budget. By then, ...
000
Doug Turnbull @softwaredoug.bsky.social · 08/08/2026
Amazing how powerful it is to have a system that produces millions of lines of plausible BS, but then have a verifier of that text to see if it holds a brilliant math proof...
000
Reposted by Doug Turnbull
shantanudhadap.bsky.social @shantanudhadap.bsky.social · 07/08/2026
Huge thanks to @treygrainger.bsky.social & @softwaredoug.bsky.social for a stellar @aipoweredsearch.bsky.social cohort! Great dive into vector architectures, hybrid search, and LTR. Essential for Search & ML Engineers. Check out the book & course: aipoweredsearch.com/live-course?...
001
Doug Turnbull @softwaredoug.bsky.social · 07/08/2026
It's too bad the ped bypass on Market by artful lodger construction is just “sorry cross here at this dangerous, blind turn” Good luck!
000
Doug Turnbull @softwaredoug.bsky.social · 07/08/2026
Wectors Week! kicking off on Monday :) softwaredoug.com/blog/2026/07...
softwaredoug.com
Vectors Week: become a savier vector db customer
A week of wector wevents - vector retrieval, hybrid search, combining the dense and lexical.
010
Reposted by Doug Turnbull
Stephen Hopkins @phil-lol-ogist.bsky.social · 07/08/2026
Parents Parents 2026 BCE 2026 CE 🤝 "These kids and their damned tablets"
235232959
Reposted by Doug Turnbull
Matthew Gillikin @mtgillikin.bsky.social · 05/08/2026
We put this together on short notice but I’m really hoping it helps bring clarity and direction around a really challenging situation
041
Doug Turnbull @softwaredoug.bsky.social · 03/08/2026
Iran peace deal week is the new infrastructure week
020
Doug Turnbull @softwaredoug.bsky.social · 02/08/2026
You Odyssey deez nu...mbers Getting close to $1B www.boxofficemojo.com/title/tt3376...
boxofficemojo.com
The Odyssey
000
Reposted by Doug Turnbull
danieldstone.bsky.social @danieldstone.bsky.social · 31/07/2026
Learnt so much from the @aipoweredsearch.bsky.social course. Was comfortable with keyword & vector search, but there's so much more — from nDCG evaluation to query understanding. @treygrainger.bsky.social & @softwaredoug.bsky.social are fantastic tutors. Highly recommend to anyone improving search.
131
Doug Turnbull @softwaredoug.bsky.social · 30/07/2026
@austegard.com seems to have been nerdsniped into writing about quantization, so be sure to follow him :)
020
Doug Turnbull @softwaredoug.bsky.social · 29/07/2026
Just brute force your vector search. A lot of people have tiny vector indices: like 1m embeddings which can be easily searched brute-force softwaredoug.com/blog/2026/07...
softwaredoug.com
Just brute force your embeddings
Sure its not fancy, but you might save operational headaches by just brute-forcing vector search for a small enough corpus
010
Doug Turnbull @softwaredoug.bsky.social · 29/07/2026
Hybrid search is a chicken-and-egg problem. We think about L0 as naive candidate selection for later rerankers. Just RRF them and rerank. We don't take into account obvious filters of user intent that should push all the way down to L0. Come to my talk :) maven.com/p/ec3299/why...
maven.com
Why your hybrid search sucks
Hybrid search isn't merging different systems. It's a single search engine. Today's systems combine dense + lexical retrieval to get the best of both worlds. Just taking top 1000 vector + top 1000 lex...
000
Doug Turnbull @softwaredoug.bsky.social · 29/07/2026
You can now puff your way to late interaction glory :)
000
Reposted by Doug Turnbull
turbopuffer @turbopuffer.bsky.social · 29/07/2026
tpuf now supports late interaction [beta] use models like ColBERT to represent text as a set of vectors (1 per token) tpuf uses a single-vector ANN index for a fast first pass, then reranks hits using exact late interaction scoring to boost recall docs: turbopuffer.com/docs/query#...
051