Reposted by Doug Turnbullturbopuffer @turbopuffer.bsky.social · 5hwe're changing tpuf's storage architecture so we can keep pushing the search frontier the new engine (v3) now passes CI, but we have to make it fast before we ship it to prod we're grinding query plans in public until v3 wins on everything follow along: turbopuffer.com/v3 011
Doug Turnbull @softwaredoug.bsky.social · 29/09/2026Hang out with me and Mr. Tunkelang at 1PM ET today :) maven.com/p/1f1f46/ir-...maven.comIR Today: Theory, Practice, and AgentsLLMs and agentic search have dominated search in 2026. Daniel will give his observations after attending SIGIR, the world’s leading conference on search and information retrieval, as well as reflectin... 010
Doug Turnbull @softwaredoug.bsky.social · 29/09/2026My talk today: Embeddings Don't Solve RAG www.youtube.com/watch?v=kBFs...youtube.comEmbeddings Don't Solve RAGYouTube video by Doug Turnbull 000
Doug Turnbull @softwaredoug.bsky.social · 28/09/2026Next weeks training should be fun, hope you can make it 100
Doug Turnbull @softwaredoug.bsky.social · 28/09/2026In one week, I'm going to be giving the last Cheat at Search w/ Agents in 2026. Hope you can make it! maven.com/softwaredoug...maven.comCheat at Search with Agents by Doug Turnbull on MavenRethink search to put tireless agents at work for human users 000
Doug Turnbull @softwaredoug.bsky.social · 27/09/2026OK it's a little more than a week until I teach people about modern Agentic RAG. Then I have to go past shitposting and get hands on. maven.com/softwaredoug...maven.comCheat at Search with Agents by Doug Turnbull on MavenRethink search to put tireless agents at work for human users 000
Doug Turnbull @softwaredoug.bsky.social · 25/09/2026We'll hear from Adam Hevenor an 1.5 hours on his fun work with agentic memory at Retrieval Augmented Gathering, hope you can make it! maven.com/lls/f27953maven.comRAG: Retrieval Augmented Gathering | MavenLive courses with real-world experts in AI, Product, Leadership, Design, Data & engineering, Marketing & sales, and Business & finance. 001
Doug Turnbull @softwaredoug.bsky.social · 24/09/2026Allow commercial-in-residential to support your local taco shop 010
Doug Turnbull @softwaredoug.bsky.social · 24/09/2026We're finally building more housing, tell Council you support it www.reddit.com/r/Charlottes...reddit.comFrom the Charlottesville community on Reddit: We're finally building more housing. Tell Council you support it.Posted by softwaredoug - 1 vote and 0 comments 010
Doug Turnbull @softwaredoug.bsky.social · 24/09/2026This is so cool to see for Charlottesville City, but its going to be under threat in 2027 if housing skeptics get elected to Council fred.stlouisfed.org/series/BPPRI...fred.stlouisfed.orgNew Private Housing Structures Authorized by Building Permits for Charlottesville City, VANew Private Housing Structures Authorized by Building Permits for Charlottesville City, VA 120
Doug Turnbull @softwaredoug.bsky.social · 23/09/2026Cheat at Search starts in 1.5 weeks You: A search developer that wants to understand LLMs, Agents, and RAG Me: Someone who has built production AI search agents at Reddit, Shopify, and various startups I want to help :) maven.com/softwaredoug... 000
Doug Turnbull @softwaredoug.bsky.social · 23/09/2026See everyone in 35 minutes :) maven.com/p/2acdeb/ten...maven.comTensors in the Search Engine (Why?)RAG and Agentic search requires vector search. And increasingly multi-vector retrieval. Vespa's tensor feature implements vector search. "How are tensors better than vectors?" is a common follow-up q... 010
Doug Turnbull @softwaredoug.bsky.social · 23/09/2026All hail our lord and savior Jevus softwaredoug.com/blog/2026/09...softwaredoug.comCheating at search with jevKicking the tires of jev for a very basic query understanding task 161
Doug Turnbull @softwaredoug.bsky.social · 22/09/2026Next up in Retrieval Augmented Gathering This afternoon (1PM ET) we'll hear from Kumar Shivendu of @qdrant.bsky.social on doing neural search with no query-time inference 111
Doug Turnbull @softwaredoug.bsky.social · 21/09/2026Price going up to $1450 in a few hours maven.com/softwaredoug...maven.comCheat at Search with Agents by Doug Turnbull on MavenRethink search to put tireless agents at work for human users 000
Doug Turnbull @softwaredoug.bsky.social · 21/09/2026Career Q&A recap from Friday www.youtube.com/watch?v=N8Gn...youtube.comEmployers don't know how to hire for searchYouTube video by Doug Turnbull 000
Doug Turnbull @softwaredoug.bsky.social · 21/09/2026 In 24 hours I increase price for October's Cheat at Search It's an important class: I explore how LLMs and retrieval intersect. From query understanding with LLMs to LLM as a judge, to exploring whether all search is now agentic maven.com/softwaredoug...maven.comCheat at Search with Agents by Doug Turnbull on MavenRethink search to put tireless agents at work for human users 000
Doug Turnbull @softwaredoug.bsky.social · 19/09/2026I think a lot about the quote "A computer can never be held accountable, therefore a computer must never make a management decision" these days Except I think it applies to any 'decision', not just management. It's your code, not the AI's code 052
Doug Turnbull @softwaredoug.bsky.social · 17/09/2026I read Brian Pedersen's data on what Search hiring teams are looking for and wrote about my own pointers for job seekers. One big danger for search professionals: keeping your head in the sand. Participate in community, in whatever form that can take for you. softwaredoug.com/blog/2026/09...softwaredoug.comPointers for your search career in 2026What you should be thinking of as you consider search + retrieval roles 000
Doug Turnbull @softwaredoug.bsky.social · 17/09/2026Retrieval Augmented Gathering starting tomorrow with a search career Q&A. Hope you can make it! maven.com/lls/f27953maven.comRAG: Retrieval Augmented Gathering | MavenLive courses with real-world experts in AI, Product, Leadership, Design, Data & engineering, Marketing & sales, and Business & finance. 010
Doug Turnbull @softwaredoug.bsky.social · 16/09/2026Price will increase to $1450 on Friday for October's cohort. Hope you can make it maven.com/softwaredoug...maven.comCheat at Search with Agents by Doug Turnbull on MavenRethink search to put tireless agents at work for human users 000
Doug Turnbull @softwaredoug.bsky.social · 15/09/2026Over the next few weeks, we'll have a series of talks on retrieval, RAG, agentic memory, agentic search and more - come hang out! maven.com/lls/f27953maven.comRAG: Retrieval Augmented Gathering | MavenLive courses with real-world experts in AI, Product, Leadership, Design, Data & engineering, Marketing & sales, and Business & finance. 040
Doug Turnbull @softwaredoug.bsky.social · 14/09/2026It's 2026 and this still needs to be said :) maven.com/p/74f7ed/emb...maven.comEmbeddings don't solve RAGYou've been fed a false narrative. That RAG means embeddings. Ask a retrieval engineer they'll only be one small piece of a good RAG solution. By questioning embeddings as a search solution, we'll tak... 010
Doug Turnbull @softwaredoug.bsky.social · 11/09/2026On the road to my Cheat at Search w/ Agents course we'll have Brian Pedersen of The Search Bar with a Q&A on search + AI career Bring your tough questions! maven.com/p/2b0df3/sea...maven.comSearch and AI Career Q&AIt's scary out there. Skills we thought would be timeless are being brought into question. We're all being asked to relearn our career as agentic coding continues to eat software development. Search r... 012
Reposted by Doug TurnbullLivable Cville @livablecville.bsky.social · 03/09/2026Good morning everyone - here’s some good housing news to start your day! 0195
Reposted by Doug Turnbulldman-os @dman-os.bsky.social · 31/08/2026first time I came across this verdik.substack.com/p/how-to-get...verdik.substack.comHow to Get Consistent Classification From Inconsistent LLMs?A technique for deterministic labeling from stochastic models, with benchmarked Golang implementation. 132
Doug Turnbull @softwaredoug.bsky.social · 31/08/2026It's down to the wire folks, Hugo and I are teaching in 1 hour! maven.com/softwaredoug...maven.comBuild Production-Ready AI Agents for the Enterprise by Doug Turnbull and Hugo Bowne-Anderson on MavenBuild and reason about enterprise agents grounded in your team's knowledge base 030
Doug Turnbull @softwaredoug.bsky.social · 31/08/2026My course with @hugobowne starts in 9 hours! maven.com/softwaredoug...maven.comBuild Production-Ready AI Agents for the Enterprise by Doug Turnbull and Hugo Bowne-Anderson on MavenBuild and reason about enterprise agents grounded in your team's knowledge base 000
Reposted by Doug TurnbullHolly Jones @hollyjones1.bsky.social · 30/08/2026"Don’t think about chunks think how do I represent a unit of information and its provenance to an LLM. and how do I let LLMs navigate that information architecture.” 011
Doug Turnbull @softwaredoug.bsky.social · 29/08/2026As a search person, I get a front row seat to AI team problems. Honestly they look like search team mistakes from 10 years ago * Ignoring evals * Thinking retrieval is 'one thing' (in this case RAG) * Thinking in chunks, not metadata softwaredoug.com/blog/2026/08...softwaredoug.comThree mistakes of new AI teamsMy biased search expert perspective on where new AI teams run into expensive and unfortunate mistakes 042
Reposted by Doug TurnbullKen Collins 🦾 ⛅️ @unremarkable.ai · 11/08/2026Never occurred to me to use a fixed set of embeddings in application memory. 031
Reposted by Doug TurnbullSungbin Jo @goranmoomin.dev · 14/08/2026this feels so simple and so intuitive that i now feel dumb… tldr: for a llm classification task, ofc you can use constrained decoding (a.k.a. structured output) but you can also have the llm hallucinate a class, pick the actual class by running text embedding on it and picking the closest one.softwaredoug.comDon’t classify. Hallucinate!A useful pattern for LLM classification at scale is to let it hallucinate plausible, fake entities. Then resolve to real ones. 012
Doug Turnbull @softwaredoug.bsky.social · 13/08/2026Last call for "Build Your Own Vector Database". Happening tomorrow maven.com/softwaredoug...maven.comBuild your own vector database by Doug Turnbull on MavenMake embedding retrieval an asset, not a headache 000
Doug Turnbull @softwaredoug.bsky.social · 10/08/2026This pattern of asking a cheap LLM to generate hypothetical / fake classifications that we then later resolve to real ones is one of the dominant way I'm doing query understanding these days softwaredoug.com/blog/2026/08...softwaredoug.comThe hallucinating classifier patternA useful pattern for LLM classification at scale is to let it hallucinate plausible, fake entities. Then resolve to real ones. 3476
Doug Turnbull @softwaredoug.bsky.social · 09/08/2026WOMORROW WECTOR WEEK WEGINS! maven.com/p/59a7d9/how...maven.comHow to choose a vector databaseChoosing a vector database is an expensive, sticky decision often made using feature lists and generic benchmarks. Teams commit, load their real corpus, then discover costs far above budget. By then, ... 000
Doug Turnbull @softwaredoug.bsky.social · 08/08/2026Amazing how powerful it is to have a system that produces millions of lines of plausible BS, but then have a verifier of that text to see if it holds a brilliant math proof... 000
Reposted by Doug Turnbullshantanudhadap.bsky.social @shantanudhadap.bsky.social · 07/08/2026Huge thanks to @treygrainger.bsky.social & @softwaredoug.bsky.social for a stellar @aipoweredsearch.bsky.social cohort! Great dive into vector architectures, hybrid search, and LTR. Essential for Search & ML Engineers. Check out the book & course: aipoweredsearch.com/live-course?... 001
Doug Turnbull @softwaredoug.bsky.social · 07/08/2026It's too bad the ped bypass on Market by artful lodger construction is just “sorry cross here at this dangerous, blind turn” Good luck! 000
Doug Turnbull @softwaredoug.bsky.social · 07/08/2026Wectors Week! kicking off on Monday :) softwaredoug.com/blog/2026/07...softwaredoug.comVectors Week: become a savier vector db customerA week of wector wevents - vector retrieval, hybrid search, combining the dense and lexical. 010
Reposted by Doug TurnbullStephen Hopkins @phil-lol-ogist.bsky.social · 07/08/2026Parents Parents 2026 BCE 2026 CE 🤝 "These kids and their damned tablets" 235232959
Reposted by Doug TurnbullMatthew Gillikin @mtgillikin.bsky.social · 05/08/2026We put this together on short notice but I’m really hoping it helps bring clarity and direction around a really challenging situation 041
Doug Turnbull @softwaredoug.bsky.social · 03/08/2026Iran peace deal week is the new infrastructure week 020
Doug Turnbull @softwaredoug.bsky.social · 02/08/2026You Odyssey deez nu...mbers Getting close to $1B www.boxofficemojo.com/title/tt3376...boxofficemojo.comThe Odyssey 000
Reposted by Doug Turnbulldanieldstone.bsky.social @danieldstone.bsky.social · 31/07/2026Learnt so much from the @aipoweredsearch.bsky.social course. Was comfortable with keyword & vector search, but there's so much more — from nDCG evaluation to query understanding. @treygrainger.bsky.social & @softwaredoug.bsky.social are fantastic tutors. Highly recommend to anyone improving search. 131
Doug Turnbull @softwaredoug.bsky.social · 30/07/2026@austegard.com seems to have been nerdsniped into writing about quantization, so be sure to follow him :) 020
Doug Turnbull @softwaredoug.bsky.social · 29/07/2026Just brute force your vector search. A lot of people have tiny vector indices: like 1m embeddings which can be easily searched brute-force softwaredoug.com/blog/2026/07...softwaredoug.comJust brute force your embeddingsSure its not fancy, but you might save operational headaches by just brute-forcing vector search for a small enough corpus 010
Doug Turnbull @softwaredoug.bsky.social · 29/07/2026Hybrid search is a chicken-and-egg problem. We think about L0 as naive candidate selection for later rerankers. Just RRF them and rerank. We don't take into account obvious filters of user intent that should push all the way down to L0. Come to my talk :) maven.com/p/ec3299/why...maven.comWhy your hybrid search sucksHybrid search isn't merging different systems. It's a single search engine. Today's systems combine dense + lexical retrieval to get the best of both worlds. Just taking top 1000 vector + top 1000 lex... 000
Doug Turnbull @softwaredoug.bsky.social · 29/07/2026You can now puff your way to late interaction glory :) 000
Reposted by Doug Turnbullturbopuffer @turbopuffer.bsky.social · 29/07/2026tpuf now supports late interaction [beta] use models like ColBERT to represent text as a set of vectors (1 per token) tpuf uses a single-vector ANN index for a fast first pass, then reranks hits using exact late interaction scoring to boost recall docs: turbopuffer.com/docs/query#... 051