Sign in

CocoIndex

@cocoindex.bsky.social
44 followers 30 following 120 posts

#OpenSource Transform data for AI 🥥🌴 ⭐ github.com/cocoindex-io/cocoindex

PostsRepliesMedia
CocoIndex @cocoindex.bsky.social · 03/04/2026
video soon!
010
CocoIndex @cocoindex.bsky.social · 03/04/2026
We use CocoIndex and @pydantic.dev to build the pipeline. CocoIndex is a data indexing framework for building incremental data transformation pipelines — it tracks what's been processed, so re-running the pipeline only processes new or changed episodes.
130
CocoIndex @cocoindex.bsky.social · 03/04/2026
we'll build a cocoindex pipeline that turns YouTube podcast episodes into knowledge graph. The pipeline downloads audio, transcribes with speaker diarization, uses an LLM to extract structured statements and entities, resolves duplicates across episodes, and stores everything in @surrealdb.com
110
CocoIndex @cocoindex.bsky.social · 03/04/2026
Podcasts are one of the richest sources of expert knowledge on the internet. A single Lex Fridman or Dwarkesh Patel episode can contain dozens of substantive claims about people, technologies, and organizations — but it's all locked inside hours of audio.
100
CocoIndex @cocoindex.bsky.social · 03/04/2026
Podcasts are one of the richest sources of expert knowledge on the internet. We built an #opensource project that continously turn turns podcast episodes into a knowledge graph with @cocoindex.bsky.social @pydantic.dev @surrealdb.com 🌟 Source code: github.com/cocoindex-io...
140
CocoIndex @cocoindex.bsky.social · 03/04/2026
let's go!!
000
Reposted by CocoIndex
SurrealDB @surrealdb.com · 23/03/2026
Our first San Francisco developer meetup set the bar high. 70+ attendees and a room of builders focused on giving production AI agents the right context.
181
CocoIndex @cocoindex.bsky.social · 18/03/2026
star the repo if you like it github.com/cocoindex-io...
github.com
GitHub - cocoindex-io/cocoindex-code: A super light-weight embedded code search engine CLI (AST based) that just works - saves 70% token and improves speed for coding agent 🌟 Star if you like it!
A super light-weight embedded code search engine CLI (AST based) that just works - saves 70% token and improves speed for coding agent 🌟 Star if you like it! - cocoindex-io/cocoindex-code
010
CocoIndex @cocoindex.bsky.social · 18/03/2026
Super excited to launch 𝐜𝐨𝐜𝐨𝐢𝐧𝐝𝐞𝐱-𝐜𝐨𝐝𝐞 𝐂𝐋𝐈 🚀 ! A super lightweight, 𝐀𝐒𝐓-𝐛𝐚𝐬𝐞𝐝 𝐜𝐨𝐝𝐞 #OpenSource 𝐂𝐋𝐈 pair with any coding agent that actually understands your codebase and just works and improves code completion speed and quality. CLI is having a comeback 🙂 and having its own moment 🔥 .
142
Reposted by CocoIndex
Jaime Morgan Hitchcock @jaimemh.bsky.social · 03/03/2026
Subscribe to our events calendar on Luma for all our meetups across NYC, London, SF, Amsterdam, and Asia: luma.com/surrealdb Next stop: San Francisco. We’ll see you there for our next SurrealDB meetup with @pydantic.dev and @cocoindex.bsky.social during NVIDIA GTC.
luma.com
SurrealDB Events · Events Calendar
View and subscribe to events from SurrealDB Events on Luma. Learn, connect, and build with SurrealDB: the multi-model database for AI agents. Discover upcoming SurrealDB events, webinars or community-...
031
Reposted by CocoIndex
SurrealDB @surrealdb.com · 05/03/2026
Curious how to keep an agent’s output correct as data changes, memory grows, and systems scale? Join Tobie Morgan Hitchcock and guest speakers @sa.muelcolvin.com (@pydantic.dev) and @badmonster0.bsky.social (@cocoindex.bsky.social) at our San Francisco meetup. Register now. 👉 sdb.li/4sryXOz
092
CocoIndex @cocoindex.bsky.social · 18/03/2026
thanks a lot for sharing the project Jan!!
010
Reposted by CocoIndex
Jan Ehrhardt @jehrhardt.dev · 10/03/2026
You can use @cocoindex.bsky.social as a MCP server to provide advanced code search in coding agents now ♥️ github.com/cocoindex-io...
github.com
GitHub - cocoindex-io/cocoindex-code: A super light-weight embedded code mcp (AST based) that just works - saves 70% token and improves speed for coding agent. 🌟 Star if you like it!
A super light-weight embedded code mcp (AST based) that just works - saves 70% token and improves speed for coding agent. 🌟 Star if you like it! - cocoindex-io/cocoindex-code
111
CocoIndex @cocoindex.bsky.social · 05/02/2026
Build your own open-source deep wiki ! Auto-generate wikis for every project that never go stale. → Scan codebases → Extract info with LLMs → Generate docs + Mermaid diagrams → Incremental updates cocoindex.io/examples-v1/multi-codebase-summarization #OpenSource #DevTools #LLM
040
Reposted by CocoIndex
Srihari Thyagarajan @haleshot.bsky.social · 23/01/2026
Kicking off 2026 with Rust Delhi Meetup #12, and what a way to start. Thanks to Guinnes Singh for accepting my talk proposal & being a great host throughout. I presented on building incremental data pipelines with @cocoindex.bsky.social, a framework I've been contributing towards. (1/n)
121
Reposted by CocoIndex
Srihari Thyagarajan @haleshot.bsky.social · 23/01/2026
@cocoindex.bsky.social has a Rust-powered execution engine with Python bindings,so you get the performance without leaving Python. @agriyakhetarp.al was the one who told me about Rust Delhi in the first place, so glad I didn't skip this one. The meetup was at Aftershoot's office (great dogfooding)!
121
CocoIndex @cocoindex.bsky.social · 15/12/2025
AI agents understand codebases 🤖 CocoIndex: real-time semantic code indexing → Tree-sitter chunking → Incremental → Vector search Use: • MCP for AI editors • Semantic search • AI code review • Auto docs Query "Find auth" → instant code chunks cocoindex.io/docs/examples/code_index #AI #Rust
010
CocoIndex @cocoindex.bsky.social · 13/12/2025
Tree-sitter powered codebase indexing → real-time semantic search for AI agents 🚀 Index your code with language-aware chunking. Query with vectors in Postgres. Ship context that actually understands your codebase. cocoindex.io/docs/examples/code_index #AI #Rust #DevTools
020
CocoIndex @cocoindex.bsky.social · 13/12/2025
Why build in #opensource? Best infrastructure is transparent, composable, community-driven. CocoIndex (Rust + Python): data transformation for AI with incremental sync, schema validation, context extraction. No vendor lock-in. No black boxes. Fast, type-safe pipelines. #rustlang #python
030
CocoIndex @cocoindex.bsky.social · 13/12/2025
🚀 CocoIndex + DSPy: structured extraction from patient intake forms LLMs as typed extractors, not black boxes. Production-ready with incremental sync. No OCR/regex mess. Clean separation between reasoning (DSPy) & data infra (CocoIndex). 💻 github.com/cocoindex-io/cocoindex #AI #DataEngineering
github.com
cocoindex/examples/patient_intake_extraction_dspy at main · cocoindex-io/cocoindex
Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it! - cocoindex-io/cocoindex
030
CocoIndex @cocoindex.bsky.social · 12/12/2025
🚀 CocoIndex just hit Rust Trending Again! 🦀 Why Rust? ⚡ Speed - C++ speed + memory safety 🔒 Reliability - No GC pauses or segfaults. Predictable performance always Speed + Fresh data = Critical infra for AI agents github.com/cocoindex-io... #Rust #AI #Opensource
github.com
GitHub - cocoindex-io/cocoindex: Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it!
Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it! - cocoindex-io/cocoindex
030
CocoIndex @cocoindex.bsky.social · 08/12/2025
Building Knowledge Graphs with LLMs! 🔥 Turn docs into living graphs: ✅ Triple extraction ✅ Real-time entity mapping ✅ Neo4j export with zero pain CocoIndex handles it all - no manual Cypher ⚡ Perfect for RAG & AI agents! youtu.be/FKNcv2n4nTg
youtu.be
Property Graph, Triple extraction and Knowledge Graph with LLM in simple words and examples
YouTube video by CocoIndex
010
CocoIndex @cocoindex.bsky.social · 08/12/2025
Tired of fragile LLM prompts? 😤 BAML = typed prompt functions: ✅ Type-safe schemas ✅ Predictable outputs ✅ Production-ready + CocoIndex for incremental processing = 🔥 Tutorial: Extract patient data from PDFs cocoindex.io/blogs/extrac... #AI #LLM
cocoindex.io
Extracting Intake Forms with BAML and CocoIndex | CocoIndex
How to use BAML and CocoIndex to extract structured data from patient intake forms in PDF/Word with LLM continuous for production.
010
CocoIndex @cocoindex.bsky.social · 08/12/2025
CocoIndex just hit Rust Trending Again! 🚀 github.com/cocoindex-io... With all the AI agents development, CocoIndex is becoming critical infra for autonomous driving agents. Star & share this 🥥 if it resonates! #Opensource #RustLang
github.com
GitHub - cocoindex-io/cocoindex: Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it!
Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it! - cocoindex-io/cocoindex
030
CocoIndex @cocoindex.bsky.social · 08/12/2025
Why 🦀Rust for CocoIndex Core Engine? - Memory safety - Performance - Reliable from day 0 George wrote a great article on Rust's ownership model: cocoindex.io/blogs/rust-o... GitHub: github.com/cocoindex-io...
cocoindex.io
Thinking in Rust: Ownership, Access, and Memory Safety | CocoIndex
A mental framework for Rust's memory safety concepts. Think systematically about ownership, references, Send, Sync, and Rc, Arc, RefCell, Mutex, etc.
020
CocoIndex @cocoindex.bsky.social · 06/12/2025
go rust!!
010
CocoIndex @cocoindex.bsky.social · 06/12/2025
thanks for the spotlight @astrakernel.bsky.social !
010
CocoIndex @cocoindex.bsky.social · 06/12/2025
CocoIndex just hit Rust Trending! 🚀 github.com/cocoindex-io... Simplest way to connect data sources & keep targets fresh for AI transformations. Becoming critical infra for autonomous AI agents. Star & share! 🥥 #Opensource #RustLang
github.com
GitHub - cocoindex-io/cocoindex: Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it!
Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it! - cocoindex-io/cocoindex
161
CocoIndex @cocoindex.bsky.social · 05/12/2025
🦀 CocoIndex 0.3.10 drops today! Rust improvements: • Async runtime fixes (no deadlocks) • Smarter incremental recomputation • Optimized embedding batches • Robust file/streaming handling Why Rust for data? Memory safety + performance + async = reliable AI infra at scale
cocoindex.io
CocoIndex Changelog 0.2.21 - 0.3.10 | CocoIndex
Featuring batching support for CocoIndex functions, execution robustness, schema & type system improvements, custom source support, and more.
010
CocoIndex @cocoindex.bsky.social · 05/12/2025
Context engineering just got easier 🚀 CocoIndex transforms how you build AI systems: ✨ Incremental processing - only recompute what changed 🔄 Real-time sync - keep context always fresh 🎯 Data lineage built-in ⚡ Rust-powered Perfect for RAG, knowledge graphs & AI agents github.com/cocoindex-io/c…
github.com
GitHub - cocoindex-io/cocoindex: Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it!
Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it! - cocoindex-io/cocoindex
020
CocoIndex @cocoindex.bsky.social · 04/12/2025
Custom Sources in CocoIndex 🚀 Pull data from ANY system - APIs, databases, cloud storage. CocoIndex now ingests incrementally, tracks changes efficiently, and integrates seamlessly. No longer limited by prebuilt connectors. Use CocoIndex for anything. #opensource cocoindex.io/blogs/custom...
cocoindex.io
Bring your own data: Index any data with Custom Sources | CocoIndex
CocoIndex now officially supports custom sources — giving you the power to read data from any system you want. You can use CocoIndex for anything, and enjoy the robust incremental computing to build f...
020
CocoIndex @cocoindex.bsky.social · 04/12/2025
Automatic Batching in CocoIndex 🚀 CocoIndex now supports automatic batching for all functions. ~5× higher throughput when embedding our codebase. Best part? Adaptive and knob-free - no timers, no tuning. Just set batching=True. #opensource cocoindex.io/blogs/batching
cocoindex.io
Adaptive Batching - 5x throughput on your data pipelines | CocoIndex
Discover how CocoIndex delivers automatic batch processing for GPU workloads and machine learning pipelines. Framework-level batching optimizes performance for text embeddings and other AI operations ...
020
CocoIndex @cocoindex.bsky.social · 04/12/2025
cocoindex.io/blogs/change...
cocoindex.io
CocoIndex Changelog 0.2.21 - 0.3.10 | CocoIndex
Featuring batching support for CocoIndex functions, execution robustness, schema & type system improvements, custom source support, and more.
000
CocoIndex @cocoindex.bsky.social · 04/12/2025
CocoIndex v0.3.10 just shipped with automatic batching support! 🚀 ~5× faster throughput when embedding our codebase. Best part? Zero tuning needed - it's adaptive and knob-free. Just set batching=True. Read the benchmarks 👇
100
Reposted by CocoIndex
GitHub Projects @githubprojects.bsky.social · 04/12/2025
Keep passwords and other sensitive information out of your inboxes and chat logs
121
Reposted by CocoIndex
Linghua Jin @badmonster0.bsky.social · 21/11/2025
Improve your ai data pipeline throughput x times by adaptive batching cocoindex.io/blogs/batching #ai #opensource
cocoindex.io
Adaptive Batching - 5x throughput on your data pipelines | CocoIndex
Discover how CocoIndex delivers automatic batch processing for GPU workloads and machine learning pipelines. Framework-level batching optimizes performance for text embeddings and other AI operations ...
051
Reposted by CocoIndex
Linghua Jin @badmonster0.bsky.social · 13/11/2025
CocoIndex made to #1 Github trending global in Rust - data transformation engine. Grateful to the Rust open source community and all the amazing Rustaceans for the support 💛 #rustlang #github #opensource
283
Reposted by CocoIndex
Linghua Jin @badmonster0.bsky.social · 09/10/2025
vibe coding, not vibe data www.youtube.com/watch?v=crV7... #ai #youtube #llm #data #opensource
youtube.com
Fast Iterate Your Indexing Strategy 🚀
YouTube video by CocoIndex
051
Reposted by CocoIndex
Linghua Jin @badmonster0.bsky.social · 14/08/2025
CocoIndex - github.com/cocoindex-io... - Build fresh knowledge for AI made to the top 3 in trending github in #rustlang! 🌟 star if you like it! Let's go Rust 🦀. Data infra project should be on #Rustlang. #opensource #buildinpublic
073
CocoIndex @cocoindex.bsky.social · 12/08/2025
A mental framework to really understand how Rust’s ownership, borrowing, and memory safety work. With this - moves, borrows, Send, Sync, and runtime checks become intuitive and predictable tools in your programming toolbox. cocoindex.io/blogs/rust-o... #rustlang #opensource #programming
cocoindex.io
Thinking in Rust: Ownership, Access, and Memory Safety | CocoIndex
A mental framework for Rust's memory safety concepts. Think systematically about ownership, references, Send, Sync, and Rc, Arc, RefCell, Mutex, etc.
031
Reposted by CocoIndex
Linghua Jin @badmonster0.bsky.social · 12/08/2025
Multi-dimensional vectors? That’s how AI understands everything — text, images, audio, all at once. We broke it down here. cocoindex.io/blogs/multi-... 🌟Star the repo if you like it! github.com/cocoindex-io... #opensource #Vision #LLM #AI #buildinpublic
cocoindex.io
Multi-Dimensional Vector Support in CocoIndex | CocoIndex
CocoIndex natively handles typed multi-dimensional vectors — from simple arrays to multi-vector embeddings, unlocks multimodal AI pipelines at scale.
162
Reposted by CocoIndex
Linghua Jin @badmonster0.bsky.social · 10/08/2025
#vibecoding #opensource #ClaudeCode #Claude #GPT5 #GPT #OPENAI #GEMINI
042
CocoIndex @cocoindex.bsky.social · 29/07/2025
CocoIndex is officially supporting custom targets - cocoindex.io/docs/custom_.... We believe this work will add more flexibility for using coco / bring your own lego for targets as well beyond the flow ops. Thanks our community for the great suggestions!
cocoindex.io
Custom Targets | CocoIndex
Learn how to create custom targets in CocoIndex to export data to any destination including databases, cloud storage, file systems, and APIs. Build target specs and connectors with setup and data meth...
020
CocoIndex @cocoindex.bsky.social · 27/07/2025
🚀 Build Your Own Google Photo Search with Face Indexing at Scale. We just dropped a new tutorial on building a scalable face recognition pipeline using CocoIndex and Qdrant. cocoindex.io/blogs/face-d... #opensource #faceRecognition #LLM #AI #startup #Qdrant #CocoIndex #ColdPlay
cocoindex.io
Indexing Faces for Scalable Visual Search - Build your own Google Photo Search | CocoIndex
Build a scalable face detection and recognition pipeline using CocoIndex. This tutorial covers extracting and embedding faces from images, structuring data for visual search, and exporting to a vect...
021
CocoIndex @cocoindex.bsky.social · 17/07/2025
A mental framework -- as a simple and natural interpretation -- on Rust's memory safety models cocoindex.io/blogs/rust-o... #rustlang #buildinpublic
cocoindex.io
Thinking in Rust: Ownership, Access, and Memory Safety | CocoIndex
A mental framework for Rust's memory safety concepts. Think systematically about ownership, references, Send, Sync, and Rc, Arc, RefCell, Mutex, etc.
062
Reposted by CocoIndex
Linghua Jin @badmonster0.bsky.social · 16/07/2025
A holistic, top-down perspective on Rust’s ownership, permission, and memory safety model cocoindex.io/blogs/rust-o... #Rustlang #Programming #MemorySafty #Data
cocoindex.io
Thinking in Rust: Ownership, Access, and Memory Safety | CocoIndex
A mental framework for Rust's memory safety concepts. Think systematically about ownership, references, Send, Sync, and Rc, Arc, RefCell, Mutex, etc.
051
CocoIndex @cocoindex.bsky.social · 13/07/2025
#windsurf #cursor #codingagents #llm #coding #tech
031
Reposted by CocoIndex
HackerNoon @hackernoon.com · 11/07/2025
How to index academic research papers by extracting metadata (e.g., title, authors, abstract) for AI agents and AI workflows using LLMs and CocoIndex. #ai
hackernoon.com
Turn Your PDF Library into a Searchable Research Database with 100 Lines of Code
032
Reposted by CocoIndex
Linghua Jin @badmonster0.bsky.social · 10/07/2025
What you get: ✅ LLM-extracted title, authors, abstract ✅ Embeddings for smart search ✅ Build 3 tables in one shot: metadata, author→paper, embeddings ✅ Real-time updates via Postgres + PGVector (one-line switch to Qdrant) Appreciate a star on the repo if it is helpful github.com/cocoindex-io...
github.com
GitHub - cocoindex-io/cocoindex: Data transformation framework for AI. Ultra performant, with incremental processing.
Data transformation framework for AI. Ultra performant, with incremental processing. - cocoindex-io/cocoindex
031
Reposted by CocoIndex
Linghua Jin @badmonster0.bsky.social · 10/07/2025
📚 Build LLM-ready, metadata-rich indexes from academic papers PDF in minutes. Get started: 🔗https://cocoindex.io/blogs/academic-papers-indexing Repo: 🌟 github.com/cocoindex-io... #LLM #RAG #SemanticSearch #opensource #DataInfrastructure #KnowledgeGraphs #VectorSearch #DevTools #OpenSource
152