iiinova — where your digital self keeps evolving

Chonkie

@chonkieai.bsky.social

11 followers 2 following 6 posts

CHONK all the docs with Chonkie! Building no nonsense solutions for your RAG applications 🦛✨ (DMs open) chonkie.ai

Posts Replies Media

Chonkie @chonkieai.bsky.social · 25/12/2024

Check out our full release notes here: github.com/chonkie-ai/c... Happy Chonking! 🦛 ✨

github.com

Release v0.3.0 · chonkie-ai/chonkie

Highlights Added LateChunker support! You can use LateChunker in the following manner: from chonkie import LateChunker chunker = LateChunker( embedding_model="jinaai/jina-embeddings-v3", ...

000

Chonkie @chonkieai.bsky.social · 25/12/2024

Chonkie is a fast boi ⚡ Late chunking all of War and Peace took less than 30 seconds! 💨 🤯

100

Chonkie @chonkieai.bsky.social · 25/12/2024

Late chunking with Chonkie is simple and powerful 💪🏽

Code block displaying how to use a late chunker with Chonkie

100

Chonkie @chonkieai.bsky.social · 25/12/2024

Instead of segmenting data into fixed chunks upfront, late chunking postpones this decision until the latest possible moment—when more context is available. 🧠 This approach results in embeddings that are much richer in context, as they have "attended to" the entire context. ⚡

100

Chonkie @chonkieai.bsky.social · 25/12/2024

Merry Chonkmas everybody! This holiday season, Chonkie brings to you a new release featuring support for Late Chunking! 🧵 github.com/chonkie-ai/c...

github.com

Release v0.3.0 · chonkie-ai/chonkie

Highlights Added LateChunker support! You can use LateChunker in the following manner: from chonkie import LateChunker chunker = LateChunker( embedding_model="jinaai/jina-embeddings-v3", ...

100

Chonkie @chonkieai.bsky.social · 23/12/2024

The no-nonsense chunking library. Lightweight, lightning fast and prepared to Chonk all your docs 🦛 ✨ www.chonkie.ai

020