Sign in

Vignesh Chandramohan

@vigneshc.bsky.social
1.2K followers 87 following 41 posts

Stream processing, data infra, Table formats. vigneshc.github.io

PostsRepliesMedia
Vignesh Chandramohan @vigneshc.bsky.social · 27/06/2026
Does anyone have a production use case example for Quack? Remote reads make sense for local cache like scenarios. I am curious about remote writes. Great talk from this year's AI council on duckdb quack : youtu.be/O_tzHeDpjrE?...
youtu.be
Super-Secret Next Big Thing for DuckDB
YouTube video by AI Council
000
Vignesh Chandramohan @vigneshc.bsky.social · 26/05/2026
A short post on Iceberg deletions : vigneshc.github.io/blog/iceberg...
vigneshc.github.io
Iceberg Deletes — Equality Deletes and V3 Deletion Vectors
A short walkthrough of Apache Iceberg deletes: equality deletes, V3 deletion vectors, and streaming considerations.
030
Vignesh Chandramohan @vigneshc.bsky.social · 12/04/2026
Exploring Apache Iceberg and SlateDB formats - with a repo link for additional exploration. datapapers.substack.com/p/exploring-...
datapapers.substack.com
Exploring Table Formats - Iceberg & SlateDB
What is common between Apache Icerberg, SlateDB and object-store first table formats? Explore with real examples.
081
Vignesh Chandramohan @vigneshc.bsky.social · 31/10/2025
Short talk on Iceberg use cases in last week's Seattle Iceberg meetup. youtu.be/F7qpOVVnxek?...
youtu.be
​Iceberg Use Cases at DoorDash
YouTube video by Apache Iceberg™ Meetup
020
Reposted by Vignesh Chandramohan
Chris @chris.blue · 21/10/2025
If you find yourself in SF next week, @almog.xyz is talking about SlateDB at the SF Systems Meetup on Wednesday!
luma.com
SF Systems Meetup: Databases and Stateful Apps · Luma
The SF Systems Meetup is back with a pair of talks giving us a peek at the future of state management! This month, we're excited to have talks from Almog Gavra…
0174
Vignesh Chandramohan @vigneshc.bsky.social · 27/09/2025
1/ Nice read: medium.com/@xiafan/time... Software engineer growth in AI era: * Build composable tools. * Assume non deterministic outcomes from a group of ai agents. * Understand how LLM works to the next level, like how you would understand to read a query plan.
medium.com
Time to Adapt and Become a Better Engineer
A colleague recently asked if I think AI agents could do all the jobs humans do. My answer was an unequivocal yes. Given the same sensory…
120
Reposted by Vignesh Chandramohan
Chris @chris.blue · 25/08/2025
Just added sqlync.com to SlateDB's adopters list! They're building a streaming system that speaks MQTT or PostgreSQL across millions of connected users and devices. 🤯
sqlync.com
SQLync
051
Reposted by Vignesh Chandramohan
Chris @chris.blue · 18/06/2025
Insane amount of SlateDB work going on: - snapshot reads - split/merge DBs (zero copy) - deterministic simulation testing And someone just pushed Python bindings in a PR! 🤯
0103
Vignesh Chandramohan @vigneshc.bsky.social · 30/05/2025
My Data council talk on SlateDB. youtu.be/gcTRXZeKbNg?...
youtu.be
Internals of SlateDB: An Embedded Key Value Store Built On Object Storage
YouTube video by Data Council
0213
Reposted by Vignesh Chandramohan
Chris @chris.blue · 24/04/2025
SlateDB 0.6.0 is out! github.com/slatedb/slat... Highlights include a hybrid cache (using Foyer), a lot of internal cleanup, and more groundwork for transactions. Oh, and put performance jumped ~80% for write-heavy workloads :) slatedb.io/performance/...
081
Reposted by Vignesh Chandramohan
Chris @chris.blue · 22/04/2025
Today marks SlateDB’s one year anniversary! It’s been a lot of fun. Thanks to @rohanpd.bsky.social @flaneur2024.bsky.social @almog.ai @vigneshc.bsky.social @paulbutler.org Jason Gustafson, David Moravek, and many others for joining the project. 😀
slatedb.io
SlateDB - An embedded storage engine built on object storage | SlateDB
Description will go into a meta tag in <head />
0165
Reposted by Vignesh Chandramohan
Commonhaus Foundation @commonhaus.org · 10/04/2025
Commonhaus is 1! 🎂 14 projects, solid foundations, and more on the way. If you believe in light governance, shared care, and thoughtful support for open source, come see what we’re building. www.commonhaus.org/activity/253...
commonhaus.org
🎂 Commonhaus Turns One — A Look Back, and the Road Ahead
Commonhaus Foundation celebrates its first anniversary and lays down expectations for its future
03019
Reposted by Vignesh Chandramohan
Mike Driscoll @medriscoll.com · 16/04/2025
Yo SF Bay Area #databs crew, want to talk lakehouses at a real Lake House? :) Next week after Data Council, join the founders of @clickhouse.com, @motherduck.com, @startreedata.bsky.social, and @tobikodata.com to talk real-time databases and next-generation ETL. www.rilldata.com/events/data-...
193
Reposted by Vignesh Chandramohan
Chris @chris.blue · 17/03/2025
SlateDB 0.5.0 is out! Features: - Checkpoints - Clones - Read only client - Split/merge database foundation - TTL filtering on reads - Last version with breaking byte format changes By the numbers: - 62 commits - 2 new contributors - 10 total contributors github.com/slatedb/slat...
github.com
Release v0.5.0 · slatedb/slatedb
What's Changed Refactor Block Tests to Use Table-Driven Test Cases by @samsond in #410 Update await calls in README.md by @criccomini in #425 chore: Apply table driven test for sst.rs by @jeffreyl...
2213
Vignesh Chandramohan @vigneshc.bsky.social · 02/03/2025
datapapers.substack.com/p/building-c... New post.
datapapers.substack.com
Building composable data systems: Why, How and Standards
Standards improve interoperability. Reusable libraries built around standards drive adoption. In this post, we explore key papers and real-world examples.
041
Vignesh Chandramohan @vigneshc.bsky.social · 23/02/2025
DEBS conference hosts a grand challenge every year. This year's challenge is detecting outliers in a stream of images from laser powder bed fusion. The challenge involves submitting a kubernetes app (constraint: 2 cores 8 gb). Interesting to try if you have the time! 2025.debs.org/call-for-gra...
2025.debs.org
CALL FOR GRAND CHALLENGE SOLUTIONS
DEBS2025
010
Reposted by Vignesh Chandramohan
Diptanu Choudhury @diptanu.bsky.social · 17/12/2024
Python Folks - which data/workflow engine has the best developer experience for packaging code? We have looked into - Modal, Beam, Airflow, Flyte, AWS Lambda, Prefect, Dagster and Spark. Haven’t seen any approach which is fast, reliable and intuitive.
6102
Vignesh Chandramohan @vigneshc.bsky.social · 19/01/2025
What are some papers or blogs about data quality challenges? I see tools like great expectations, table formats features like 'check constraints' in Delta. I don't yet see it as a first class property of catalogs. Found this, are there others? journalofbigdata.springeropen.com/articles/10....
journalofbigdata.springeropen.com
Big data quality framework: a holistic approach to continuous quality management - Journal of Big Data
Big Data is an essential research area for governments, institutions, and private agencies to support their analytics decisions. Big Data refers to all about data, how it is collected, processed, and ...
131
Vignesh Chandramohan @vigneshc.bsky.social · 19/01/2025
Great talk by Binwei Yang on Apache Gluten last week. youtu.be/GWTj3INSzPg?... Apache Gluten moves execution of spark operators to native backend like Velox, accelerating query performance. It has basic iceberg support too! github.com/apache/incub...
youtu.be
Big Data Bellevue: Apache Gluten: Accelerating SparkSQL with Spark on Velox
YouTube video by BDB
010
Reposted by Vignesh Chandramohan
Chris @chris.blue · 31/12/2024
SlateDB 0.4.0 is out! Features: - Range scans - No DynamoDB needed for S3 - Nightly perf tests - Merge operator groundwork - GC improvements By the numbers: - 57 commits - 5 new contributors - 11 total contributors github.com/slatedb/slat...
3254
Reposted by Vignesh Chandramohan
Chris @chris.blue · 21/11/2024
SlateDB is now part of @commonhaus-fdn.bsky.social! I think we might be the first non-JVM project. Looking forward to more projects joining us here. Our experience with the foundation has been excellent so far. github.com/commonhaus/f...
github.com
SlateDB would like to join Commonhaus · commonhaus foundation · Discussion #213
Project information Project name: SlateDB Project website: https://slatedb.io Code repository: https://github.com/slatedb/slatedb License: Apache 2.0 Do you have authority to represent this project...
2296
Reposted by Vignesh Chandramohan
Ryanne Dolan @ry.codes · 16/11/2024
The 3 reasons to backfill: 1) new pipeline, who dis? 2) logic changed, recompute 3) whoops downstream lost everything. resend it.
3135