Sign in

Kaivalya Apte

@thegeeknarrator.bsky.social
2.4K followers 153 following 278 posts

Podcaster, Youtuber @TheGeekNarrator (youtube.com/@thegeeknarrator?si=yN0…) Databases, Stream processing, Distributed systems Software Engineer @Confluent

PostsRepliesMedia
Reposted by Kaivalya Apte
Jeremy Morrell @jeremymorrell.dev · 02/05/2026
Hell yeah @thegeeknarrator.bsky.social I’ve been really curious about what OpenData has been doing with SlateDB. Looking forward to listening to this! youtu.be/IAh3kmo2-9M?...
youtu.be
Many Databases 1 LSM Engine - OpenData
YouTube video by The Geek Narrator
131
Kaivalya Apte @thegeeknarrator.bsky.social · 30/04/2026
If you understand the Math behind something, it becomes easier to understand. But understanding Math itself can be difficult, but totally worth it.
010
Reposted by Kaivalya Apte
TigerBeetle @tigerbeetle.com · 15/04/2026
Assertions vs Types: Design by Contract, Deterministic Simulation Testing, and Safety vs Availability Vol. 3 of TigerStyle with matklad on @thegeeknarrator.bsky.social Thanks for having us, KV!
121
Kaivalya Apte @thegeeknarrator.bsky.social · 07/10/2025
We’ve reached a point where managing digital cookies burns more calories than you’d gain from eating real ones. Such a pain 😵‍💫
040
Kaivalya Apte @thegeeknarrator.bsky.social · 06/10/2025
If I ever design a system badly… I won’t admit.. But there will be signs. - Every software engineer ever.
010
Reposted by Kaivalya Apte
Philippe Noël @philippemnoel.bsky.social · 01/07/2025
1/12. I'm excited to share our latest technical blog post on ParadeDB. After a brief hiatus focused on transforming ParadeDB into an enterprise-ready database, expect to hear a lot more from us. Today's post: How ParadeDB built an LSM on top of Postgres block storage. 🧵
1147
Kaivalya Apte @thegeeknarrator.bsky.social · 01/07/2025
How do LSM trees work? Finally created a light board video. I hope you like it 🙏🏻 LSM Trees: How does it all work? youtu.be/CizxYuq-z6E
youtu.be
LSM Trees: How does it all work?
YouTube video by The Geek Narrator
040
Reposted by Kaivalya Apte
Lalith Suresh @lalithsuresh.bsky.social · 15/06/2025
Another advantage to designing systems as state machines: automated testing and even verification becomes dramatically easier.
141
Kaivalya Apte @thegeeknarrator.bsky.social · 15/06/2025
What is State Machine thinking and how do I use it (practically)? State machine thinking is one of the best ways to build reliable software. The idea is to break down complex systems into discrete states and explicit transitions between them.
171
Kaivalya Apte @thegeeknarrator.bsky.social · 14/06/2025
What is First principles thinking and how do I use it (practically) ?👇 First-principles thinking is one of the best ways to tackle complex problems. The idea is to break down complex problems into primitive elements and then reassemble the problem from scratch.
161
Kaivalya Apte @thegeeknarrator.bsky.social · 13/06/2025
Small enough service is a micro-service. Large enough language model is a Large Language Model. Naming is a NP-hard problem.
001
Kaivalya Apte @thegeeknarrator.bsky.social · 11/06/2025
Here is a sketch of how a solid observability platform built on top of object storage would look like this 👇 And guess what, Parseable is built exactly like that. All the good stuff that makes a system fast, reliable and highly scalable. New episode 🚀 youtu.be/MugLlrf5E_g
050
Reposted by Kaivalya Apte
Kaivalya Apte @thegeeknarrator.bsky.social · 09/06/2025
Diskless Kafka? But why? Why is it important for Kafka ecosystem ? How does it compare with existing revolutionary technologies? Blogged a comparison between Diskless Kafka, WarpStream and Confluent Freight. www.geeknarrator.com/blog/diskles...
022
Kaivalya Apte @thegeeknarrator.bsky.social · 09/06/2025
Diskless Kafka? But why? Why is it important for Kafka ecosystem ? How does it compare with existing revolutionary technologies? Blogged a comparison between Diskless Kafka, WarpStream and Confluent Freight. www.geeknarrator.com/blog/diskles...
022
Kaivalya Apte @thegeeknarrator.bsky.social · 25/05/2025
Blogged ✍🏻 Schema Driven Development with Buf www.geeknarrator.com/blog/buf-sch...
geeknarrator.com
Buf - A detailed introduction
This blog introduces Bufstream as a potential solution to data quality issues in streaming data, specifically within Kafka. It uses a case study of "Kafkaflix" to demonstrate schema evolution challeng...
020
Reposted by Kaivalya Apte
Kaivalya Apte @thegeeknarrator.bsky.social · 08/05/2025
DUPLICATE events and painfully SLOW joins are a real and painful problems in the world of stream processing and realtime analytics. But why there hasn't been a simple, easy and fast solution for these problems that just works with the hassle?
101
Kaivalya Apte @thegeeknarrator.bsky.social · 08/05/2025
DUPLICATE events and painfully SLOW joins are a real and painful problems in the world of stream processing and realtime analytics. But why there hasn't been a simple, easy and fast solution for these problems that just works with the hassle?
101
Kaivalya Apte @thegeeknarrator.bsky.social · 03/05/2025
BLOGGED 🎉 - Diskless Kafka KIP-1150 Wrote a detailed blog on why I think diskless Kafka is going to be HUGE. Do check it out here: www.geeknarrator.com/blog/diskless-kafka-kip-1150 Thanks Aiven for sponsoring the blog.
0132
Kaivalya Apte @thegeeknarrator.bsky.social · 23/04/2025
There is a lot of innovation happening in the Databases world BUT one area where there is a lot of opportunities is Query optimisers. I recently learnt about query optimisers and the amazing work CMU db group is doing in this space with their new query optimiser “Optd”.
100
Reposted by Kaivalya Apte
Manish Gill @manishgill.bsky.social · 14/04/2025
Are there Senior/Staff+ Engineers on my timeline who want to work on the intersection of #Databases, #Caches, #Infra, Kubernetes/Operators and #Scaling #Algorithms (think time series, predictive scaling etc)? If so, please drop me a DM. Our small but mighty team at ClickHouse is growing!
2174
Kaivalya Apte @thegeeknarrator.bsky.social · 11/04/2025
If someone says “I am a perfectionist”… they are either lying OR mean they are not going to get/let things done on time. The only realistic way is to be above a certain quality bar and keep the progress iterative and incremental. Get things done fast.
110
Reposted by Kaivalya Apte
Redpanda @redpanda.com · 21/03/2025
🎵 Sweet dreams are made of C++ 🎵 When something isn't working, sometimes you just need to rebuild it from scratch. That's what our Founding Panda, @emaxerrno.bsky.social, did when building Redpanda 🚀 Want to hear his story? Listen to Alex's chat with @thegeeknarrator.bsky.social in this episode 🎧
youtube.com
Redpanda - High Performance Streaming Platform for Data Intensive Applications @RedpandaData
YouTube video by The Geek Narrator
022
Reposted by Kaivalya Apte
Lalith Suresh @lalithsuresh.bsky.social · 17/03/2025
Thanks to @thegeeknarrator.bsky.social for having me! This was a fun podcast. 🚀
031
Reposted by Kaivalya Apte
Feldera @feldera.bsky.social · 17/03/2025
Listen to @thegeeknarrator.bsky.social podcast! @feldera.bsky.social CEO, @lalithsuresh.bsky.social, discusses Feldera's approach to incremental view maintenance and the foundational breakthrough -- DBSP -- that powers it, engine internals, storage, handling late events. youtu.be/GpcIoABwF60?...
youtu.be
Powering Incremental Compute with Mathematics - Feldera
YouTube video by The Geek Narrator
074
Reposted by Kaivalya Apte
Andrew @raindev.io · 13/03/2025
Listening to the DuckDB Internals with Mark Raasveldt (@markraasveldt.bsky.social) episode of The Geek Narrator podcast (@thegeeknarrator.bsky.social): www.youtube.com/watch?v=f9Ql...
youtube.com
@duckdb Internals with Mark Raasveldt @duckdb3282
YouTube video by The Geek Narrator
121
Reposted by Kaivalya Apte
Kaivalya Apte @thegeeknarrator.bsky.social · 01/03/2025
Just imagine writing a mature and massive system like #Kafka from scratch in C++. And on top, challenge yourself to make it 10x faster in tail latencies and way more cost effective.
121
Kaivalya Apte @thegeeknarrator.bsky.social · 01/03/2025
Just imagine writing a mature and massive system like #Kafka from scratch in C++. And on top, challenge yourself to make it 10x faster in tail latencies and way more cost effective.
121
Reposted by Kaivalya Apte
WarpStream @warpstream.com · 24/02/2025
In this episode of @thegeeknarrator.bsky.social The GeekNarrator, Richard Artoul and Ryan Worl discuss: 🚀 WarpStream architecture. ✅ Kafka ordering guarantees. 🗜️ Buffering + compaction. 💸 WarpStream flexibility + cost efficiency.
buff.ly
WarpStream: A drop-in replacement for Kafka
In this episode of The GeekNarrator podcast, host Kaivalya Apte interviews Ryan and Richie, the founders of WarpStream. They discuss the architecture, benefi...
032
Kaivalya Apte @thegeeknarrator.bsky.social · 16/02/2025
Learn the JVM internals 👇 1) The JVM Internals - Basics (Episode 1) youtu.be/Yg69qM0iZa4 2) JVM Internals: Heaps, Stacks, Program Counters and more youtu.be/MCTTg8VPaBY 3) JVM Internals - The Class file format youtu.be/15sz5yvQ-Po
youtu.be
The JVM Internals - Basics (Episode 1)
YouTube video by The Geek Narrator
140
Reposted by Kaivalya Apte
Qian Li @qianli.dev · 10/02/2025
We are focused on high-quality talks and expert speakers. Talks about engineering, not product pitches. Currently looking for speakers and venues that can host >50 people!
1113
Kaivalya Apte @thegeeknarrator.bsky.social · 08/02/2025
Do one thing with best quality. > Do less things with good quality. > Do many things with subpar quality. > Do nothing. > Nothing.
110
Kaivalya Apte @thegeeknarrator.bsky.social · 02/02/2025
The JVM internals series - #5 is out.. This episode lays out a good foundation for us to go into the internals of each of the amazing GCs and their tradeoffs. Become a member to access the upcoming internals episode.. Meanwhile watch this video (free access until tomorrow). youtu.be/p1Yamdly0QE
041
Kaivalya Apte @thegeeknarrator.bsky.social · 30/01/2025
New episode "Patterns of Distributed Systems" is up now.. Experience based, Actionable insights is what you can expect from this episode. Enjoy: youtu.be/HnyKJq8oR0M Image taken from: martinfowler.com/articles/pat...
051
Kaivalya Apte @thegeeknarrator.bsky.social · 27/01/2025
This is HUGE! Congratulations to the team.
051
Reposted by Kaivalya Apte
Qian Li @qianli.dev · 25/01/2025
Totally agreed!! I really enjoyed our podcast interview with @thegeeknarrator.bsky.social — thoroughly prepared with informative insights and questions.
141
Kaivalya Apte @thegeeknarrator.bsky.social · 25/01/2025
Wow thanks a lot @chris.blue 🙏🏻
040
Reposted by Kaivalya Apte
Marc Brooker @marcbrooker.bsky.social · 24/01/2025
I had a great time talking to Kaivalya Apte about Aurora DSQL on the Geek Narrator podcast. Watch our episode here: www.youtube.com/watch?v=ONkf... We cover the design of Aurora DSQL, interesting aspects of the design, PostgreSQL, Firecracker, and trade-offs of database systems. A lot in an hour!
youtube.com
AWS Aurora Distributed SQL internals with Marc Brooker - ​ @amazonwebservices
YouTube video by The Geek Narrator
0343
Kaivalya Apte @thegeeknarrator.bsky.social · 24/01/2025
Today I released the next episode on The GeekNarrator, with @marcbrooker.bsky.social on AWS Aurora DSQL internals. This is filled with amazing insights. Don't miss this one! youtu.be/ONkfXvPSSpc
youtu.be
AWS Aurora Distributed SQL internals with Marc Brooker - ​ @amazonwebservices
YouTube video by The Geek Narrator
092
Reposted by Kaivalya Apte
MotherDuck @motherduck.com · 21/01/2025
Crunching too many numbers inside your Postgres database? Is it crawling along while doing analytics? Use pg_duckdb to power the elephant with the duck. Learn more from contributor @jeltef.nl in this interview on a podcast by @thegeeknarrator.bsky.social. www.youtube.com/watch?v=Qn9_...
youtube.com
Power of #Duckdb with Postgres: pg_duckdb
YouTube video by The Geek Narrator
042
Kaivalya Apte @thegeeknarrator.bsky.social · 20/01/2025
What happens when you create a "new" Object in Java? What are the challenges in a multithreaded environment? Does GC play any role in object creation? New video will answer these questions for you. Get access here www.youtube.com/channel/UC_m... Link to the video: youtu.be/qfcnB8kciCE
030
Kaivalya Apte @thegeeknarrator.bsky.social · 05/01/2025
The best #SystemDesign interview question is something that is relevant to your business domain and helps you understand how well the candidate suits the requirements and the team setup.
130
Reposted by Kaivalya Apte
Kaivalya Apte @thegeeknarrator.bsky.social · 04/01/2025
How do you build reliable applications faster? By taking the standard reliability patterns and applying them to your applications. Just released first episode of 2025 with Peter Kraft and Qian Li. youtu.be/F0nXTAaXYaY
youtu.be
DBOS internals - Build reliable backends 10x faster
YouTube video by The Geek Narrator
1124
Reposted by Kaivalya Apte
Qian Li @qianli.dev · 04/01/2025
We had a wonderful time chatting with Kaivalya about @dbos.dev, durable execution, and serverless on The Geek Narrator podcast! I was impressed by how much thought and preparation went into Kaivalya's insightful questions, which made for an engaging discussion. Check it out 🤗
0132
Kaivalya Apte @thegeeknarrator.bsky.social · 04/01/2025
How do you build reliable applications faster? By taking the standard reliability patterns and applying them to your applications. Just released first episode of 2025 with Peter Kraft and Qian Li. youtu.be/F0nXTAaXYaY
youtu.be
DBOS internals - Build reliable backends 10x faster
YouTube video by The Geek Narrator
1124
Reposted by Kaivalya Apte
Chris @chris.blue · 02/01/2025
This is an excellent summary. Reminds me in some ways of star tree indexes. Also feels like an LSM B-tree mashup. Interesting tradeoffs. Who's building this on object storage? 😅
282
Kaivalya Apte @thegeeknarrator.bsky.social · 02/01/2025
I started my 2025 reading white-paper(s) on Bε-trees. A thread that captures everything you need to know about them and more.. Like, repost and share..👇
1294
Kaivalya Apte @thegeeknarrator.bsky.social · 30/12/2024
Deep down, everyone knows, “I will start doing XYZ from Jan 1st/New Year” is just an excuse and they are going to fail at it, worse than they did, an year ago.
110
Kaivalya Apte @thegeeknarrator.bsky.social · 28/12/2024
One of the Holiday projects completed. Was tougher than what I thought and easier than what my wife thought. Now movie time. One of my favourites.
000
Kaivalya Apte @thegeeknarrator.bsky.social · 28/12/2024
A couple of more books and I am all set. 2025 is going to be amazing. Stronger fundamentals. More Deep work. Quality content. Along with podcasts, it will be filled with series on Distributed systems, JVM internals, Database internals and Stream processing.
0170
Kaivalya Apte @thegeeknarrator.bsky.social · 24/12/2024
Happy Holidays folks.. What are y’all reading?
2100