Sign in

Apurva Mehta

@apurvamehta.com
2.2K followers 80 following 185 posts

Co-Founder and CEO of @responsive.dev. I write about stream processing and company building. Views are my own. 🌐 apurvamehta.com

PostsRepliesMedia
Reposted by Apurva Mehta
Almog @almog.xyz · 09/12/2025
The inner join between sets of people who build databases, write, and draw? Low cardinality. I'm in that set, so I'm starting a blog! Here's my first post: www.bitsxpages.com/p/frameworks...
bitsxpages.com
frameworks for understanding databases
building mental models for tradeoffs in performance, availability and durability in data systems
2163
Reposted by Apurva Mehta
Chris @chris.blue · 22/04/2025
Today marks SlateDB’s one year anniversary! It’s been a lot of fun. Thanks to @rohanpd.bsky.social @flaneur2024.bsky.social @almog.ai @vigneshc.bsky.social @paulbutler.org Jason Gustafson, David Moravek, and many others for joining the project. 😀
slatedb.io
SlateDB - An embedded storage engine built on object storage | SlateDB
Description will go into a meta tag in <head />
0165
Reposted by Apurva Mehta
Chris @chris.blue · 31/03/2025
I’m a sucker for a good cost calculator. This one is pretty slick. Lots of components contribute to cost in Kafka Streams.
051
Reposted by Apurva Mehta
Chris @chris.blue · 17/03/2025
SlateDB 0.5.0 is out! Features: - Checkpoints - Clones - Read only client - Split/merge database foundation - TTL filtering on reads - Last version with breaking byte format changes By the numbers: - 62 commits - 2 new contributors - 10 total contributors github.com/slatedb/slat...
github.com
Release v0.5.0 · slatedb/slatedb
What's Changed Refactor Block Tests to Use Table-Driven Test Cases by @samsond in #410 Update await calls in README.md by @criccomini in #425 chore: Apply table driven test for sst.rs by @jeffreyl...
2213
Reposted by Apurva Mehta
Luke @lukehedger.dev · 16/03/2025
Related: super interesting discussion on stateful stream processing vs OLTP with @apurvamehta.com from @responsive.dev open.spotify.com/episode/1hsH... (start at 18:46)
open.spotify.com
Reinventing Stream Processing: From LinkedIn to Responsive with Apurva Mehta
Tech on the Rocks · Episode
143
Reposted by Apurva Mehta
Kostas Pardalis @cpard.bsky.social · 14/03/2025
I'm always excited to chat with @apurvamehta.com about what @responsive.dev is building. Streaming and real time as terms are being constantly reinvented as the market needs change rapidly, and Apurva is one of the best to talk about that. Check the conversation here: techontherocks.show/15
techontherocks.show
Tech on the Rocks | Reinventing Stream Processing: From LinkedIn to Responsive with Apurva Mehta
SummaryIn this episode, Apurva Mehta, co-founder and CEO of Responsive, recounts his extensive journey in stream processing—from his early work at LinkedIn and Confluent to his current venture at R...
052
Reposted by Apurva Mehta
Chris @chris.blue · 06/03/2025
I’m excited to listen to this one. Some of my favorite folks all in one podcast 😀
021
Apurva Mehta @apurvamehta.com · 06/03/2025
This week, our 101 series has @ableegoldman.bsky.social diving deep into the world of performance optimization for Kafka Streams. This isn't just theory: she shows how we realized 10x throughput improvements by implementing these techniques in prod! www.responsive.dev/blog/perform...
responsive.dev
Kafka Streams 101: Optimizing your apps for maximum performance
Learn the concepts, configs, and application design strategies to get your Kafka Streams apps running as optimally as possible.
073
Reposted by Apurva Mehta
Tech on the Rocks @totrrocks.bsky.social · 06/03/2025
New episode: Reinventing Stream Processing with @apurvamehta.com from @responsive.dev We cover: Real-time vs low latency in streaming Why stateful streaming is hard at scale RocksDB, Postgres limitations SQL vs flexible APIs Decoupling state & compute with SlateDB. 🎧 👉
techontherocks.show
Tech on the Rocks
Join Kostas and Nitay as they speak with amazingly smart people who are building the next generation of technology, from hardware to cloud compute. Tech on the Rocks is for people who are curious…
041
Reposted by Apurva Mehta
Sophie Blee-Goldman @ableegoldman.bsky.social · 26/02/2025
Next entry in the Kafka Streams 101 series: application lifecycle. Very beginner friendly, but even the pros might find a useful tip or two -- for example: have you heard of the new standby task listener? Check it out: www.responsive.dev/blog/app-lif...
responsive.dev
Kafka Streams 101: Application Lifecycle
Learn how to properly start, stop, and manage the lifecycle of Kafka Streams
094
Reposted by Apurva Mehta
Sophie Blee-Goldman @ableegoldman.bsky.social · 18/02/2025
We're keeping the ball rolling on the Kafka Streams 101 series with yet another blog post! This time the focus is on configuration, and breaking down the most important configs to focus on for various needs (such as correctness, resiliency, etc) Check it out here: www.responsive.dev/blog/importa...
responsive.dev
Kafka Streams 101: The Most Important Configs
Learn which configurations are most critical for a reliable and efficient deployment
086
Reposted by Apurva Mehta
Responsive @responsive.dev · 14/02/2025
We are happy to announce that we have completed another SOC2 Type 2 audit along with completing another successful penetration test against our cloud services. You can find the latest reports on our trust center: trust.responsive.dev
trust.responsive.dev
Responsive Trust Center
Responsive is a stream processing solution that brings disaggregated state, autoscaling, observability and enterprise-grade support to Kafka Streams. Eliminate unpredictable lag and rebalance instabil...
031
Apurva Mehta @apurvamehta.com · 13/02/2025
(1/3) One of the hardest problems in the world of stream processing is upgrading stateful applications. Why? Because the events never stop, and your application has to handle the events correctly before and after a upgrade and if rewind your position in a topic.
260
Reposted by Apurva Mehta
Chris @chris.blue · 13/02/2025
Had two people ask me for guidance about open source foundations this week. Lots of trepidation around Apache, not much familiarity with CNCF, and curiousity about why I chose Commonhaus for SlateDB. Here are my thoughts:
cnr.sh
Comparing Apache, CNCF, and Commonhaus | cnr.sh
I've used open source projects for over 30 years and contributed for about 20 of those. My first interaction with an open source foundation was with Apache when I began working with Apache Hadoop ...
1186
Reposted by Apurva Mehta
Matthias J. Sax 🦦 @mjsax.bsky.social · 07/02/2025
#StreamProcessing with @kafkastreams.bsky.social
0153
Apurva Mehta @apurvamehta.com · 04/02/2025
Should you use Kafka? If so, when? And what are the tradeoffs presented by the dizzying variety of Kafka-adjacent technologies? I hope that my latest blog post provides unique and useful answers to these questions. Let me know what you all think! 👉 www.responsive.dev/blog/why-whe...
0155
Reposted by Apurva Mehta
Sophie Blee-Goldman @ableegoldman.bsky.social · 04/02/2025
Thanks everyone for all the feedback on blog post ideas! Performance and upgrades were most popular so stay tuned for these deep dives - for beginners and advanced users alike Check out our new Kafka Streams 101 site and subscribe to get notified for these and other upcoming lessons! bit.ly/40LWJZL
bit.ly
Kafka Streams 101 | Responsive
Learn to build bulletproof Kafka Streams applications
062
Apurva Mehta @apurvamehta.com · 03/02/2025
This will be the foundation for being able to branch @kafkastreams.bsky.social apps to support seamless blue/green deploys. It also allows you to branch a previous version of the state to debug an issue from the past. Powerful stuff coming to the world of stream processing!
2134
Apurva Mehta @apurvamehta.com · 02/02/2025
I'm enjoying putting the finishing touches on my next blog post on the Why, When, and How of Kafka applications. It's a distillation of my point of view from a decade in the space and I hope it's as useful to read as it was fun to write. Coming Tuesday!
190
Apurva Mehta @apurvamehta.com · 30/01/2025
I've used ChatGPT and/or Gemini to brainstorm ideas for presenting concepts visually multiple times recently. They have unlocked ideas I wouldn't have thought of otherwise. And sometimes, they generate the graphics. For the rest, Figma is perfect. It's such a major boost either way!
3120
Reposted by Apurva Mehta
ScyllaDB @scylladb.com · 29/01/2025
How did Responsive simplify its architecture and achieve monstrously high availability with unlimited scale potential? Co-founder @almog.ai will share how replacing RocksDB with #ScyllaDB in #Kafka Streams led to big wins for their team at Monster Scale Summit. www.scylladb.com/monster-scal...
084
Apurva Mehta @apurvamehta.com · 28/01/2025
The first of our Kafka Streams 101 Series. Practical knowledge on thinking about windowing and time in @kafkastreams.bsky.social We are going to ship new tutorials regularly over the next few months, and you can find them all here: www.responsive.dev/resources/ka...
0151
Reposted by Apurva Mehta
Almog @almog.xyz · 23/01/2025
There are some learnings that only come from having seen a wildly successful technology go from a nascent project to ubiquitous. These insights can change the trajectory for new tech. Jason's summary about error handling is a great read for practical engineers: github.com/slatedb/slat...
github.com
API Error Guidance · Issue #454 · slatedb/slatedb
Dumping a few thoughts on API errors. At the moment, we have a single flat error SlateDBError which is exposed through the public API. This is the same pattern used in Kafka and there are some less...
0155
Apurva Mehta @apurvamehta.com · 15/01/2025
Sophie arguably has the best @kafkastreams.bsky.social blog posts on the internet. Now you get a say on what she should write about next!
160
Apurva Mehta @apurvamehta.com · 20/12/2024
👋
061
Apurva Mehta @apurvamehta.com · 19/12/2024
Kafka Streams had an amazing 2024! Check out @ableegoldman.bsky.social's year in review, where she recaps the 25 major improvements the community made to Kafka Streams! www.responsive.dev/blog/kafka-s...
responsive.dev
Kafka Streams Wrapped: 2024 in review
Kafka Streams had some tremendous additions and improvements in 2024. Here are the highlights.
0123
Reposted by Apurva Mehta
Chris @chris.blue · 16/12/2024
SlateDB now has range scans! An important feature for joins, time series, secondary indexes, and so on. Props to the folks @responsive.dev for getting this done. github.com/slatedb/slat...
0181
Apurva Mehta @apurvamehta.com · 13/12/2024
It was so much fun to observe the @responsive.dev team brainstorm distributed state snapshots for Kafka Streams using SlateDB/RS3. Nothing beats the thrill of having a team of the best engineers solving hard problems with nothing but a whiteboard in front of them!
1111
Apurva Mehta @apurvamehta.com · 12/12/2024
Great to see so many people online. If you want to hear about how Metronome scaled their Kafka streams apps to 10's of TBs of state and 10's of thousands of events/s, do tune in for the last few minutes!
050
Reposted by Apurva Mehta
Almog @almog.xyz · 12/12/2024
The momentum on SlateDB development can't be stopped! We're getting close to closing out another foundational RFC by @flaneur2024.bsky.social: transactions 🏦 Mostly taking inspiration from Badger, but there's some innovative stuff there. Check it out: github.com/slatedb/slat...
github.com
docs: Add rfc about Transaction by flaneur2020 · Pull Request #260 · slatedb/slatedb
fixes #248 this doc is still in WIP, but the discussion is open here. TLDR of this doc: Snapshot (with sequence number in keys) and WriteBatch are MUST before working on the Transaction feature SS...
0125
Reposted by Apurva Mehta
Sophie Blee-Goldman @ableegoldman.bsky.social · 11/12/2024
For any Kafka Streams fans out there who want to know what it's like scaling an EOS application up to multiple TB of state at ~10k+ records/s with minimal downtime -- make sure to catch the Q&A we're hosting tomorrow with Metronome. Join us Dec 12th at 9:30am PST! www.linkedin.com/events/72647...
linkedin.com
Q&amp;A: Scaling Event Driven Architectures with Metronome | LinkedIn
We're hosting a live Q&A session with two engineers who have seen it all: - Casey Crites, a founding engineer at Metronome, implemented and scaled the Kafka pipeline at Metronome from zero to where i...
0114
Apurva Mehta @apurvamehta.com · 11/12/2024
The best thing about doing a startup is that you have the absolute freedom to invest in creative ideas with absolute accountability. The bad thing is that 99% of your ideas will fail. The most important asset in my experience is being able to use failure as a fuel for more creativity.
060
Reposted by Apurva Mehta
Chris @chris.blue · 05/12/2024
First new post in a couple of weeks! There's been a lot of activity around regattastorage.com this week, so I decided to write about the space. tl;dr It's pretty exciting!
materializedview.io
The Quest for a Distributed POSIX-Compatible Filesystem
Distributed POSIX filesystems have proven elusive, but we're getting closer. Perhaps that's all we need.
2209
Apurva Mehta @apurvamehta.com · 05/12/2024
It's remarkable how popular Kafka Streams is. Here's data for people searching for solutions to their Kafka Streams problems and landing on @responsive.dev. That's an up-and-to-the-right chart I love! On that note, what's the best book or blog you've read for optimizing website conversions?
351
Apurva Mehta @apurvamehta.com · 04/12/2024
This was a fun conversation with @thegeeknarrator.bsky.social and @yingjunwu.bsky.social about the world of SQL stream processing on one side and event driven apps on the other. Thanks for having me on the show, Kaivalya!
183
Reposted by Apurva Mehta
Chris @chris.blue · 04/12/2024
"SQL is a great language for expressing ETL and analytics logic, but it has never been a language developers pick for expressing application logic. By contrast, Responsive was founded on the belief that the true value of stream processing is in the new applications you can build with event streams."
responsive.dev
Founder's Letter: Responsive and the Future of Stream Processing
A recap of all that we've built in our first 18 months as a company, and what that means for the future of stream processing.
3293
Reposted by Apurva Mehta
The Streaming Otter @thestreamingotter.bsky.social · 04/12/2024
KIP-1104 is completed. It closes such an obvious gap in the FK-join API that I am wondering why it was not done this way in the first place... (and why did it not come up much earlier?) Well, we will have it with upcoming 4.0 release. Better now than never. cwiki.apache.org/confluence/d...
cwiki.apache.org
KIP-1104: Allow Foreign Key Extraction from Both Key and Value in KTable Joins - Apache Kafka - Apache Software Foundation
032
Apurva Mehta @apurvamehta.com · 03/12/2024
Is stream processing interesting because of the new apps it enables, or because it promises better data processing? I'm in the first camp and am proud of the major contributions Responsive has made to the application space. My reflections on what's next: www.responsive.dev/blog/respons...
responsive.dev
Founder's Letter: Responsive and the Future of Stream Processing
A recap of all that we've built in our first 18 months as a company, and what that means for the future of stream processing.
1132
Apurva Mehta @apurvamehta.com · 02/12/2024
With ChatGPT, higher level decision making will increasingly become bottleneck for any given project, and so its existence should really favor startups. For example, here's how I used ChatGPT during the rebuild of my personal website. (1/3)
130
Apurva Mehta @apurvamehta.com · 01/12/2024
I've always wanted to have a landing page for apurvamehta.com. But a blog was too much of a commitment and a short bio was too simple. @bsky.app allows you to display your feed on a static webpage, which is a perfect setup and is perfectly aligned with the 'your domain is your id' philosophy too!
5302
Apurva Mehta @apurvamehta.com · 26/11/2024
This thread sparked a lot of interest! Here's some more information on @responsive.dev's streaming storage engine (RS3). @rohanpd.bsky.social wrote about why SlateDB is the engine for RS3: www.responsive.dev/blog/why-sla...
responsive.dev
If not RocksDB, then what? Why SlateDB is the right choice for Stream Processing.
Why we think SlateDB is the right foundation for a state storage service for Kafka Streams.
130
Reposted by Apurva Mehta
Chris @chris.blue · 26/11/2024
The story of how SlateDB came to be. Couldn’t have happened without reponsive.dev. And now they’re launching RS3, a streaming storage backend, built on SlateDB. 🤩
0164
Apurva Mehta @apurvamehta.com · 26/11/2024
It's said that Silicon Valley is special because the density of smart and motivated people leads to chance encounters that don't happen elsewhere. I can attest to that. Here's how a coffee resulted in @responsive.dev building a database optimized for stream processing in 8 months. (1/n)
1236
Reposted by Apurva Mehta
Ryanne Dolan @ry.codes · 24/11/2024
Clusters are getting squeezed from above by smarter control planes, and from below by cheap and consistent object storage. www.linkedin.com/pulse/contro...
linkedin.com
Control Planes and the Death of the Cluster
The recent (few years) rediscovery of control plane architecture, largely due to the success of Kubernetes, is changing the way people think about distributed systems. Not many years ago, everything "...
2215
Apurva Mehta @apurvamehta.com · 23/11/2024
Most of my time in first 18 months of @responsive.dev has been spent on things I've never done before, like marketing and sales. Not only have I had to learn new domains, the effort needs to to work: there's no excuses for not having leads and customers! Here's how I approach it. Thread (1/n)
1141
Apurva Mehta @apurvamehta.com · 21/11/2024
The thread below seemed to resonate! For developers building new types of applications on Kafka, I think Kafka Streams is the best available technology. This is largely due to its embedded form factor: developers want to build apps, they don't want to manage clusters! (1/4)
194
Reposted by Apurva Mehta
Chris @chris.blue · 21/11/2024
SlateDB is now part of @commonhaus-fdn.bsky.social! I think we might be the first non-JVM project. Looking forward to more projects joining us here. Our experience with the foundation has been excellent so far. github.com/commonhaus/f...
github.com
SlateDB would like to join Commonhaus · commonhaus foundation · Discussion #213
Project information Project name: SlateDB Project website: https://slatedb.io Code repository: https://github.com/slatedb/slatedb License: Apache 2.0 Do you have authority to represent this project...
2296
Reposted by Apurva Mehta
The Streaming Otter @thestreamingotter.bsky.social · 20/11/2024
www.linkedin.com/video/event/...
081
Apurva Mehta @apurvamehta.com · 20/11/2024
Welcome @ableegoldman.bsky.social to BlueSky! Kafka Streams extraordinaire!
1125
Apurva Mehta @apurvamehta.com · 16/11/2024
From one of @responsive.dev 's customers: "will report back .. when we start to change ttl lengths, which we're currently set up to do through launchdarkly based on the client and environment...pretty slick." They are changing the TTL of rows in their Kafka Streams state stores dynamically 🤩
072