Sign in

shikhar

@schmizz.net
2.2K followers 476 following 159 posts

Making streams serverless @s2.dev

PostsRepliesMedia
shikhar @schmizz.net · 28/08/2026
we took gists and made them live!
020
Reposted by shikhar
Mehul Arora @infiniteregrets.bsky.social · 30/07/2026
You can now use S2 as a backend for Mastra Durable Agents! The @ s2-dev/mastra-pubsub adapter maps each durable topic to an S2 stream, with live delivery, replay after refreshes or process restarts, and distributed leases for coordinating thread ownership across processes.
142
shikhar @schmizz.net · 29/07/2026
What if your brain could be a pet? @anthropic.com have shared the benefits of decoupling the brain from its hands. We have also written about using a stream per agent session as a WAL and what that unlocks. If it seems complicated, it is. And durable execution frameworks are far too intrusive.
110
shikhar @schmizz.net · 24/07/2026
no reliability without durability
030
Reposted by shikhar
s2.dev @s2.dev · 20/07/2026
S2 source and sink plugins are now available for Streamling. Read durable S2 streams into Arrow batches, or write Streamling output back to S2. ClickHouse ingestion, Postgres CDC, and a full Postgres → S2 → ClickHouse example: s2.dev/docs/integr...
042
shikhar @schmizz.net · 15/07/2026
me deciphering llmese
040
shikhar @schmizz.net · 12/07/2026
Also considered EFS, inspired by S3 Files being EFS in a trench coat. Built an async Rust lib that lets you use NFS directly from application code. It performs better than a Linux mount, but writes are an order of magnitude slower than what's achievable by purpose-building. Reads look great though.
150
shikhar @schmizz.net · 10/07/2026
thinking about a single-digit ms storage class for @s2.dev it's a plunge from just being s3-based, but gotta do what you gotta do?
030
shikhar @schmizz.net · 07/07/2026
try the notion or gdocs experience in a regular editor!
010
shikhar @schmizz.net · 01/07/2026
literally serving off his Jetson: streamtts.dev
streamtts.dev
streamtts
010
Reposted by shikhar
Mehul Arora @infiniteregrets.bsky.social · 29/06/2026
Seems like Local AI is getting more and more relevant, so I wrote about it! s2.dev/blog/local-ai
s2.dev
Serving Local AI on my Jetson through Durable Streams
Its time to self-host!
063
Reposted by shikhar
s2.dev @s2.dev · 14/06/2026
If you have wondered whether to use the s2.dev cloud service, or self-host s2-lite (github.com/s2-streamstore/s2) – s2.dev/docs/s2-lite...
021
shikhar @schmizz.net · 09/06/2026
Cargo.lock +40 -1,142 nbd just @sbalogh.bsky.social replacing polars with csv
040
shikhar @schmizz.net · 08/06/2026
Serverless gets clowned on sometimes (ha ha, there are servers) but is ultimately about pricing usage and not having to provision resources you don't use, or think about such things as "clusters". It is genuinely hard for stateful services, but I don't think there is a better DevX.
030
shikhar @schmizz.net · 01/06/2026
turns out "stream per session" is not just for agents. it works for browser sessions too. built RePlaya, a self-hosted session replay tool where each visit is just an @s2.dev stream you can play back or tail live. recording = append playback = read live replay = tail github.com/s2-streamsto...
031
Reposted by shikhar
s2.dev @s2.dev · 29/05/2026
Streams as a cloud storage primitive, now in more places. S2 is the serverless API for unlimited, durable, real-time streams. Today, we're adding US West and EU North as new basin locations. s2.dev/blog/locatio...
s2.dev
Two new locations for your streams: US West and EU North
S2 introduces location as a first-class construct, with two new ones to choose from: western US and northern Europe.
031
Reposted by shikhar
Mehul Arora @infiniteregrets.bsky.social · 15/05/2026
You can plug @s2.dev into your anthropic sdk based chat app and make your chats durable!
142
Reposted by shikhar
Mehul Arora @infiniteregrets.bsky.social · 01/05/2026
oh and tanstack ai too!
102
shikhar @schmizz.net · 30/04/2026
Maybe QUIC is an opening for a gRPC challenger. I would call it Spooky. For spooky action at a distance, the outmoded critique of RPC.
030
shikhar @schmizz.net · 30/04/2026
On the retirement of S2's gRPC API, realized how to describe our current API: REST-first. REST undersells, it supports append & read sessions over HTTP/2 similar to gRPC. We'll do HTTP/3 too when the ecosystem is ready.
030
shikhar @schmizz.net · 27/04/2026
maybe it's not too surprising plaintext can be competitive with vector dbs when you consider agents effectively do semantic grep by query expansion
020
shikhar @schmizz.net · 27/04/2026
@s2.dev now supports client-supplied encryption keys for durable streams. Bring your own per-request key, keep key material out of S2 storage and logs, and let S2 handle request-time encryption behind the stream API. s2.dev/blog/encrypt...
s2.dev
Your data, your keys
S2 now supports client-supplied encryption keys for durable streams, giving teams control over key material without changing record APIs.
052
shikhar @schmizz.net · 24/04/2026
Today I felt like a cigarette. I have to say "coding" agents are a champ at operational investigation.
AWS GuardDuty false positive credential exfil reports with EKS
100
Reposted by shikhar
Mehul Arora @infiniteregrets.bsky.social · 21/04/2026
Make your aisdk chat app crash proof by using s2.dev as the persistence layer behind useChat!
173
shikhar @schmizz.net · 14/04/2026
gotta constraint to innovate
010
shikhar @schmizz.net · 08/04/2026
new Dart SDK for @s2.dev from the community: pub.dev/packages/s2_...
pub.dev
s2_sdk_dart | Dart package
Dart SDK for S2 Stream Store.
031
shikhar @schmizz.net · 18/03/2026
This is video conferencing on S2, but also... video conferencing on S3. Really shows off the power of pipelining writes!
020
shikhar @schmizz.net · 06/03/2026
Pipelining is now default in latest s2-lite! 8x increase in throughput and 6x lower latency when running against an S3 standard bucket.
060
Reposted by shikhar
Mehul Arora @infiniteregrets.bsky.social · 04/03/2026
There's two new ways to manage S2 as code! The Terraform provider lets you manage resources with full lifecycle support. Available on the Terraform Registry at s2-streamstore/s2. Or you can use the CLI by `s2 apply` which takes a declarative JSON spec and creates/reconfigures specified resources.
232
shikhar @schmizz.net · 03/03/2026
Excited to enable pipelining by default in s2-lite with this upgrade! Expect lower latency and higher throughput. github.com/s2-streamsto...
github.com
default to pipelining appends and remove `S2LITE_PIPELINE` knob · Issue #48 · s2-streamstore/s2
Improves performance a lot against high-latency object storage Depends on slatedb/slatedb#1138
021
Reposted by shikhar
Mehul Arora @infiniteregrets.bsky.social · 27/02/2026
The s2.dev dashboard now has a Data Plane studio to make it convenient to work with streams. You can: -Do one-shot reads, live tail from any stream, start from an offset, seq no., or timestamp -Append records in multiple modes -Run stream commands -Inspect records with command record aware rendering
032
Reposted by shikhar
s2.dev @s2.dev · 25/02/2026
The S2 cloud service is now GA! We also raised a $3.85M seed round led by Accel with participation from Y Combinator, and other funds and angels like @t3.gg @chris.blue @fulmicoton.bsky.social s2.dev/blog/ga
s2.dev
General availability & our seed round
S2 is now GA. Plus, $3.85M in seed funding led by Accel.
2146
Reposted by shikhar
Mehul Arora @infiniteregrets.bsky.social · 22/02/2026
It was fun to run multi-agent research cohorts and have them connect over durable streams, making infinitely many reasoning topologies possible!
133
shikhar @schmizz.net · 17/02/2026
We have landed on an open source monorepo for the Rust SDK, CLI, and s2-lite github.com/s2-streamsto...
github.com
GitHub - s2-streamstore/s2: Durable Streams API
Durable Streams API. Contribute to s2-streamstore/s2 development by creating an account on GitHub.
161
Reposted by shikhar
s2.dev @s2.dev · 16/02/2026
Curious about the architecture of S2? This is how we cook infinite durable streams for you.
s2 cell architecture diagram
174
Reposted by shikhar
Mehul Arora @infiniteregrets.bsky.social · 30/01/2026
just got finished no-lifing on building a TUI for s2, wdyt?
262
shikhar @schmizz.net · 28/01/2026
Thanks to Claude, I can frontend. Shipped some improvements to the stream tailing UX in the @s2.dev dashboard.
130
shikhar @schmizz.net · 21/01/2026
s2-lite is here – an open source @s2.dev Stream Store! It's a single binary you can run anywhere. Powered by SlateDB, so you can point it at an object storage bucket for durable streams with real-time reads. github.com/s2-streamsto...
1226
shikhar @schmizz.net · 29/12/2025
www.youtube.com/watch?v=21EY...
youtube.com
Richard Sutton – Father of RL thinks LLMs are a dead end
YouTube video by Dwarkesh Patel
020
shikhar @schmizz.net · 29/12/2025
The era of experience calls for event sourcing via paper by David Silver and Richard Sutton, storage.googleapis.com/deepmind-med...
020
shikhar @schmizz.net · 27/12/2025
Thankful to the @s2.dev team for all the progress we made this year! Really excited for 2026. Some highlights 🧵
684
shikhar @schmizz.net · 28/11/2025
Very vegan sentiment from Ilya Sutskever about aligning AI to care about sentient life rather than human in particular www.youtube.com/watch?v=aR20...
youtube.com
Ilya Sutskever – We're moving from the age of scaling to the age of research
YouTube video by Dwarkesh Patel
070
shikhar @schmizz.net · 26/11/2025
Make small writes cheap again
020
shikhar @schmizz.net · 12/11/2025
We are at SyncConf SF! Find us or DM if you wanna chat streams (or logs if you prefer!)
032
shikhar @schmizz.net · 11/11/2025
Definitely seeing the argument against non-standard runtimes – @cloudflare.social Workers don't support http2
010
shikhar @schmizz.net · 09/11/2025
@s2.dev YC-launched today! www.ycombinator.com/launches/OnP...
1102
shikhar @schmizz.net · 07/11/2025
Excited to be diving into this! Open source, self-hosting, and an emulator have been big asks - and "s2-lite" will solve for all of those.
081
Reposted by shikhar
Mehul Arora @infiniteregrets.bsky.social · 02/11/2025
just tried out the real-time TodoMVC example with @livestore.dev + @s2.dev as the durable sync provider, and honestly its crazy how fast it is! local SQLite, works offline, real-time updates and no complex setup, just works
1144
shikhar @schmizz.net · 23/10/2025
she is @antithesis.com
361
shikhar @schmizz.net · 20/10/2025
s3 express never made the list on aws status, but all 3 use1 zones were unavailable 07.50Z-09.21Z
130