Sign in

Samyak Sarnayak

@samyak.me
30 followers 102 following 17 posts

rust, systems, query engines, pl samyak.me

PostsRepliesMedia
Reposted by Samyak Sarnayak
Hillel @hillelwayne.com · 29/07/2026
I am delighted to announce that after 5 years of work, 15 early releases, 50,000 words written, and 100,000 more deleted, *Logic for Programmers* is now complete and available in print! Blog post announcement: www.hillelwayne.com/post/lfp/ Website: logicforprogrammers.com
logicforprogrammers.com
Logic for Programmers
Practical math for the working programmer.
1020348
Reposted by Samyak Sarnayak
Iroh @iroh.computer · 15/06/2026
We just released the first stable version of iroh, v1.0! Read about it: www.iroh.computer/blog/v1 We're super proud of where we landed with iroh's 1.0. Since version 0.35 it feels like we've entirely replaced the "engine underneath". Are you a fellow key-dialer? Come tell us how you use iroh!
iroh.computer
Iroh 1.0 - Dial Keys, not IPs
Iroh 1.0 is out. Now is the time to build.
721862
Samyak Sarnayak @samyak.me · 05/06/2026
Code is here: tangled.org/samyak.me/he... (just don't look at the commit messages)
tangled.org
samyak.me/hexastack
game
030
Samyak Sarnayak @samyak.me · 05/06/2026
Progress update: got a grid system working! Huge shoutout to www.redblobgames.com/grids/hexago.... I could not have figured out the grid without that. #gamedev #rustlang
171
Reposted by Samyak Sarnayak
Functional Programming India @fpindia.bsky.social · 04/06/2026
Announcing the June #Bangalore #FPIndia #Meetup! Our first talk is Type-level Programming in #Haskell, presented by Abhinav! Like always, meet fellow FP heads, have great conversations, all skill levels welcome! RSVP hasgeek.com/fpindia/bang... #PureScript #Typescript #Rust #Erlang #Scala #OCaml
hasgeek.com
Bangalore FP June 2026 meetup
Bangalore FP June 2026 meetup
031
Samyak Sarnayak @samyak.me · 22/05/2026
It’s an honor for my talk to be recommended by Andrew (PMC Chair for DataFusion). The recording is up, check it out!
051
Samyak Sarnayak @samyak.me · 21/05/2026
Done! Thanks for the link
020
Reposted by Samyak Sarnayak
Andrew Lamb @andrewlamb1111.bsky.social · 21/05/2026
I just had the chance to watch @samyak.me 's talk about cancellation safety and async Rust (and how a `&mut` can lead to a deadlock). If this is a topic that interests you, I recommend checking it out: samyak.me/talks/cancel/
1112
Samyak Sarnayak @samyak.me · 18/05/2026
We have seen this delay go up to 15s for large queries!
000
Samyak Sarnayak @samyak.me · 18/05/2026
The abort is asynchronous. So the streams and plans would have dropped cleanly, but the tasks may continue running until they yield and then until their drop completes. So there’s a delay in “query cancelled” (ExecutionPlan dropped) vs “all memory held by the query is freed”.
100
Samyak Sarnayak @samyak.me · 18/05/2026
Thanks for the link! I had come across this PR too. But this wasn’t the problem in our case. I will try opening an issue with a reproducer soon. This is the gist of the problem: RepartitionExec spawns tasks directly on the tokio executor. These tasks are `.abort()`ed when the query plan drops.
100
Samyak Sarnayak @samyak.me · 17/05/2026
So I was wondering how you handle this in prod at InfluxDB. Or is this not a problem for your system?
100
Samyak Sarnayak @samyak.me · 17/05/2026
There’s no way to wait for all tasks to finish (and thus all mem to be freed). So what happens is sometimes we let a query in while the previous query is still holding mem. (This was a recent issue we had faced, it wasn’t covered in my talk)
200
Samyak Sarnayak @samyak.me · 17/05/2026
Even with all the great work that went into cancellation in DataFusion, we had seen some problems in prod. They were due to CoalescePartitionsExec and RepartitionExec spawning tasks which only get cooperatively cancelled on Drop.
100
Samyak Sarnayak @samyak.me · 17/05/2026
2. It was a shame that you couldn’t cover cancellation. I was hoping you would and referenced your future talk in my talk lol (samyak.me/talks/cancel/). I think it’s a very interesting topic and probably deserves a separate talk.
samyak.me
Cancellation in async rust - Samyak Sarnayak
My talk at Rust India Conference 2026 on cancellation in async rust
210
Samyak Sarnayak @samyak.me · 17/05/2026
(a) tokio task budgets integration could cause the task to yield in the middle of processing a batch. That task could then start on a different thread, right? (b) hashmaps used in join/agg could get evicted from the cache if a different task runs on a thread which was holding it. What do you think?
100
Samyak Sarnayak @samyak.me · 17/05/2026
Great talk! Couple of things: 1. It wasn’t clear to me how DataFusion avoids cpu cache misses due to tasks being moved around. I get that one RecordBatch is processed on one task (the volcano/morsel model). But I can still see two cases where work stealing can affect this.
100
Reposted by Samyak Sarnayak
Functional Programming India @fpindia.bsky.social · 17/05/2026
The wait is over #Bangalore! #FPIndia #meetup this weekend! Saachi will talk about building chess provers using #Lean. Plus, the usual nerdy debates, and catching up with fellow FP heads. Don't miss it! hasgeek.com/fpindia/bang... #Haskell #PureScript #Erlang #Scala #OCaml #TypeScript #Rust #Clojure
hasgeek.com
Bangalore FP May 2026 meetup
Bangalore FP May 2026 meetup
052
Samyak Sarnayak @samyak.me · 04/05/2026
@psiayn.bsky.social and I trying to get back at game dev. First image from engine (bevy), second one from blender (cycles). #gamedev #rustlang
A MacOS window showing a hexagonal building being rendered. Cyberpunk aesthetics.Same image, but looks way better being rendered in cycles (blender).
0122
Samyak Sarnayak @samyak.me · 02/05/2026
Recordings for the Rust India Conference 2026 are up! (including my talk on cancellation in async rust) youtube.com/playlist?lis... #rust
youtube.com
Rust India Conference 2026 — Full Talk Recordings - YouTube
📅 April 18, 2026 | 📍 NIMHANS Convention Centre, Bengaluru, India Rust India Conference 2026 is India's first national Rust conference — a single-track, techn...
000
Samyak Sarnayak @samyak.me · 30/04/2026
It looks like it's going to be disabled by default for now: github.com/tokio-rs/tok...
github.com
Make LIFO slot stealing opt-in by Darksonn · Pull Request #8092 · tokio-rs/tokio
We made it possible to steal the LIFO slot in #7431, but this causes a performance regression #8065. Thus, make it opt-in. The feature is split into two options: Can stealing happen at all? Are wo...
010
Samyak Sarnayak @samyak.me · 13/04/2026
I'm giving a talk on cancellation in async rust! It's at the Rust India Conference: hasgeek.com/rustbangalor...
010
Reposted by Samyak Sarnayak
Phil Eaton @eatonphil.bsky.social · 09/04/2026
DataFusion 53 came out last week. I took a look at the individuals and companies who committed the most. (paywall has expired) theconsensus.dev/p/2026/04/03...
1103