Sign in

Shayon Mukherjee

@shayonj.bsky.social
521 followers 246 following 40 posts

Everything, everywhere - always in progress 🏃‍♂️👨🏽‍🍳💻

PostsRepliesMedia
Shayon Mukherjee @shayonj.bsky.social · 27/10/2025
"So this Diwali, a small reminder to myself, and maybe to you. Light the lamp. Not just in your home, but between people. In conversation, in community, in the spaces where it’s hardest to do so. Choose warmth over heat. Choose curiosity over certainty.." www.shayon.dev/post/2025/30...
shayon.dev
Diwali
A personal reflection on Diwali. The festival of lights, the world I grew up in, and choosing light in darker times.
020
Shayon Mukherjee @shayonj.bsky.social · 04/10/2025
For funsies www.shayon.dev/post/2025/27...
shayon.dev
An MVCC-like columnar table on S3 with constant-time deletes
A thought experiment in building Parquet-like columnar table on S3 with row-level deletes using conditional writes, tombstone files, and a single-object transaction pointer.
000
Shayon Mukherjee @shayonj.bsky.social · 26/09/2025
⚖️
000
Shayon Mukherjee @shayonj.bsky.social · 10/08/2025
Bypass PostgreSQL catalog overhead with direct partition hash calculations www.shayon.dev/post/2025/22...
shayon.dev
Bypass PostgreSQL catalog overhead with direct partition hash calculations
Eliminating PostgreSQL catalog traversal overhead with local partition calculations for up to 20x faster hash partition queries.
020
Shayon Mukherjee @shayonj.bsky.social · 04/07/2025
This is what progress looks like
100
Shayon Mukherjee @shayonj.bsky.social · 22/06/2025
"The paradox of artificial general intelligence might be that the more we chase it, the more we appreciate what we already have: human intelligence, in all its messy, creative, contextual glory. And perhaps...." www.shayon.dev/post/2025/17...
shayon.dev
Is AGI paradoxical?
If AI learns from human intelligence, can it ever truly transcend its origins? Is AGI a technical milestone or philosophical mirage?
020
Shayon Mukherjee @shayonj.bsky.social · 17/06/2025
Good morning HN!
030
Shayon Mukherjee @shayonj.bsky.social · 13/06/2025
Fresh off the press - some raw thoughts on "Premature Closure" in the world of AI. www.shayon.dev/post/2025/16...
shayon.dev
Pitfalls of premature closure with LLM assisted coding
When LLM models generates clean, professional-looking code, it's tempting to stop exploring alternatives. But therein lies the risks that comes with premature closure. So what is premature closure?
020
Reposted by Shayon Mukherjee
Tines Engineering @tineseng.bsky.social · 09/06/2025
tines.com
Why We Moved Our ECS Services from Fargate to EC2 | Tines
At Tines, we migrated our ECS services from Fargate to EC2 to improve performance, reliability, and flexibility. Here’s what we learned.
002
Reposted by Shayon Mukherjee
Tines Engineering @tineseng.bsky.social · 16/05/2025
Engineering teams know all too well how hard on-call can be. At @tineseng.bsky.social , one tool is critical to how we make it easier: Tines. Izabela from our team shares how we do it: www.tines.com/blog/tines-a...
tines.com
How our engineering team improves the on-call experience with Tines | Tines
At Tines, we have two types of on-call: daytime and out-of-hours. In this blog, we explain the daytime on-call shift, its pros and cons, and how we make it easier by using Tines.
052
Shayon Mukherjee @shayonj.bsky.social · 15/05/2025
As much as I love shipping features, systems and performance wins just hit different! 🚀
041
Shayon Mukherjee @shayonj.bsky.social · 05/05/2025
Finding about PostgreSQL vacuums, heap truncation and standbys the hard way 🙃 github.com/postgres/pos...
github.com
020
Shayon Mukherjee @shayonj.bsky.social · 29/04/2025
This was a fun one www.shayon.dev/post/2025/11...
shayon.dev
A PostgreSQL planner gotcha with CTEs DELETE and LIMIT
How a seemingly straightforward DELETE query using a CTE and LIMIT returned more rows than expected due to query planner optimization.
000
Shayon Mukherjee @shayonj.bsky.social · 27/04/2025
github.com/shayonj/pg_h... Usually moving to partitioned tables come with a cost. Turns out calculating which partitioned table you can send your pointed queries (without querying database) makes those queries _extremely_ fast. More to come soon.
github.com
GitHub - shayonj/pg_hash_func: Determine the target partition index for an integer key according to PostgreSQL's default hash strategy, without querying the database
Determine the target partition index for an integer key according to PostgreSQL's default hash strategy, without querying the database - shayonj/pg_hash_func
020
Shayon Mukherjee @shayonj.bsky.social · 22/04/2025
Reverse engineering PostgreSQL's hashfn.c (github.com/postgres/pos...) in Ruby to speed up point queries on partitioned tables (as one does 😂)
github.com
010
Reposted by Shayon Mukherjee
Dan McKinley @mcfunley.com · 28/03/2025
I have some thoughts about boringtechnology.club for you, as the work turns ten years old this weekend.
boringtechnology.club
Choose Boring Technology
How to be old, for young people.
2317
Reposted by Shayon Mukherjee
Craig @craigkerstiens.com · 19/03/2025
Great article from @shayonj.bsky.social about async vs. sync commit in Postgres. I've talked about this with folks for year that it's not all or nothing you can toggle per session/transaction/etc. Though can't recall many folks writing it up, so thanks! www.shayon.dev/post/2025/75...
shayon.dev
Selective asynchronous commits in PostgreSQL - balancing durability and performance
Safely leverage PostgreSQL's asynchronous commit for significant performance gains
051
Shayon Mukherjee @shayonj.bsky.social · 16/03/2025
Wrote a bit about an interesting find lately www.shayon.dev/post/2025/75...
shayon.dev
Selective asynchronous commits in PostgreSQL - balancing durability and performance
Safely leverage PostgreSQL's asynchronous commit for significant performance gains
021
Shayon Mukherjee @shayonj.bsky.social · 09/03/2025
Are folks running PostgreSQL DBs with synchronous_commit on or off? 🌶️
100
Shayon Mukherjee @shayonj.bsky.social · 22/02/2025
"While these tools boost productivity, they’re not a replacement for critical thinking. Taking the time to understand why something works (or breaks) and building strong mental models isn’t just busy work..." www.shayon.dev/post/2025/53...
shayon.dev
Challenging AI generated code from first principles
While these tools boost productivity, they're not a replacement for critical thinking. Taking the time to understand why something works (or breaks) and building strong mental models isn't just busy w...
000
Shayon Mukherjee @shayonj.bsky.social · 09/02/2025
Some more ramblings from working on PostgreSQL (Had its brief moment on HN) www.shayon.dev/post/2025/40...
shayon.dev
Scaling with PostgreSQL without boiling the ocean
Practical scaling strategies for application developers who don't have a dedicated database team
162
Shayon Mukherjee @shayonj.bsky.social · 06/12/2024
Counting is a hard problem.
010
Shayon Mukherjee @shayonj.bsky.social · 25/11/2024
Planning a wedding with your parents is a group project that no one prepared you for.
000
Shayon Mukherjee @shayonj.bsky.social · 24/11/2024
Post run, half baked thought: In memory store, flush to S3 every N interval. Reader replicas straight from S3 (?) New S3 primitives (conditional writes, and append only) for strong consistency and other good semantics. Costs ? Unknown 💸
000
Shayon Mukherjee @shayonj.bsky.social · 19/11/2024
Rollercoaster of emotions next few days.
030
Shayon Mukherjee @shayonj.bsky.social · 18/11/2024
Very heartwarming to see other companies finding pg_easy_replicate (born out of @TinesEng) useful for large scale PostgreSQL migrations 🫶🏽 github.com/shayonj/pg_e...
github.com
Cross Cloud Migration Validated · Issue #187 · shayonj/pg_easy_replicate
Just wanted to put this out there - cross cloud migration is validated. It is definitely possible to migrate from AWS >> Azure or vice versa, the only minor preparation step is that you need to ens...
020
Shayon Mukherjee @shayonj.bsky.social · 04/11/2024
Just realized with pg_flo you can use the same DB as both source & destination. This lets you create shadow tables & remap data flows within a single DB using the routing feature. Useful for data migrations when you need time to verify data integrity! www.pgflo.io
pgflo.io
pg_flo - Stream, transform, and route PostgreSQL data in real-time
pg_flo is a powerful PostgreSQL data replication tool that enables real-time streaming, table routing, data transformation, and secure data masking between databases.
000
Shayon Mukherjee @shayonj.bsky.social · 03/11/2024
Happy to see pg_flo in top 5 on Hacker News today. Looks like all positive feedback. Excited to continue hacking on it.
120
Shayon Mukherjee @shayonj.bsky.social · 29/10/2024
Wrote a few words about using #PostgreSQL page location (CTID) for large data cleanups as a workaround www.shayon.dev/post/2024/30...
shayon.dev
Using CTID Based Pagination for Data Cleanups in PostgreSQL
When dealing with very large PostgreSQL tables (we're talking 15TB+), sometimes routine maintenance like archiving very old data can become surprisingly challenging
010
Shayon Mukherjee @shayonj.bsky.social · 27/10/2024
Just shipped the v1 of new table routing feature in pg_flo. This way you can easily route PostgreSQL changes to different tables & column names in the target database. Lots more soon. In the mean time, a small and simple site: www.pgflo.io
pgflo.io
pg_flo - Stream, transform, and route PostgreSQL data in real-time
pg_flo is a powerful PostgreSQL data replication tool that enables real-time streaming, table routing, data transformation, and secure data masking between databases.
010
Reposted by Shayon Mukherjee
v @handle.invalid · 26/10/2024
Reminder: SQLite is 35% faster than the filesystem while also using 20% less disk space read more here: www.sqlite.org/faste...
heading: 35% Faster Than The Filesystem

SQLite reads and writes small blobs (for example, thumbnail images) 35% faster¹ than the same blobs can be read from or written to individual files on disk using fread() or fwrite().

Furthermore, a single SQLite database holding 10-kilobyte blobs uses about 20% less disk space than storing the blobs in individual files.
2122
Shayon Mukherjee @shayonj.bsky.social · 25/10/2024
Noodling on a tool to sync (CDC)between Postgres DBs. Define rules to anonymize, filter, or transform data before it reaches the destination. Considering a cloud version as well to keep it zero-touch-ops. Just setup & go. Early days, open to feedback. Design is flexible github.com/shayonj/pg_flo
github.com
GitHub - shayonj/pg_flo: Easiest way to move and transform data between PostgreSQL databases
Easiest way to move and transform data between PostgreSQL databases - shayonj/pg_flo
130
Shayon Mukherjee @shayonj.bsky.social · 24/10/2024
Not a yolo day, today.
020
Reposted by Shayon Mukherjee
Lawrence Jones @lawrencejones.dev · 21/10/2024
Ok so turns out this is possible! There's a Chrome extension called Sky Follower Bridge that does the matching for you. This worked with zero drama.
Screenshot of the matches
121
Reposted by Shayon Mukherjee
Craig @craigkerstiens.com · 21/10/2024
Giving this starter pack thing a try, if you want a little Postgres in your feed (and who doesn't) here's some folks work a follow - go.bsky.app/Acp7hmk
23917