Sign in

fjallrs.bsky.social

@fjallrs.bsky.social
126 followers 36 following 157 posts

Snazzy Rust KV store @ github.com/sponsors/fjall-rs

PostsRepliesMedia
Reposted by @fjallrs.bsky.social
Trifecta Tech Foundation @trifectatech.bsky.social · 01/06/2026
We're proud to announce the first release of our latest data compression project, Zstandard in Rust! Read why we did this, the current state of the project, and where we're hoping to take it: buff.ly/JoruN7e Thanks to Chainguard, Astral, NLnet Foundation, and @sovereign.tech. #rustlang #opensource
trifectatech.org
Announcing Zstandard in Rust - Trifecta Tech Foundation
Over the past year, we've been silently working on our third compression project. After zlib and bzip2 we're now taking on zstd with libzstd-rs-sys, and are proud to announce its first release.
14914
fjallrs.bsky.social @fjallrs.bsky.social · 30/03/2026
fjall is at 1989 stars 😵 - The road to 2K is on!!
040
fjallrs.bsky.social @fjallrs.bsky.social · 07/03/2026
Oh yeah bluesky exists too. I just released 3.1 - which features compaction filter support, meaning you can custom logic during compaction (e.g. TTL rules, or soft deletions)! fjall-rs.github.io/post/fjall-3...
fjall-rs.github.io
Fjall 3.1: Compaction filters
Run custom logic during compactions
1151
Reposted by @fjallrs.bsky.social
fig (aka:[phil]) @bad-example.com · 06/01/2026
the sheer speed from initial bug report to @fjallrs.bsky.social getting a fix fully released is just wild.
github.com
Release 3.0.1 · fjall-rs/fjall
[fix] Edge case that could result in the second memtable being dropped before being flushed [fix] Custom filter policy not being applied
161
fjallrs.bsky.social @fjallrs.bsky.social · 02/01/2026
A strange moment, but - I just released 3.0.0. fjall-rs.github.io/post/fjall-3/ What has started as a rewrite of the block format has become almost a full rewrite, interrupted by a bachelor's thesis, faulty hardware and a couple of weeks of sickness - but I think the end product is pretty good.
fjall-rs.github.io
Releasing Fjall 3.0
A year in the making
3216
fjallrs.bsky.social @fjallrs.bsky.social · 24/12/2025
Love it when SQLite just stops working but allocates hundreds of GBs of disk space.
Initial curve was bulk ingestion
030
Reposted by @fjallrs.bsky.social
Carl Sverre @f0a.org · 09/12/2025
Check out my talk on physical replication and Graft that I delivered at the recent @syncconf.bsky.social in SF. youtu.be/QoKzDyH2MEA?...
youtu.be
Carl Sverre (SQLSync) - Why Physical Replication Still Matters
YouTube video by Local-First Conf
053
fjallrs.bsky.social @fjallrs.bsky.social · 07/12/2025
Well... looks like my Kingston disk just died...?!
121
fjallrs.bsky.social @fjallrs.bsky.social · 02/12/2025
This year's winter album... goes to Maria Somerville youtu.be/k9qEKyQ7jc4
youtu.be
Maria Somerville - Projections (Official Video)
YouTube video by Maria Somerville
010
fjallrs.bsky.social @fjallrs.bsky.social · 25/11/2025
RC 1 is out! I forgot to post about RC 0, but here we are. At this point API and disk format are unlikely to further change - now it's all about stabilization for the final release... crates.io/crates/fjall...
crates.io
crates.io: Rust Package Registry
1102
fjallrs.bsky.social @fjallrs.bsky.social · 13/11/2025
v3 pre.6 is out - probably the penultimate prerelease before going into release candidate(s). At this point, all major architectural reworks are done, and just some APIs need some changes. Followed by a final cleanup and stabilization phase. crates.io/crates/fjall...
crates.io
crates.io: Rust Package Registry
1102
fjallrs.bsky.social @fjallrs.bsky.social · 08/11/2025
3.0.0 pre.5 is out and brings journal compression support. Here's 16K JSON blobs being written:
172
fjallrs.bsky.social @fjallrs.bsky.social · 28/10/2025
v3 pre-release 2 is out! Still not file format -or API stable, but most importantly this release marks lsm-tree being *feature complete*. crates.io/crates/fjall...
crates.io
crates.io: Rust Package Registry
151
fjallrs.bsky.social @fjallrs.bsky.social · 26/10/2025
Well, it was a faulty RAM stick everybody
061
fjallrs.bsky.social @fjallrs.bsky.social · 25/10/2025
So I have now tried btrfs, xfs, ext4 on two diff. SSDs, updating to Ubuntu 24; and I'm still getting corruptions... at this point I don't really know what to do. This is not code specific (RocksDB is also affected), yet I don't understand how my OS and all apps just seem to continue to work fine...
152
fjallrs.bsky.social @fjallrs.bsky.social · 09/10/2025
95% Zipfian reads, 5% random updates on a Kingston PLP SSD with 16K JSON blobs - sled DNF! (OOM) fjall uses LZ4 compression
250
Reposted by @fjallrs.bsky.social
fig (aka:[phil]) @bad-example.com · 08/10/2025
constellation runs on a bare metal server with 4 dedicated CPU cores, 16GiB memory, 1TiB fast NVMe SSD attached, and 500mbit unmetered network connection.
2443
fjallrs.bsky.social @fjallrs.bsky.social · 05/10/2025
Blob GC working again (now fully automatic) - much less impact on foreground work (old GC was stop-the-world)
081
fjallrs.bsky.social @fjallrs.bsky.social · 02/10/2025
Fun coloured bars and lines
374
Reposted by @fjallrs.bsky.social
fjallrs.bsky.social @fjallrs.bsky.social · 26/09/2025
If you sponsor NOW (github.com/sponsors/fja...), you can get an exclusive preview of version 3!! jk I pushed the first pre-release to crates.io - it's unstable though! Breakages guaranteed, and some APIs are missing! bye
github.com
Sponsor @fjall-rs on GitHub Sponsors
Support fjall-rs's open source work
086
fjallrs.bsky.social @fjallrs.bsky.social · 26/09/2025
If you sponsor NOW (github.com/sponsors/fja...), you can get an exclusive preview of version 3!! jk I pushed the first pre-release to crates.io - it's unstable though! Breakages guaranteed, and some APIs are missing! bye
github.com
Sponsor @fjall-rs on GitHub Sponsors
Support fjall-rs's open source work
086
fjallrs.bsky.social @fjallrs.bsky.social · 23/09/2025
ngl v3 is a bit more involved than I originally planned or anticipated; I don't want breaking changes for a while, so it becomes this chase of making sure everything is really future-proof
130
fjallrs.bsky.social @fjallrs.bsky.social · 18/09/2025
I will never do a major release like this again
171
fjallrs.bsky.social @fjallrs.bsky.social · 16/09/2025
I really dread having to some day write a quick_cache replacement, tailored for lsm-tree
020
fjallrs.bsky.social @fjallrs.bsky.social · 06/09/2025
friendship with ext4 ended, xfs is my new best friend (whyyy is ext4 still giving me corruptions sometimes, even after updating my kernel??)
140
fjallrs.bsky.social @fjallrs.bsky.social · 06/09/2025
Yeah, that's a bit better
031
fjallrs.bsky.social @fjallrs.bsky.social · 24/08/2025
For weeks I've been regularly getting corruptions while running benchmarks... for RocksDB, too. It's infuriating because running a 15min+ benchmark is a coin flip whether it completes. Seems like it was an issue with my arguably outdated Linux kernel... there were ext4 corruption bugs a while ago.
040
Reposted by @fjallrs.bsky.social
Ryan Carniato @ryansolid.bsky.social · 14/08/2025
For a framework renowned for its innovation, it is funny how little Solid has changed in the last 7 years. Yeah we've innovated on features, fine-grained concurrency/hydration, streaming, server functions, single flight mutations, but the core tech and structure are untouched.
1361
fjallrs.bsky.social @fjallrs.bsky.social · 10/08/2025
History repeats itself
https://www.cs.princeton.edu/courses/archive/spring25/cos418/papers/rocksdb.pdfhttps://blog.cloudflare.com/moving-quicksilver-into-production/
120
fjallrs.bsky.social @fjallrs.bsky.social · 07/08/2025
Lovely 3D plots to sweeten the day
120
fjallrs.bsky.social @fjallrs.bsky.social · 26/05/2025
Refactoring a 3-level deep .iter().map() is something my future self will have to deal with
030
fjallrs.bsky.social @fjallrs.bsky.social · 09/05/2025
Oh
1101
fjallrs.bsky.social @fjallrs.bsky.social · 19/04/2025
I'm sorry afl, my fuzz test is just very sophisticated
010
fjallrs.bsky.social @fjallrs.bsky.social · 18/04/2025
1000??
150
fjallrs.bsky.social @fjallrs.bsky.social · 13/04/2025
Forgot to turn off the fuzz tester over night Well, at least now it's REALLY fuzz tested
020
Reposted by @fjallrs.bsky.social
Carl Sverre @f0a.org · 04/04/2025
My vancouver.systems talk is up! It's a deep dive on Graft—a transactional storage engine providing lazy, partial and strongly consistent edge replication. Thanks to Cameron Morgan and Kir Shatrov for hosting and @tavis.damnsimple.com for video! www.youtube.com/watch?v=eRsD...
youtube.com
Carl Sverre on "Storing small things in big places"
YouTube video by vancouver systems
063
Reposted by @fjallrs.bsky.social
Carl Sverre @f0a.org · 31/03/2025
What if your app could combine the simplicity of physical replication with the efficiency of logical replication? Meet Graft: lazy, partial, strongly consistent edge replication. #OpenSource #EdgeComputing #Replication sqlsync.dev/posts/stop-s...
sqlsync.dev
Stop syncing everything
Discover Graft, an open-source transactional storage engine built to solve the challenges of syncing data at the edge. Inspired by lessons from SQLSync, Graft enables lazy, partial, and strongly consi...
14022
fjallrs.bsky.social @fjallrs.bsky.social · 30/03/2025
2.8 fjall-rs.github.io/post/fjall-2... Probably the penultimate 2.x feature release?!
fjall-rs.github.io
Fjall 2.8
Better cache API & fast bulk loading
060
fjallrs.bsky.social @fjallrs.bsky.social · 29/03/2025
I think I just broke a couple of releases because "1.7.3" (or whatever) behaves differently in Cargo compared to e.g. NPM... I'm tilde-ing (~) everything now...
010
Reposted by @fjallrs.bsky.social
Ben @benjdd.com · 13/03/2025
Give it a read: pscale.link/io
pscale.link
IO devices and latency — PlanetScale
Take an interactive journey through the history of IO devices, and learn how IO device latency affects performance.
2245
fjallrs.bsky.social @fjallrs.bsky.social · 21/03/2025
Looks like I maybe found a rustc performance regression
030
fjallrs.bsky.social @fjallrs.bsky.social · 21/03/2025
A little blog post about Google's "Webtable" key-value schema and wide-column databases, and recreating it with Fjall. fjall-rs.github.io/post/recreat...
fjall-rs.github.io
Retracing Google’s steps: recreating the Webtable in Rust
The key-value design to store the entire internet
022
fjallrs.bsky.social @fjallrs.bsky.social · 17/03/2025
shoutout to all the cpu cores out there compacting rocksdb sstables
010
fjallrs.bsky.social @fjallrs.bsky.social · 17/03/2025
lsm trees
010
fjallrs.bsky.social @fjallrs.bsky.social · 11/03/2025
Looks like replacing std::slice::partition_point will push point read performance a bit further for heavily cached workloads
010
Reposted by @fjallrs.bsky.social
TypeScript @typescriptlang.org · 11/03/2025
Today we're thrilled to announce our effort to port the TypeScript compiler and language service to native code, gaining a 10x speed boost in build times and editor responsiveness! devblogs.microsoft.com/typescript/t...
devblogs.microsoft.com
A 10x Faster TypeScript - TypeScript
Embarking on a native port of the existing TypeScript compiler and toolset to achieve a 10x performance speed-up.
22971289
fjallrs.bsky.social @fjallrs.bsky.social · 08/02/2025
2.6.0 fjall-rs.github.io/post/fjall-2...
fjall-rs.github.io
When Rust's Arc is not enough: Announcing Fjall 2.6
Introducing byteview for better performance in Fjall
272
fjallrs.bsky.social @fjallrs.bsky.social · 27/01/2025
Approximate membership filters are an important part of LSM-trees, but they are used in many places - here's a great intro to Bloom filters by @b5.bsky.social youtu.be/eCUm4U3WDpM
youtu.be
Bloom Filters - Part 1 of 3
YouTube video by number 0
151
Reposted by @fjallrs.bsky.social
Iroh @iroh.computer · 18/01/2025
Hey! You've asked for more detail, you get more detail! Here's a 17 minutes deep dive into how you can use me :) www.youtube.com/watch?v=AkHaIVuFHK4
youtube.com
A tour of iroh
YouTube video by number 0
1134
fjallrs.bsky.social @fjallrs.bsky.social · 24/01/2025
2.6.0 should give some nice read performance improvements, seeing something around 15-20% for uncached workloads. This is using jemalloc; the impact could be higher for other memory allocators.
120