Sign in

Xuanwo

@xuanwo.io
2K followers 116 following 192 posts

ASF Member. Apache OpenDAL PMC Chair. VISION: Data Freedom. Working on #RBIR. More: bento.me/xuanwo

PostsRepliesMedia
Xuanwo @xuanwo.io · 29/10/2025
For everyone interested in data infra, want to get a quick sense of how big data works, how data systems are designed, and what the tradeoffs are, start with this share from @xiangpeng.systems, really nice intro! intro-data-system.xiangpeng.systems
1124
Xuanwo @xuanwo.io · 30/06/2025
Thank you for the kind words!
020
Xuanwo @xuanwo.io · 04/06/2025
Rust is not “Other” in linux anymore 🤪
0140
Xuanwo @xuanwo.io · 13/03/2025
I'm happy to announce that @apache.org has refined its release policy, clarifying that expedited releases are permitted in certain circumstances. Let's bring more good changes🥰
140
Xuanwo @xuanwo.io · 10/03/2025
@xiangpeng.systems shared a great post about system researchers. I wrote a comment on it and would like to share some thoughts here and offer complementary ideas. In short: build paper with open source. xuanwo.io/links/2025/0...
082
Xuanwo @xuanwo.io · 05/03/2025
I shared a post about mcp-server-opendal along with a simple explanation of what the Model Context Protocol is. Post: xuanwo.io/links/2025/0... Repo: github.com/Xuanwo/mcp-s...
090
Xuanwo @xuanwo.io · 03/03/2025
opendal.apache.org/blog/2025/03... Apache OpenDAL 2025 Roadmap: Perfecting Production Adoption
opendal.apache.org
Apache OpenDAL 2025 Roadmap: Perfecting Production Adoption | Apache OpenDAL™
Hi everyone, long time no see. Although we have been actively developing OpenDAL and consistently releasing updates, we haven’t provided a clear overview of where OpenDAL is heading. This post aims to...
020
Xuanwo @xuanwo.io · 03/03/2025
Archlinux announced that they will remove the deprecated repository and now it effected. Please go check your /etc/pacman.conf and remove the section that is deprecated. xuanwo.io/links/2025/0...
010
Xuanwo @xuanwo.io · 27/02/2025
With @andrewlamb1111.bsky.social 's help, I assisted the Arrow Rust community in releasing Arrow Rust 54.2.1 within six hours. I shared what I learned during this process, which I believe could benefit other ASF projects in handling similar cases. xuanwo.io/links/2025/0...
092
Xuanwo @xuanwo.io · 27/02/2025
Happy to read zlib-rs is faster than C from @trifectatech.bsky.social. I read that post and took some notes on SIMD instructions and DFA jump threading. Feel free to check them out! xuanwo.io/links/2025/0...
081
Xuanwo @xuanwo.io · 20/02/2025
The AWS S3 SDK breaks its compatible services by enforcing integrity checksums. This reminds me of another key advantage of Apache OpenDAL: it's not controlled by any storage vendor. xuanwo.io/links/2025/0...
010
Reposted by Xuanwo
Commonhaus Foundation @commonhaus.org · 18/02/2025
Chris Riccomini (@chris.blue) shares his thoughts on Open Source foundations: Apache, CNCF, Commonhaus. He also explains why Commonhaus is a better fit for SlateDB cnr.sh/posts/compar...
cnr.sh
Comparing Apache, CNCF, and Commonhaus | cnr.sh
I've used open source projects for over 30 years and contributed for about 20 of those. My first interaction with an open source foundation was with Apache when I began working with Apache Hadoop ...
0126
Xuanwo @xuanwo.io · 18/02/2025
I am happy to announce the release of BackON v1.4.0. BackON has been used by 1.1k projects on github, and been downloaded for 20k times per day. Really nice! xuanwo.io/links/2025/0...
000
Xuanwo @xuanwo.io · 12/02/2025
Really appreciate @github.com and @glich.stream 's help with OpenDAL's GHAC service migration. xuanwo.io/links/2025/0...
030
Xuanwo @xuanwo.io · 11/02/2025
duckdb is the best TPC data generator! Don't bother building dsdgen—just use @duckdb.org instead. xuanwo.io/links/2025/0...
0194
Xuanwo @xuanwo.io · 07/02/2025
Personal software has been trending recently. I enjoyed reading @leerob.com's "personal software" and @edmarferreira.bsky.social 's "selfish software". Hope you enjoy them too! xuanwo.io/links/2025/0...
2195
Xuanwo @xuanwo.io · 05/02/2025
"Cloud virtualization: Red Hat, AWS Firecracker, and Ubicloud internals" provides a great conclusion to cloud virtualization in the 2020s. Reading this post will give you a good understanding of the current state of cloud virtualization. Highly recommended. xuanwo.io/links/2025/0...
051
Xuanwo @xuanwo.io · 04/02/2025
I decided to follow @simonwillison.net's approach to creating a link blog, where I can share interesting links I find on the internet along with my own comments and thoughts about them. xuanwo.io/links/2025/0...
xuanwo.io
Build a link blog
An infrastructure engineer, focused on distributed storage system
150
Xuanwo @xuanwo.io · 02/02/2025
My 2024 review will answer 40 questions to myself😜 xuanwo.io/2025/01-2024...
031
Xuanwo @xuanwo.io · 28/01/2025
Happy New Year!
180
Xuanwo @xuanwo.io · 20/01/2025
Maybe we can build a tool based on opendal to find the best object storage key pattern for given storage services? github.com/apache/opend...
130
Xuanwo @xuanwo.io · 20/01/2025
#TIL: new bug from Ceph RADOS. Invalid etag value in complete multipart uploads response:
000
Xuanwo @xuanwo.io · 20/01/2025
I haven't found a practical use for the infinite spinning wheel, but the act of spinning it makes me happy. I could spin it all day long!
120
Xuanwo @xuanwo.io · 17/01/2025
Just bought a new Logi MX Master 3X. Really love it!
140
Xuanwo @xuanwo.io · 30/12/2024
Great, I'm now a contributor to wasmtime!
1141
Xuanwo @xuanwo.io · 27/12/2024
The next version of OpenDAL will be "v0.51.1 - Look, a New Day Has Begun," a famous line from Cats Musical. Hoping you all find happiness in the coming new year ❤️ github.com/apache/opend...
github.com
discuss: prepare release for "v0.51.1 - Look, a new day has begun" · apache opendal · Discussion #5470
Dear Apache OpenDAL community, I will serve as the release manager for v0.51.1. This release will fix #5469 Please let me know if you have any questions about this version. For this release, I woul...
020
Xuanwo @xuanwo.io · 27/12/2024
040
Xuanwo @xuanwo.io · 17/12/2024
Fewer commits than last year, but there was more collaboration within the community. The happiest moment for me this year was being elected as an iceberg committer and starting iceberg-rust together with liurenjie1024. Next year will bring more RBIR projects—let's keep moving!
3160
Xuanwo @xuanwo.io · 09/12/2024
New Post: A letter to open-source maintainers Hoping maintainers can find happiness in open source. xuanwo.io/2024/10-a-le...
xuanwo.io
A letter to open-source maintainers
An infrastructure engineer, focused on distributed storage system
142
Xuanwo @xuanwo.io · 05/12/2024
The things that inspire me to keep contributing to OpenDAL. Thank you, kind strangers!
040
Xuanwo @xuanwo.io · 03/12/2024
Hello, bluesky. The recording of my CMU-DB's Building Blocks Seminar Talk about OpenDAL is online now. If you have any questions about OpenDAL or are looking for collaboration, feel free to DM me! www.youtube.com/watch?v=eVMI...
youtube.com
Apache OpenDAL: One Layer, All Storage (Xuanwo)
YouTube video by CMU Database Group
0121
Xuanwo @xuanwo.io · 02/12/2024
I'm happy to become the cache of this API. Please grant me the write permission.
040
Xuanwo @xuanwo.io · 02/12/2024
What happened to SPDK? It doesn't seem to have been active since 2021. In fact, the entire trend of kernel bypass seems to have faded as io_uring and BPF have matured. Is it just my imagination?
100
Xuanwo @xuanwo.io · 30/11/2024
Hi, @bohutang.bsky.social , the cofounder of @databend.com is here😍
042
Xuanwo @xuanwo.io · 28/11/2024
Hello everyone, the first Iceberg #Rust Community Sync will happen at 28th Nov (today!) at 23:00 UTC+8. Welcome to join us! docs.google.com/document/d/1...
docs.google.com
Iceberg Rust Community Sync
Iceberg Rust Community Sync Meeting Link Calendar Link 2024-11-28 Proposed Topics Introductions Implementing Writes (https://github.com/apache/iceberg-rust/issues/700, https://github.com/apache/icebe...
0102
Xuanwo @xuanwo.io · 28/11/2024
For those interested in learning more about Apache Hudi, consider reading "Apache Hudi: From Zero To One" written by Shiyan Xu (One of Hudi PMC Member) blog.datumagic.com/p/apache-hud...
blog.datumagic.com
Apache Hudi: From Zero To One (1/10)
A first glance at Hudi's storage format
041
Xuanwo @xuanwo.io · 26/11/2024
When something like Redis is so widely used that it becomes an informal standard, how should the open-source community engage with the original author? This discussion is worth joining, and I look forward to your comments. Thank @mitsuhiko.at for setting up the context. github.com/redis-rs/red...
github.com
Future Crate Maintenance and Redis Inc. Relationship · Issue #1419 · redis-rs/redis-rs
Hello users. I haven't actively maintained this library in a very long time as you probably noticed. I am still controlling the entry on crates.io for it alongside the redis release team and @badbo...
080
Xuanwo @xuanwo.io · 25/11/2024
Looking forward to!
010
Xuanwo @xuanwo.io · 23/11/2024
Rust Edition 2024 scheduled to be released on February 20, 2025. Nice! github.com/rust-lang/ru...
github.com
Stabilize the 2024 edition by ehuss · Pull Request #133349 · rust-lang/rust
This stabilizes the 2024 edition for Rust 1.85, scheduled to be released on February 20, 2025. 🎉 cc tracking issue: #117258 There is a fair amount of follow-up work after this that I am working on ...
1192
Xuanwo @xuanwo.io · 22/11/2024
Wow, just find @andrewlamb1111.bsky.social is on bluesky, happy to see! Follow him if you are interested in rust, database, arrow and datafusion 😍
010
Xuanwo @xuanwo.io · 22/11/2024
backon is a lib that makes retry like a built-in feature provided by #Rust. I'm excited to announce the release of v1.3.0, which includes several quality-of-life improvements. Enjoy! github.com/Xuanwo/backo...
github.com
v1.3.0 · Xuanwo backon · Discussion #165
What's Changed refactor: Remove the Debug requirement of Backoff by @Xuanwo in #141 feat: Implement BackoffBuilder for Backoff itself by @Xuanwo in #142 docs: mention sleep() in blocking retry exam...
042
Xuanwo @xuanwo.io · 22/11/2024
Has AWS S3 changed its leadership or something? This year, S3 has undergone so many changes that it seems like they've undone progress from the past 10 years. - Deprecated SelectObject - Added AppendObject (directory bucket only) - Introduced PutObject if none exist
140
Xuanwo @xuanwo.io · 22/11/2024
That's huge. Created an OpenDAL issue for it: github.com/apache/opend...
github.com
new feature: Implement append object for S3 · Issue #5351 · apache/opendal
Feature Description AWS S3 supports append object for directory-buckets now. https://docs.aws.amazon.com/AmazonS3/latest/userguide/directory-buckets-objects-append.html Problem and Solution OpenDAL...
020
Xuanwo @xuanwo.io · 21/11/2024
Publishing a post "What Did ASF Do Wrong?" to explore ways to attract more contributors—feel free to join the discussion with me. xuanwo.io/2024/09-what...
xuanwo.io
What did ASF do wrong?
An infrastructure engineer, focused on distributed storage system
32811
Xuanwo @xuanwo.io · 21/11/2024
- Added @crunchydata.com - Added @electric-sql.com - Added @pglite.dev
130
Xuanwo @xuanwo.io · 20/11/2024
- Added @motherduck.com
140
Xuanwo @xuanwo.io · 20/11/2024
Updates for my database starter pack and list: - Added @clickhouse.com - Added @memgraph.com Welcome to join the bluesky, let's rock! go.bsky.app/Nd8hieE
2239
Xuanwo @xuanwo.io · 20/11/2024
If you use 1Password's GitHub load-secrets-action, feel free to join the discussion on this issue. We are going to build something really cool! github.com/1Password/lo...
github.com
Rewrite using 1Password JS SDK · Issue #80 · 1Password/load-secrets-action
Hey! First, thanks for providing the actions of course. Under the hood, this action installs 1Password CLI and uses it to load secrets. The downside is that installing CLI takes some time and also ...
010
Xuanwo @xuanwo.io · 19/11/2024
The Apache #Iceberg #Rust Community is shifting it's force from reading to writing now. Let's rock! github.com/apache/icebe...
github.com
Iceberg-rust Write support · Issue #700 · apache/iceberg-rust
Iceberg-rust Write support I've noticed a lot of interest in write support in Iceberg-rust. This issue aims to break this down into smaller pieces so they can be picked up in parallel. Commit path ...
1205
Xuanwo @xuanwo.io · 16/11/2024
If you are building a library, use the following GitHub search to actively gather feedback from users. "<name> -repo:<author> state:open" Take OpenDAL as an example: "opendal -repo:apache/opendal state:open"
030