iiinova — where your digital self keeps evolving

Xuanwo @xuanwo.io · 29/10/2025

For everyone interested in data infra, want to get a quick sense of how big data works, how data systems are designed, and what the tradeoffs are, start with this share from @xiangpeng.systems, really nice intro! intro-data-system.xiangpeng.systems

1124

Xuanwo @xuanwo.io · 30/06/2025

Thank you for the kind words!

020

Xuanwo @xuanwo.io · 04/06/2025

New meaning for "Secure File Transfer Protocol"

010

Xuanwo @xuanwo.io · 04/06/2025

Rust is not “Other” in linux anymore 🤪

0140

Xuanwo @xuanwo.io · 14/03/2025

Cool, will learn!

000

Xuanwo @xuanwo.io · 14/03/2025

Drawing easy to understand and pretty image is a talent 😍

110

Xuanwo @xuanwo.io · 13/03/2025

Hi, are you using Claude 3.5 Sonnet from Zed AI or Github's Copilot Chat?

100

Xuanwo @xuanwo.io · 13/03/2025

My original post is here: xuanwo.io/links/2025/0... The policy discussion took place internally. The changes can be seen at github.com/apache/www-s....

xuanwo.io

Release Arrow Rust 54.2.1 in 6 hours

Achieving Data Freedom Through Open Source and Rust

010

Xuanwo @xuanwo.io · 13/03/2025

I'm happy to announce that @apache.org has refined its release policy, clarifying that expedited releases are permitted in certain circumstances. Let's bring more good changes🥰

140

Xuanwo @xuanwo.io · 10/03/2025

@xiangpeng.systems shared a great post about system researchers. I wrote a comment on it and would like to share some thoughts here and offer complementary ideas. In short: build paper with open source. xuanwo.io/links/2025/0...

082

Xuanwo @xuanwo.io · 05/03/2025

I shared a post about mcp-server-opendal along with a simple explanation of what the Model Context Protocol is. Post: xuanwo.io/links/2025/0... Repo: github.com/Xuanwo/mcp-s...

090

Xuanwo @xuanwo.io · 03/03/2025

Archlinux announced that they will remove the deprecated repository and now it effected. Please go check your /etc/pacman.conf and remove the section that is deprecated. xuanwo.io/links/2025/0...

010

Xuanwo @xuanwo.io · 27/02/2025

With @andrewlamb1111.bsky.social 's help, I assisted the Arrow Rust community in releasing Arrow Rust 54.2.1 within six hours. I shared what I learned during this process, which I believe could benefit other ASF projects in handling similar cases. xuanwo.io/links/2025/0...

092

Xuanwo @xuanwo.io · 27/02/2025

Happy to read zlib-rs is faster than C from @trifectatech.bsky.social. I read that post and took some notes on SIMD instructions and DFA jump threading. Feel free to check them out! xuanwo.io/links/2025/0...

081

Xuanwo @xuanwo.io · 27/02/2025

I think IOPS is used more widely.

010

Xuanwo @xuanwo.io · 20/02/2025

The AWS S3 SDK breaks its compatible services by enforcing integrity checksums. This reminds me of another key advantage of Apache OpenDAL: it's not controlled by any storage vendor. xuanwo.io/links/2025/0...

010

Xuanwo @xuanwo.io · 18/02/2025

I am happy to announce the release of BackON v1.4.0. BackON has been used by 1.1k projects on github, and been downloaded for 20k times per day. Really nice! xuanwo.io/links/2025/0...

000

Xuanwo @xuanwo.io · 13/02/2025

Life is really easy like xuanwo.io/links/2025/0... I used to spent hours to build test dataset.

xuanwo.io

duckdb is the best TPC data generator

Achieving Data Freedom Through Open Source and Rust

000

Xuanwo @xuanwo.io · 12/02/2025

Really appreciate @github.com and @glich.stream 's help with OpenDAL's GHAC service migration. xuanwo.io/links/2025/0...

030

Xuanwo @xuanwo.io · 11/02/2025

duckdb is the best TPC data generator! Don't bother building dsdgen—just use @duckdb.org instead. xuanwo.io/links/2025/0...

0194

Xuanwo @xuanwo.io · 07/02/2025

Personal software has been trending recently. I enjoyed reading @leerob.com's "personal software" and @edmarferreira.bsky.social 's "selfish software". Hope you enjoy them too! xuanwo.io/links/2025/0...

2195

Xuanwo @xuanwo.io · 05/02/2025

"Cloud virtualization: Red Hat, AWS Firecracker, and Ubicloud internals" provides a great conclusion to cloud virtualization in the 2020s. Reading this post will give you a good understanding of the current state of cloud virtualization. Highly recommended. xuanwo.io/links/2025/0...

051

Xuanwo @xuanwo.io · 04/02/2025

I decided to follow @simonwillison.net's approach to creating a link blog, where I can share interesting links I find on the internet along with my own comments and thoughts about them. xuanwo.io/links/2025/0...

xuanwo.io

Build a link blog

An infrastructure engineer, focused on distributed storage system

150

Xuanwo @xuanwo.io · 02/02/2025

Maybe something that can run on Cloudflare Workers?

010

Xuanwo @xuanwo.io · 02/02/2025

My 2024 review will answer 40 questions to myself😜 xuanwo.io/2025/01-2024...

031

Xuanwo @xuanwo.io · 29/01/2025

This seems interesting. More like what RSS?

110

Xuanwo @xuanwo.io · 24/01/2025

s/perfer/personally

010

Xuanwo @xuanwo.io · 24/01/2025

OpenDAL returns a Buffer: docs.rs/opendal/late... It's a wrapper of contiguous Bytes and non-contiguous [Bytes]. Users can convert to Vec<u8> or Bytes or std::io::Reader on demand. I perfer feel like it's great tradeoff between easy to use API and performance.

docs.rs

Buffer in opendal - Rust

Buffer is a wrapper of contiguous `Bytes` and non-contiguous `[Bytes]`.

130

Xuanwo @xuanwo.io · 20/01/2025

Thanks for sharing. I think I got the point now. S3 now requires only prefix splits instead of randomized splits. That means split key in 0,1,2 won't wrose than a,g,z. The key pattern design could still be useful for allowing S3 to gradually add partitions, but it’s no longer related to key order.

110

Xuanwo @xuanwo.io · 20/01/2025

By the way, I have seen GCS return errors like the following: "Your request distribution is too uneven across the key-ranges in your bucket. Please follow the guidance at cloud.google.com/storage/docs... in order to avoid temporary limits on the bucket"