iiinova — where your digital self keeps evolving

Reposted by Gabor Szarnyas

DuckDB @duckdb.org · 03/06/2026

What's new in DuckDB and how does DuckDB fit into old shell scripts? These are topics that our DevRel Gábor covered at Ubuntu Summit 2026. His talk explained three aspects of DuckDB: a command-line tool, a portable database, and a client-server database. duckdb.org/library/duck...

0194

Gabor Szarnyas @szarnyasg.org · 26/05/2026

I will be speaking at Ubuntu Summit 26.04 on Thursday about DuckDB. My presentation will cover DuckDB at three different deployment models: as a CLI tool, as a portable database, and as a server. The event is streamed but requires registration – see ubuntu.com/summit

0111

Gabor Szarnyas @szarnyasg.org · 07/05/2026

I've been working on organizing our next DuckCon for the past three months. The program is finally out and I think we have a really strong lineup, featuring speakers from ETH Zürich, Spotify, MariaDB, the Merck Group, Snowflake, Foursquare, and more. Join us in Amsterdam on June 24!

0121

Reposted by Gabor Szarnyas

DuckDB @duckdb.org · 22/04/2026

Today is your last chance to submit a talk proposal to DuckCon #7. The submission form is lightweight, so it shouldn't take long. If you're in doubt whether your talk idea fits, drop us a DM and we are happy to discuss it further!

041

Gabor Szarnyas @szarnyasg.org · 17/11/2025

Thanks! All the fiddling with SVGs was worth it! 🙌

110

Reposted by Gabor Szarnyas

DuckDB @duckdb.org · 12/11/2025

🚀 We released DuckDB v1.4.2, the second patch release of our LTS edition. 🔎 We are shipping new Iceberg features, improved logger/profiler integration and several bugfixes. The new DuckDB version can also read and write Vortex files. 📖 For more details, read duckdb.org/2025/11/12/a...

0395

Gabor Szarnyas @szarnyasg.org · 24/10/2025

DuckDB does not support GraphQL. GraphQL itself is a bit of misnomer as it is not a full-fledged graph query language, it's primarily intended query REST endpoints. GQL and SQL/PGQ are full-fledged graph query languages, supporting both pattern matching and path finding.

000

Reposted by Gabor Szarnyas

DuckDB @duckdb.org · 28/08/2025

🔬 We are hosting the first “DuckDB in Science” meetup in London on September 4, co-located with VLDB 2025. 🔍 We'll have two deep-dive presentations from DuckDB's developers and four lightning talks from community members. 📍 For details and registration, see duckdb.org/events/2025/...

0114

Reposted by Gabor Szarnyas

DuckDB @duckdb.org · 18/08/2025

🎓 On September 4, we are hosting a new kind of meetup in London which will focus on the use of DuckDB in Science and Education! ⚡️ We still have some spots for lightning talks. If you're working with DuckDB in your research and/or classroom, consider sharing your story! 🔗 duckdb.org/events/2025/...

duckdb.org

DuckDB Meetup on Science and Education in London

DuckDB is an in-process SQL database management system focused on analytical query processing. It is designed to be easy to install and easy to use. DuckDB has no external dependencies. DuckDB has bin...

0135

Reposted by Gabor Szarnyas

DuckDB @duckdb.org · 08/07/2025

🚀 The DuckDB 1.3.2 bugfix release is out! 📦 The Python and CLI clients are already on the latest version, while the rest will follow in the coming days. 🔖 See the detailed change log at github.com/duckdb/duckd...

0246

Gabor Szarnyas @szarnyasg.org · 16/05/2025

I work at DuckDB Labs so obviously I am biased but this really looks like a prime use case for @duckdb.org Last year I reimplemented a lot of the cut / awk / csvkit examples of the “Data Science at the Command Line Book in DuckDB“ book in DuckDB and got good results: szarnyasg.org/posts/data-s...

szarnyasg.org

Data Science at the Command Line Book in DuckDB

Today I solved the exercises in Chapter 5 of the Data Science at the Command Line book using the DuckDB command line client. This page documents my solutions. Prerequisites Clone the https://github.co...

141

Gabor Szarnyas @szarnyasg.org · 09/05/2025

I don't think there is such a test in DuckDB at the moment. You'd have to look at the binary code with a disassembler and try to find vector instructions.

000

Gabor Szarnyas @szarnyasg.org · 08/05/2025

It would be an interesting experiment to try to make use of RISC-V RVV but I'm not aware of any attempts. In the official DuckDB code base, the engine doesn't have any platform-specific code to ensure portability. So it's up to the compilers to auto-vectorize the code.

100

Gabor Szarnyas @szarnyasg.org · 07/03/2025

It turns out DuckDB can load Latin-2 encoded CSV files just fine with the combination of iconv and the shellfs extension.

1161

Reposted by Gabor Szarnyas

DuckDB @duckdb.org · 28/02/2025

New blog post by @a13x.bsky.social and @archie.sarrewood.com: Reading and Writing Google Sheets in DuckDB This post introduces the gsheets community extension, which enables DuckDB to directly read from and write to Google Sheets. duckdb.org/2025/02/26/g...

1325

Gabor Szarnyas @szarnyasg.org · 25/02/2025

Here is a query making use of prefix aliases in all three clauses: SELECT "Station name": s.name_short, "Max distance": max(d.distance) FROM s: 's3://duckdb-blobs/stations.parquet' JOIN d: 's3://duckdb-blobs/distances.parquet' ON d.station1 = s.code GROUP BY ALL ORDER BY "Max distance" DESC;

120

Gabor Szarnyas @szarnyasg.org · 19/02/2025

I don't think this is possible in the moment. I would go the other route and try to do unnest and join. To save memory, you could peel away the nested column (CREATE TEMP TABLE tmp AS SELECT column FROM original_table), and do the unnest and join on this table, then join it back to the original.

020

Gabor Szarnyas @szarnyasg.org · 19/02/2025

The list_reduce function iterates through the list and picks the correct categoriy. You can generalize this and put a MAP value into the list_reduce function to capture the mapping, then do exact matching on the MAP's keys. For more details, see list_reduce in the docs: duckdb.org/docs/sql/fun...

duckdb.org

Lambda Functions

Lambda functions enable the use of more complex and flexible expressions in queries. DuckDB supports several scalar functions that operate on LISTs and accept lambda functions as parameters in the for...

120

Gabor Szarnyas @szarnyasg.org · 19/02/2025

I ran into a similar problem recently when I needed to categorize posts into according to their length: – 0: 0 ≤ length < 40 – 1: 40 ≤ length < 80 – 2: 80 ≤ length < 160 – 3: 160 ≤ length I came up with this: list_reduce([0, 40, 80, 160], (acc, x, i) -> IF(x <= length, i - 1, acc)) AS category

120

Gabor Szarnyas @szarnyasg.org · 04/12/2024

My post on DuckDB vs. wc received a lot of feedback. Based on these, I ran a few more experiments to see how DuckDB stacks up against parallelized wc and grep/ripgrep on Linux. I wrote up my results in a blog post. TL;DR: it depends but DuckDB is still pretty fast! szarnyasg.org/posts/duckdb...

1132

Gabor Szarnyas @szarnyasg.org · 02/12/2024

Oops, that's the difference of reading the CSV with or without its header. Well-spotted!

010

Gabor Szarnyas @szarnyasg.org · 30/11/2024

3) The ts command adds a timestamp at the beginning of each line. On macOS, it's available in the moreutils package on Homebrew.

000

Gabor Szarnyas @szarnyasg.org · 30/11/2024

2) A single sed command can include multiple search and replace pairs separated by semicolon. This makes sed commands *even less readable*, so use it with caution.

100

Gabor Szarnyas @szarnyasg.org · 30/11/2024

1) The bat tool – an alternative to cat – prints the newline characters if it's invoked with the -A switch. This output mode reveals whether a file is using CR/LF or LF newlines (or both).

100

Gabor Szarnyas @szarnyasg.org · 30/11/2024

I solved the exercises in Chapter 5 of the "Data Science at the Command Line" book using the @duckdb.org CLI client. Most exercises had a straightforward solution in DuckDB's SQL – see here: szarnyasg.org/posts/data-s... I gathered some ideas for DuckDB blog posts and learned a few new CLI tricks:

szarnyasg.org

Data Science at the Command Line Book in DuckDB

1172