Sign in

Carlo Piovesan

@carlo.piovesan.io
1.1K followers 192 following 135 posts

Compiling @duckdb

PostsRepliesMedia
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 26/08/2026
.@ducklabs.com is joining Amazon Web Services (AWS), expected to be effective by early Sept. This move gives DuckLabs the resources and reach to bring #DuckDB, DuckLake, and the Quack protocol to many more developers and orgs – while keeping our commitment to OSS Read the full announcement here:
ducklabs.com
DuckLabs to Join AWS, Projects to Remain Open Source
DuckLabs provides services around the DuckDB in-process OLAP data management system directly from its main developers.
22414
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 12/05/2026
Today we are revealing the Next Big Thing for DuckDB: Quack, a protocol that turns DuckDB into a client-server database. True to DuckDB's philosophy, Quack is simple and fast. Setting it up takes seconds, and it works for both bulk operations and small write transactions. 🔗 duckdb.org/quack
710012
Carlo Piovesan @carlo.piovesan.io · 12/05/2026
It's client initiates, server respond, but given 2 instances they could be both a server and a client, so quack both ways.
130
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 07/05/2026
The Delta and Unity Catalog extensions in DuckDB have shed their experimental labels! Today's blog post by Ben Fleis presents there features: ✍️ Write Delta tables 🤝 Multi-writer access with concurrency control through UC ⏪ Time travel queries on Delta tables Read more: duckdb.org/2026/05/07/d...
duckdb.org
Delta Grows Up: Writes, Unity Catalog and Time Travel
DuckDB's Delta and Unity Catalog extensions shed their experimental tags — now with writes, Unity Catalog and time travel support.
0304
Carlo Piovesan @carlo.piovesan.io · 01/04/2026
Great post from @dtenwolde.bsky.social! DuckDB is the Duolingo of the data space thanks to the push for localized SQL.
020
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 01/04/2026
🇳🇱🌷🚲 DuckDB now speaks Dutch! Load the EendDB community extension and start writing your queries in het Nederlands: duckdb.org/2026/04/01/d...
1183
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 20/03/2026
We're excited to announce duckdb-skills, a DuckDB plugin for Claude Code! We think the embedded nature of DuckDB makes it a perfect companion for Claude in your local workflows. Check out the repository at github.com/duckdb/duckd...
github.com
GitHub - duckdb/duckdb-skills
Contribute to duckdb/duckdb-skills development by creating an account on GitHub.
15414
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 09/03/2026
We released DuckDB v1.5! This release comes with a “friendly CLI” client, a new (opt-in) PEG parser, support for VARIANT types and many lakehouse features. It also ships a new network stack, a reworked geospatial extension, Azure writes and an ODBC scanner. Read more at duckdb.org/2026/03/09/a...
06116
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 20/02/2026
🦆 ↔️ 🦀 DuckDB Labs is looking for a Rust engineer to join our team in Amsterdam. 📝 See the details and application page at duckdblabs.com/jobs/rust_en...
duckdblabs.com
Rust Engineer
DuckDB Labs provides services around the DuckDB in-process OLAP data management system directly from its main developers.
1229
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 29/01/2026
📆 The DuckDB Developer Meeting in Amsterdam starts tomorrow! We'll have a deep-dive extension development workshop in the morning and four exciting talks in the afternoon. 🎟️ Last chance to register at duckdb.org/events/2026/...
0112
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 23/01/2026
DuckDB now supports reading from and writing to the Vortex file format! The DuckDB Labs and Spiral teams have worked together to make Vortex available as a core extension in DuckDB. We gave it a test drive, and it performed very well. Read the full article to learn more lnkd.in/eZfGzPiZ
0284
Carlo Piovesan @carlo.piovesan.io · 16/12/2025
Yes, thanks for the question, that works as well, as long as the catalog endpoint sends relevant CORS headers (that is, you might need a proxy for some catalogs out there)
010
Reposted by Carlo Piovesan
Markus Winand @winand.at · 16/12/2025
Adieu Apache Derby, Welcome DuckDB modern-sql.com/blog/2025-12...
modern-sql.com
DuckDB Coverage
Apache Derby is retired, ModernSQL now covers DuckDB instead
2225
Carlo Piovesan @carlo.piovesan.io · 16/12/2025
Blog we tried to keep it to the point, but basics can be covered in the linked demo at duckdb.org/visualizer/?...
030
Carlo Piovesan @carlo.piovesan.io · 16/12/2025
If you are into Iceberg or DuckDB, this is a major step: you can access existing Iceberg datasets, while they are appended on or updated by other users (possibly they can also be clicking buttons in a browser). This has been very fun, was looking forward to be able to properly share, thanks flock!
2161
Reposted by Carlo Piovesan
Markus Winand @winand.at · 28/11/2025
modern-sql.com now covers DuckDB.
modern-sql.com
Modern SQL: A lot has changed since SQL-92
SQL has evolved. Beyond the relational model. Discover it now.
24715
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 18/11/2025
Today's Cloudflare outage has affected the DuckDB documentation site. While it seems to be mostly recovered now, it will take some time until everything stabilizes. If you need to look things up in the DuckDB documentation now, feel free to use our PDF: duckdb.github.io/duckdb-docs-...
duckdb.github.io
2172
Reposted by Carlo Piovesan
Development Seed @developmentseed.org · 06/11/2025
We took Canada’s Spatial Access Measures dataset (big, clunky CSVs) → turned it into a single GeoParquet file. Add DuckDB-WASM + deck.gl & you get - instant queries - smooth maps - no backend Public data, but actually usable. developmentseed.org/blog/2025-10... @saadiqmohiuddin.bsky.social
0215
Reposted by Carlo Piovesan
Tobias Müller @tobilg.com · 25/10/2025
I just launched github.com/tobilg/sql-w... It's a tiny (<10kb gzipped) wrapper around @duckdb.org WASM that can run queries interactively, and be embedded in plain HTML websites, as well as all other mayor frontend frameworks... It's an early version, feedback warmly appreciated!
github.com
GitHub - tobilg/sql-workbench-embedded: Lightweight JavaScript library that transforms static SQL code blocks into interactive, browser-based SQL execution environments using DuckDB WASM
Lightweight JavaScript library that transforms static SQL code blocks into interactive, browser-based SQL execution environments using DuckDB WASM - tobilg/sql-workbench-embedded
3227
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 22/10/2025
📣 New blog post by @dtenwolde.bsky.social. 🕸️ In this post, we show how to use DuckDB and the DuckPGQ community extension to analyze financial data for fraudulent patterns with the SQL/PGQ graph syntax that's part of SQL:2023. 📖 Visit duckdb.org/2025/10/22/d... to read the post.
0267
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 24/10/2025
In a new guest blog post, Mark Harrison (Madhive) presents Frozen DuckLakes. These are read-only DuckLakes that only require object storage and are frozen in time. He shows a process for creating and freezing DuckLakes, and demonstrates their use and performance. 📖 ducklake.select/2025/10/24/f...
An iPhone 17 Pro in a MAGEASY case, held afloat by DuckLake floating keychains, querying a remote DuckLake in the online Wasm shell. Do not try this at home.
0195
Reposted by Carlo Piovesan
Tobias Müller @tobilg.com · 06/10/2025
Created a DNS extension for @duckdb.org today: github.com/tobilg/duckd... Hopefully it will be available via the Community Extensions soon!
github.com
GitHub - tobilg/duckdb-dns: DNS (Reverse) Lookup Extension for DuckDB
DNS (Reverse) Lookup Extension for DuckDB. Contribute to tobilg/duckdb-dns development by creating an account on GitHub.
1164
Carlo Piovesan @carlo.piovesan.io · 07/10/2025
Should be live, in duckdb v1.4.0: ``` INSTALL dns FROM community; LOAD dns; CREATE TABLE websites AS WITH websites(endpoint) AS (VALUES ('google.com'), ('duckdb.org'), ('community-extensions.duckdb.org')) FROM websites; SELECT dns_lookup(endpoint) FROM websites; ``` duckdb.org/community_ex...
duckdb.org
dns
DuckDB Community Extensions The DNS Extension enables DNS lookups and reverse DNS lookups from within DuckDB
150
Reposted by Carlo Piovesan
Roland Bouman @rolandbouman.bsky.social · 19/09/2025
Huey 1.0.10 is now released: github.com/rpbouman/hue... demo: rpbouman.github.io/huey/src/ind... - DuckDB version upgrade (1.4.0) - Support for translation files. Currently supported: English, Dutch and Brazilian Portuguese (thanks @nosklo!) - bugfixes and UI improvements
github.com
Release Huey version 1.0.10 - Grimao Ermaôs · rpbouman/huey
What's Changed Ensure the lists have a min-height that matches their size attribute. by @rpbouman in #580 Fix #584 by @rpbouman in #585 Fix #587 by @rpbouman in #589 Fix #590 by @rpbouman in #591 ...
033
Reposted by Carlo Piovesan
qxip @qxip.bsky.social · 17/09/2025
Had a blast speaking about query.farm at the #DuckDB Amsterdam Meetup #3 where I had time to spend some time with my heroes @carlo.piovesan.io @samansmink.bsky.social @szarnyasg.org Tania Bogatsch and so many more awesome people! Thank You @duckdb.org for giving space to the community! #opensource
0131
Carlo Piovesan @carlo.piovesan.io · 03/09/2025
There is also the "Science in DuckDB" section: duckdb.org/why_duckdb.h... and the follow up on "Standing on the Shoulders of Giants"
duckdb.org
Why DuckDB
Why DuckDB There are many database management systems (DBMS) out there. But there is no one-size-fits all database system. All take different trade-offs to better adjust to specific use cases. DuckDB ...
000
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 02/09/2025
We just launched the “DuckDB in Science” site, a curated collection of papers, lectures and podcasts about DuckDB in research: duckdb.org/science/ 🎡 If you would like to learn more about DuckDB in Science, consider joining our meetup in London this Thursday: www.meetup.com/duckdb/event...
24514
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 18/08/2025
🎓 On September 4, we are hosting a new kind of meetup in London which will focus on the use of DuckDB in Science and Education! ⚡️ We still have some spots for lightning talks. If you're working with DuckDB in your research and/or classroom, consider sharing your story! 🔗 duckdb.org/events/2025/...
duckdb.org
DuckDB Meetup on Science and Education in London
DuckDB is an in-process SQL database management system focused on analytical query processing. It is designed to be easy to install and easy to use. DuckDB has no external dependencies. DuckDB has bin...
0135
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 08/08/2025
We just published a deep dive on spatial joins in DuckDB by @maxxen.bsky.social. In this blog post, Max explains how spatial joins evolved in DuckDB and how the current operator harnesses R-Trees. Read the full post at duckdb.org/2025/08/08/s...
04912
Carlo Piovesan @carlo.piovesan.io · 26/07/2025
Is anyone aware whether it’s possible to set CORS policies on the R2 (@cloudflare.social) Iceberg REST catalog?
cloudflare.social
000
Reposted by Carlo Piovesan
Andy Wheeler @crimede-coder.bsky.social · 29/06/2025
Weekend project, using R2 + DuckDB wasm to build a low price frontend for big data analytics crimede-coder.com/graphs/GSUBo...
crimede-coder.com
GSU Book Prices
GSU Book Prices Tables
071
Carlo Piovesan @carlo.piovesan.io · 24/06/2025
Quack!!
030
Reposted by Carlo Piovesan
Mathias Lafeldt @mathias.blog · 17/06/2025
Beyond excited to share that I'm now working with DuckDB Labs! My first priority will be the DuckDB Rust client, which will receive a lot more love going forward. 🎉 🦆 ❤️
3414
Reposted by Carlo Piovesan
__Alex Monahan__ @a13x.bsky.social · 03/06/2025
My #PyConUS talk is up! Tame data science file zoos with @duckdb.org! Read files of many shapes from any cloud, including your messiest CSVs. Then, organize all of your input tables, output tables, views, and relationships in one DuckDB file. No final_v3.csv! youtu.be/Yq-hxgysWLQ?...
youtu.be
Taming file zoos: Data science with DuckDB database files - Alex Monahan
YouTube video by PyCon US
0184
Reposted by Carlo Piovesan
Jordan Tigani @jrdntgn.bsky.social · 28/05/2025
Yesterday DuckDB Labs announced DuckLake, a new Open data and catalog format. Here is a bit about why it is so awesome, how it solves some key problems with existing technologies, and why we're excited to host it in the cloud at MotherDuck.
1375
Reposted by Carlo Piovesan
lloyd tabb @lloydtabb.bsky.social · 27/05/2025
Ducklake is a really elegant solution to the data lake. Radically simple and completely open.
0231
Carlo Piovesan @carlo.piovesan.io · 27/05/2025
Classing "cache invalidation and naming things" are the most complex problems. I think DuckLake is cute, but naming stuff is hard.
120
Carlo Piovesan @carlo.piovesan.io · 27/05/2025
And the biggest winner is... DuckDB support for running queries on [remote] parquet files. This happens to be a basic building block of DuckLake and a few other alternative lake technologies
0110
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 27/05/2025
Today we're launching DuckLake, an integrated data lake and catalog format powered by SQL. DuckLake unlocks next-generation data warehousing where compute is local, consistency central, and storage scales till infinity. ⁠ducklake is an open standard and we implemented it in the "ducklake" extension.
814239
Reposted by Carlo Piovesan
Torsten „Teggy“ Grust @teggy.org · 22/05/2025
Our USING KEY variant of recursive CTEs has landed in DuckDB 1.3 Formerly an off-the-beaten-path researchy idea, now available in a real off-the-shelf DBMS. Hooray! 🎉 duckdb.org/2025/05/23/u...
duckdb.org
USING KEY in Recursive CTEs
Recursive CTEs in SQL allow for powerful iterative queries like graph traversals but can be memory-intensive and slow due to repeated row accumulation. DuckDB’s new USING KEY feature addresses this by...
0256
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 23/05/2025
New post by Pedro Holanda, Ian Cook, Dewey Dunnington and Bryce Mecum: Arrow IPC Support in DuckDB This blog post introduces the new arrow community extension, which boosts interoperability by allowing to consume/produce data through the Arrow IPC Serialization Format. duckdb.org/2025/05/23/a...
03011
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 21/05/2025
DuckDB v1.3.0 “Ossivalis” is out and it packs a ton of new features, fixes and optimizations. See the announcement blog post: duckdb.org/2025/05/21/a...
06017
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 01/05/2025
A new preprint from database researchers found DuckDB the most environmentally efficient system: arxiv.org/pdf/2504.18980
0246
Reposted by Carlo Piovesan
Hamilton Ulmer @hamilton.bsky.social · 24/04/2025
So thrilled to announce we've released Instant SQL in both the MotherDuck and DuckDB UIs! It's a new interaction pattern for writing SQL queries that provides realtime result previews and deep query inspection & debugging. Bye bye run button 👋 Truly, literally only possible with DuckDB
35411
Reposted by Carlo Piovesan
DuckDB @duckdb.org · 18/04/2025
📢 The fifth and final episode of the “DuckDB in Research” podcast series is out! Haralampos Gavriilidis | SheetReader: Efficient spreadsheet parsing 🎧 Apple: podcasts.apple.com/us/podcast/h... 🎧 Spotify: open.spotify.com/episode/2CRR...
0122
Carlo Piovesan @carlo.piovesan.io · 19/04/2025
The script is very hacky indeed. I think it's cute that the information is extracted from the catalog, but there is need to go outside duckdb somehow since extension can't be unloaded, so process is irreversible. Python would have been probably better than bash, but this was what I did come out.
110
Carlo Piovesan @carlo.piovesan.io · 11/04/2025
Weirdly enough, it contained a bunch of unsanitized commit content, talking about 404 using the forbidden word 'Error', that you should never pipe into standard output.
000
Carlo Piovesan @carlo.piovesan.io · 11/04/2025
I assume since it's handy to have visual confirmation of the state of the repository at the moment you are changing it. Up to here, there is lots of complexity, but it's actually needed to gain flexibiltity / speed. Only the repo providing HTTP filesystem was special and could not be patched. Why?
100
Carlo Piovesan @carlo.piovesan.io · 11/04/2025
Then we augmented the list to be a list of tuples `{repository, hash, [...,file1.patch]}` with an (ordered) array of patches to be applied. Pretty standard trick for package managers (say Microsoft's VCPKG) to allow some wiggle room. Now the logic to apply patches happened to perform a `git log`
100