Learn how Datadog built Distributed DataFusion to scale interactive Apache DataFusion queries across multiple machines.

GitHub is where people build software. More than 225 million people use GitHub to discover, fork, and contribute to over 800 million projects.

The Apache Arrow team is pleased to announce that the v60.0.0 release of Apache Arrow Rust is now available on crates.io (arrow and parquet) and as source download. See the 60.0.0 changelog for a full...

close replace bit-at-a-time null bitmap filtering with word-level #11060 This commit adds the ability for bit filtering to be done using the _pext_u64 BMI with a scalar fallback. We cannot run th...

Weird data needs weird databases.

In my open source work on Apache DataFusion, I’ve seen this growing trend of people finding an open issue and having an AI agent author the complete solution with no real input from the author. We’ve ...

The independent non-profit DuckDB Foundation safeguards the long-term maintenance and development of DuckDB.

Which issue does this PR close? Related to apache/datafusion#3929 Rationale for this change Depends on: Derive total_byte_size for join statistics #24536 feat: derive a distinct count from prima...

Join us for an evening of talks and community discussion about Apache DataFusion and its growing role in modern data infrastructure. We will introduce the…

YouTube video by Spice AI

Join us for an evening of talks and community discussion about Apache DataFusion and its growing role in modern data infrastructure. We will introduce the…

YouTube video by Spice AI

Join us for an evening of talks and community discussion about Apache DataFusion and its growing role in modern data infrastructure. This meetup will spotlight…

Join us for an evening of talks and community discussion about Apache DataFusion and its growing role in modern data infrastructure. We will introduce the…

Join us for an evening of talks and community discussion about Apache DataFusion and its growing role in modern data infrastructure. We will introduce the…

YouTube video by Andrew Lamb

Companies like Spotify need vast quantities of data accessible at low latency for online services and, increasingly, AI Agents acting on behalf of users. Online services — such as portals and personal...

Tim Saucer, PMC member and primary maintainer of Apache DataFusion’s Python bindings, joins PlusOne to talk about how he went from frustrated Spark user to open source maintainer — and how th…

Evaluating SQL LIKE directly on FSST-compressed strings: a symbol-aware automaton and a SIMD prefilter let Vortex match without decompressing the column first.

Join us for an evening of talks, panel discussion, and community discussion about Apache DataFusion and its growing role in modern data infrastructure. We will…

YouTube video by The ASF

GPU-accelerated query engines are often constrained by memory and I/O bandwidth. NVIDIA hardware advances—including high bandwidth memory (HBM), NVIDIA NVLink-C2C, and dedicated decompression engines…

With #212 merged we currently have the machinery to fully support TPC-DS but it's not yet satisfying, this issue will track some changes and improvements we would like to make before claiming TPC-D...

datafusion-go provides a database/sql driver for the datafusion query engine - datafusion-contrib/datafusion-go

This commit is a combination of the following PRs: Introduce IEEE 754 total order PARQUET-2249: Introduce IEEE 754 total order #221 Add nan_count to handle NaNs in statistics PARQUET-2249: Add nan...