The Apache Arrow team is pleased to announce that the v60.0.0 release of Apache Arrow Rust is now available on crates.io (arrow and parquet) and as source download. See the 60.0.0 changelog for a full...

close replace bit-at-a-time null bitmap filtering with word-level #11060 This commit adds the ability for bit filtering to be done using the _pext_u64 BMI with a scalar fallback. We cannot run th...

Weird data needs weird databases.

In my open source work on Apache DataFusion, I’ve seen this growing trend of people finding an open issue and having an AI agent author the complete solution with no real input from the author. We’ve ...

The independent non-profit DuckDB Foundation safeguards the long-term maintenance and development of DuckDB.

Which issue does this PR close? Related to apache/datafusion#3929 Rationale for this change Depends on: Derive total_byte_size for join statistics #24536 feat: derive a distinct count from prima...

Join us for an evening of talks and community discussion about Apache DataFusion and its growing role in modern data infrastructure. We will introduce the…

YouTube video by Spice AI

Join us for an evening of talks and community discussion about Apache DataFusion and its growing role in modern data infrastructure. We will introduce the…

YouTube video by Spice AI

Join us for an evening of talks and community discussion about Apache DataFusion and its growing role in modern data infrastructure. This meetup will spotlight…

Join us for an evening of talks and community discussion about Apache DataFusion and its growing role in modern data infrastructure. We will introduce the…

YouTube video by Andrew Lamb

Companies like Spotify need vast quantities of data accessible at low latency for online services and, increasingly, AI Agents acting on behalf of users. Online services — such as portals and personal...

Tim Saucer, PMC member and primary maintainer of Apache DataFusion’s Python bindings, joins PlusOne to talk about how he went from frustrated Spark user to open source maintainer — and how th…

Evaluating SQL LIKE directly on FSST-compressed strings: a symbol-aware automaton and a SIMD prefilter let Vortex match without decompressing the column first.

Join us for an evening of talks, panel discussion, and community discussion about Apache DataFusion and its growing role in modern data infrastructure. We will…

YouTube video by The ASF

GPU-accelerated query engines are often constrained by memory and I/O bandwidth. NVIDIA hardware advances—including high bandwidth memory (HBM), NVIDIA NVLink-C2C, and dedicated decompression engines…

With #212 merged we currently have the machinery to fully support TPC-DS but it's not yet satisfying, this issue will track some changes and improvements we would like to make before claiming TPC-D...

datafusion-go provides a database/sql driver for the datafusion query engine - datafusion-contrib/datafusion-go

This commit is a combination of the following PRs: Introduce IEEE 754 total order PARQUET-2249: Introduce IEEE 754 total order #221 Add nan_count to handle NaNs in statistics PARQUET-2249: Add nan...

Join us for an evening of talks, panel discussion, and community discussion about Apache DataFusion and its growing role in modern data infrastructure. We will…

Last NYC meetup (#10343) was a great success, I think ~6 months later is a great time to do another one! @gene-bordegaray and I will be organizing, we'll host at DataDog again. This meetup is sched...

Hey all, This discussion is to initiate the event organization. Please feel free to share ideas - we'd love to see who's willing to participate or take the stage (event details below). Time: TBD (m...

Introducing SmithDB: LangSmith's purpose-built distributed database for agent observability, delivering up to 12x faster performance with full portability.

Is your feature request related to a problem? Please describe. Thanks First of all, Tokio is awesome, and shout out to my peeps @carllerche and @Darksonn for their amazing work on this crate. We us...

A Rust-native DuckLake engine built on Apache DataFusion - datafusion-contrib/datafusion-ducklake