Java bindings for Apache DataFusion. Contribute to apache/datafusion-java development by creating an account on GitHub.

Summary Adds native Delta Lake read support to Comet using delta-kernel-rs for log replay, matching all optimizations in the existing Iceberg native scan path. Delta tables (spark.sql("SELECT ...

The world tried to kill Andy off but he had to stay alive to to talk about what happened with databases in 2025.

This PR adds microbenchmarks for scanning a Parquet file and evaluating a single string expression per row. The benchmark runs against DuckDB and DataFusion and compares the results. Assuming that ...

What is the problem the feature request solves? Comet currently has two different approaches to scanning Iceberg tables. One approach is based on integrating with the Iceberg Java library, and the ...

Empowering everyone to build reliable and efficient software.

Apply for a Software Engineer, ASE Cassandra Storage job at Apple. Read about the role and find out if it’s right for you.

Which issue does this PR close? Closes #1705 Rationale for this change This feature makes it possible to visualize the flow of calls during query execution. What changes are included in this PR?...

Apply for a Senior Software Development Engineer (Apache Spark) - Apple Data Platform job at Apple. Read about the role and find out if it’s right for you.

Apache DataFusion Comet Spark Accelerator. Contribute to apache/datafusion-comet development by creating an account on GitHub.

I've used open source projects for over 30 years and contributed for about 20 of those. My first interaction with an open source foundation was with Apache when I began working with Apache Hadoop ...

YouTube video by Datadog

Introduction These notes reflect things I am personally involved in or thinking about and may not cover all activities. Feel free to add comments for anything that I missed. Previous week's issue: ...

Introduction Inspired by @alamb's weekly updates in DataFusion, I thought it would be a good idea to do something similar in Comet to keep contributors updated on what is happening in the project. ...

Arrow speeds up query result transfer by slashing (de)serialization overheads. We outline five key attributes of the Arrow format that enable this.

Which issue does this PR close? N/A Rationale for this change There have been a number of performance improvements since 0.4.0 so we should update the benchmark results. The results are based on ...

Andy rises from the ashes of his dead startup and discusses what happened in 2024 in the database game.

I try to offer the tips I have for how to set and stick to boundaries to maintain a healthy work-life balance.

YouTube video by CMU Database Group

<!–

Apache DataFusion Ballista Distributed Query Engine - apache/datafusion-ballista

O2 has today unveiled the newest member of its fraud prevention team, 'Daisy'. As ‘Head of Scammer Relations’, this state-of-the-art AI Granny's mission is to talk with fraudsters and waste as much of...

YouTube video by CMU Database Group

The 10 coolest open-source software tools in 2024 include tools for developing AI applications and managing large volumes of data.