iiinova — where your digital self keeps evolving

Andrus Adamchik

@andrus.adamchik.org

374 followers 186 following 180 posts

Java open-source & ObjectStyle Making Java a viable option for data processing / analysis at DFLib.org Apache Software Foundation member / ex VP

Posts Replies Media

Andrus Adamchik @andrus.adamchik.org · 13/09/2025

DFLib 2, milestone 4 is out. Massive QL improvements. I finally switched all of my own projects to QL from the API-based expressions. Also some new ECharts stuff github.com/dflib/dflib/...

030

Andrus Adamchik @andrus.adamchik.org · 12/02/2025

The first milestone of DFLib 2 is out. Lots of improvements as described here: github.com/dflib/dflib/... A few examples: * 8x reduction of memory footprint of BooleanSeries * Major new capabilities in "window" expressions * Shortened aggregation syntax of "group" expressions * Heatmap charts

020

Andrus Adamchik @andrus.adamchik.org · 24/12/2024

So I am on Amtrak on the Christmas Eve. Time to do benchmarking! Result is from the DFLib benchmark suite, normalized vs #java 17 (21 - blue, 23 - green). Some (vectorized) operations are up to 50% faster on 23. May not matter in a typical app, but array processing def. got much faster in 23.

281

Andrus Adamchik @andrus.adamchik.org · 24/12/2024

Using Bootique test framework even for libraries that are otherwise unaware of Bootique. E.g. standing up a test web server is as simple as this (server response logic is in TestServlet)

010

Andrus Adamchik @andrus.adamchik.org · 23/12/2024

Somehow this is my first time in the National Air and Space Museum. Feeling excited like a teenager

230

Andrus Adamchik @andrus.adamchik.org · 08/12/2024

Figured out the discrepancy. Loaded data from GitHub month-by-month instead of the entire year. And the new heatmap correlates really well with the green one. The only difference is GitHub also tracks issues as activity.

030

Andrus Adamchik @andrus.adamchik.org · 08/12/2024

Just added heatmap charts to DFLib. Now trying to recreate GitHub activity tiles with it. Looks pretty, but the data that I got from GitHub API seems to be missing lots of commits, so the yellow/red heatmap has more holes in it.

140

Andrus Adamchik @andrus.adamchik.org · 30/11/2024

Still seems to be a recurring topic: "[#dataengineering] become config more than anything else." My own thoughts on this as a programmer is now is the best time to shift parts of data engineering "to the left" with infrastructure-free pipelines developed next to the app code

040

Andrus Adamchik @andrus.adamchik.org · 27/11/2024

Me: working to bring data engineering techniques to programmers A common post on /r/dataengineering: "I am stuck at my job, I want to be a programmer" 😐

130

Andrus Adamchik @andrus.adamchik.org · 27/11/2024

#Apache ECharts is a really nice lib. We recently built a #Java DSL for it. The docs are not as good as ECharts' own yet 🙂 (dflib.org/dflib/docs/1...), but visualizations possibilities are amazing: * dflib.org/charts/hocke... * dflib.org/charts/hocke...

2103

Andrus Adamchik @andrus.adamchik.org · 25/11/2024

Finally, a laptop with more than 16g of RAM that can process decent-size datasets. Of course, right now it is all dedicated to “mdworker_shared”

120

Andrus Adamchik @andrus.adamchik.org · 18/11/2024

A rule of system evolution - each data processing technology inevitably ends up adding a dashboard feature 😀 DFLib is no exception. Just added a way to save semi-interactive charts to HTML.

000