iiinova — where your digital self keeps evolving

Tom Cooper @tomcooper.dev · 25/07/2026

OMG! It came! Now listening: Transformers The Movie OST - The Reformatted Edition

000

Tom Cooper @tomcooper.dev · 19/06/2026

Is that hope I feel.... www.theguardian.com/politics/202...

010

Tom Cooper @tomcooper.dev · 20/05/2026

Last breakout session of #Current26 is sticking with my Kafka Streams theme, a walkthrough of designing a production grade application based on Kafka Streams

042

Tom Cooper @tomcooper.dev · 20/05/2026

A really fascinating talk on the internal details of Parquet. Gunnar is now finishing with some guidance on using AI tools for creating low level infrastructure code

140

Tom Cooper @tomcooper.dev · 20/05/2026

Now attending the World Premiere conference talk on Hardwood: the new Apache Parquet parser by @gunnarmorling.dev at #Current26

141

Tom Cooper @tomcooper.dev · 20/05/2026

Another Kafka Streams talk at #Current26, this time from Michelin around KS automatic resource naming and all the "fun" that comes from that

022

Tom Cooper @tomcooper.dev · 20/05/2026

This was a really interesting talk with some great tips on using the new streams protocol and crucially some actual experimental results showing the clear improvement 👏👏👏

021

Tom Cooper @tomcooper.dev · 20/05/2026

Not sure I said "rebalance" enough there...anyway KIP-1071 is a beautiful thing

110

Tom Cooper @tomcooper.dev · 20/05/2026

Continuing the rebalancing theme at #Current26, with a talk on the challenges of large rebalances in Kafka Streams and moving to KIP-1071 based rebalances

121

Tom Cooper @tomcooper.dev · 20/05/2026

Buuuuuuut as the speaker highlights, assignment needs to be fast and shouldn't block 😔

010

Tom Cooper @tomcooper.dev · 20/05/2026

Next up at #Current26, time to get into some Kafka internals and learn about broker-side partition assigners (post KIP-848)

110

Tom Cooper @tomcooper.dev · 20/05/2026

Kicking off #Current26 Day 2 with a talk from LinkedIn on dealing with trillion event CDC systems. Leaning about this Brooklin things I have been hearing about for years.

000

Tom Cooper @tomcooper.dev · 19/05/2026

Discussing what's next for Strimzi after 1.0: Cert Manager support, Cruise Control self-healing support and Kubernetes Gateway API support as the replacement for NGINX Ingress Controller...

010

Tom Cooper @tomcooper.dev · 19/05/2026

This was my favourite #Current26 talk of the day, an interesting solution to a unique situation but some ideas that can apply to many other Kafka deployments. I am particularly interested in what we could do in upstream Kafka to make backfilling jobs less disruptive 🤔

000

Tom Cooper @tomcooper.dev · 19/05/2026

Finishing the first day of #Current26 in style with the Strimzi AMA

120

Tom Cooper @tomcooper.dev · 19/05/2026

After bumping into an old Reddit colleague and chatting about CDC, the next talk at #current26 is hearing from @datadoghq.com about how they run their multi-PB streaming architecture. 10^4 brokers hosting 10^6 partitions 🤯

110

Tom Cooper @tomcooper.dev · 19/05/2026

The demo gods have struck at #Current26 and sadly we can participate in the online quarkus race game but there is a backup script to simulate audience participation 😅

010

Tom Cooper @tomcooper.dev · 19/05/2026

Next up at #Current26: Writing Supersonic Kafka apps using @quarkus.io

121

Tom Cooper @tomcooper.dev · 19/05/2026

I reckon most, if not all of these privacy tools could be implemented with @kroxylicious.io filters

010

Tom Cooper @tomcooper.dev · 19/05/2026

Next up at #current26 is a talk on keeping data private in your streaming pipelines, apparently Gremlins are involved.... I wonder if a particular gremlin blocking Crocodile (@kroxylicious.io) could help here too 🤔

110

Tom Cooper @tomcooper.dev · 19/05/2026

I'm having a @kafkastreams.bsky.social theme at #Current26, so I'm kicking things off with a talk about record headers in Kafka Streams state stores

021

Tom Cooper @tomcooper.dev · 19/05/2026

Kicking off #Current2026 with a thank you to the community that makes all this possible!

122

Tom Cooper @tomcooper.dev · 30/06/2025

It's my last day at Red Hat. Tomorrow I & the rest of middleware move to IBM. I wanted to work at RH since I heard about Fedora on the Linux Action Show (RIP) decades ago & I've loved developing in the open with RH. That'll continue after the move & after all, no one got fired for buying IBM...

020

Tom Cooper @tomcooper.dev · 21/05/2025

Luckily we have 2 people on the Strimzi team who literally wrote the book on Kafka Connect and Strimiz could do something (TBD) to help.

110

Tom Cooper @tomcooper.dev · 21/05/2025

Ending #Current25 with a talk on Polymorphic Table Functions in Flink🤘

120

Tom Cooper @tomcooper.dev · 21/05/2025

So nice to get a deep technical deep dive on a subject. They did a great job of explaining the migration process. If you want more detail we have blog posts:

000

Tom Cooper @tomcooper.dev · 21/05/2025

Woooo 🎉 great to see Strimzi maintainers Kate Stanley and Paolo Patierno on stage at #Current25 talking about how Strimzi helps you migrate your K8s Kafka clusters from Zookeeper to KRaft

110

Tom Cooper @tomcooper.dev · 21/05/2025

After a very interesting lunch time at #Current25 speaking to folks from OpenAI about Mirror Maker and what we could do in Strimzi to make things easier, I'm watching the Flink AMA MC'd by @rmetzger.bsky.social

010

Tom Cooper @tomcooper.dev · 21/05/2025

My ⚡ talk choice at #Current25 is @hpgrahsl.bsky.social and vector stores in Flink

111

Tom Cooper @tomcooper.dev · 21/05/2025

Ok so the main thrust is actually about removing Kafka from the mix & what you need to do in Iceberg to emulate topic compaction. A really interesting custom solution due to missing features in the Flink Iceberg connector. The headline, it works, it doesn't need Kafka but it's not as fast #Current25

000

Tom Cooper @tomcooper.dev · 21/05/2025

Onto something a bit more concrete now at #Current25. Improving CDC performance using Kafka, Flink and Iceberg

100

Tom Cooper @tomcooper.dev · 21/05/2025

Kicking off day 2 of #Current25 by boarding the AI agent train🤖🚂 with MongoDB 🌿

000

Tom Cooper @tomcooper.dev · 20/05/2025

Wooop Open Source Datastack FTW! Pinterest moving from an in-house to OSS based architecture! #Current25

000

Tom Cooper @tomcooper.dev · 20/05/2025

Final talk of the day at #Current25, Async processing with Flink SQL

110

Tom Cooper @tomcooper.dev · 20/05/2025

Great to hear that OpenAI have identified and fixed several issues with PyFlink and intend to push those fixes upstream 👏👏👏

000

Tom Cooper @tomcooper.dev · 20/05/2025

It's PyFlink for all the things and OpenAI uses the upstream Flink Kubernetes Operator

100

Tom Cooper @tomcooper.dev · 20/05/2025

Learning about how OpenAI built its stream processing system using Kafka and Flink at #Current25

100

Tom Cooper @tomcooper.dev · 20/05/2025

This talk has some really great examples of Flink's complex event processing (CEP) functionality in Flink SQL

100

Tom Cooper @tomcooper.dev · 20/05/2025

Great to see a push to enhance upstream Flink SQL with addional AI orientated functions

100

Tom Cooper @tomcooper.dev · 20/05/2025

Next up at #Current25 Flink 🐿️ but with robots 🤖 (AI agents)!

110

Tom Cooper @tomcooper.dev · 20/05/2025

Next at #Current25 a panel discussion on the past, present and future of @kafkastreams.bsky.social. I love the background...the likeness is uncanny...

062

Tom Cooper @tomcooper.dev · 20/05/2025

Starting #Current25 with an overview of anomaly detection in Flink SQL. This is from Confluent and AFAICS uses their proprietary ML functionality. But there is work in the upstream to support the same that builds on FLIP-437 which added the model syntax to Flink SQL cwiki.apache.org/confluence/d...

040

Tom Cooper @tomcooper.dev · 20/05/2025

Ready to start another Kafka and Flink filled couple of days in London at #Current25 Looking forward to hearing about stream processing with Flink, integrating with open table formats and this newfangled AI thing...

010

Tom Cooper @tomcooper.dev · 21/02/2025

Got a bit trigger happy in @vinylguru.co.uk. Finally invested in some John Coltrane and filling in the gaps in the Fleetwood Mac collection. Also very happy to have a copy of the Cowboy Bebop soundtrack all the way from Japan "three, two, one, let's jam..."

070

Tom Cooper @tomcooper.dev · 07/11/2024

After 15 years I finally left Twitter. I will miss what it was, not what it is. I made a lot of good connections there. Even got to see behind the curtain doing an internship at head office. But all good things...

040