Sign in

Tom Cooper

@tomcooper.dev
219 followers 168 following 86 posts

Senior Principal Engineer at IBM, Ex-Red Hat, Ex-Reddit, Ex-Twitter, Distributed Systems PhD, interested in all things stream processing, also cycling

PostsRepliesMedia
Tom Cooper @tomcooper.dev · 29/09/2026
My site for tracking OSS improvement proposals (ossip.dev) has had lots of updates recently, including adding tracking for strimzi.io, @kroxylicious.io and streamshub.io. It also has its own update feed on blusky: @oss-ip.bsky.social I also got a shout out in @rmoff.net's excellent newsletter!
ossip.dev
OSSIP - Open Source Software Improvement Proposals
040
Tom Cooper @tomcooper.dev · 27/08/2026
First Dolly, then Tim and now Optimus www.bbc.co.uk/news/article... 'til all are one....
static.klipy.com
Transformers: Optimus Prime Injured
ALT: Transformers: Optimus Prime Injured
000
Tom Cooper @tomcooper.dev · 25/07/2026
OMG! It came! Now listening: Transformers The Movie OST - The Reformatted Edition
000
Tom Cooper @tomcooper.dev · 23/07/2026
Congratulations to Apache Storm on their 3.0.0 release: storm.apache.org/2026/07/22/s... I need to spend some time updating my knowledge of it, its been 6 years since I finished my PhD based on performance modelling of Storm Topologies tomcooper.dev/phd/
storm.apache.org
Apache Storm 3.0.0 Released
Apache Storm is a free and open source distributed realtime computation system. Storm makes it easy to reliably process unbounded streams of data, doing for realtime processing what Hadoop did for bat...
000
Reposted by Tom Cooper
Kafka Streams @kafkastreams.bsky.social · 25/06/2026
Apache Kafka 4.3.1 was released. It contains a critical memory-leak bug fix for #KafkaStreams. Thanks to our RM Bill Bejeck for the quick turnaround on this downloads.apache.org/kafka/4.3.1/...
downloads.apache.org
Below is a summary of the JIRA issues addressed in the 4.3.1 release of Kafka. For full documentation of the release, a guide to get started, and information about the project, see the Kafka project site.
024
Tom Cooper @tomcooper.dev · 19/06/2026
Hummmm 🤔 www.theguardian.com/politics/liv...
theguardian.com
Starmer says he ‘will stand’ in any Labour leadership contest after Burnham’s decisive byelection win – UK politics live
Burnham hails a ‘turning point’ for the country after a resounding victory over Reform UK and Restore
000
Reposted by Tom Cooper
James O’Brien @mrjamesob.bsky.social · 19/06/2026
Memo to pretty much (but obviously not quite) everybody in the media…
792045529
Tom Cooper @tomcooper.dev · 19/06/2026
Burnham probably got most of the Lib Dem, Green and disaffected Tory votes. But damn... is it nice to see the Labor vote far ahead of the combined right-wing vote. Tactical voting FTW.
010
Tom Cooper @tomcooper.dev · 19/06/2026
Is that hope I feel.... www.theguardian.com/politics/202...
010
Tom Cooper @tomcooper.dev · 15/06/2026
We need to get to the bottom of Russian interference in our country and crucially hold those who work with them responsible. Please consider signing this petition from @hopenothate.org.uk to demand a wide reaching inquiry secure.hopenothate.org.uk/page/193695/...
secure.hopenothate.org.uk
Russia set Britain on fire. Demand an inquiry.
The men who tried to set fire to Kier Starmer’s house were taking orders from Russia. Our research shows this was not an isolated plot. It was part of a wider Russian operation on British soil. Add yo...
021
Tom Cooper @tomcooper.dev · 03/06/2026
Next up at #StrimziCon2026 is Sky Kistler from Reddit talking about how they migrated there massive AWS EC2 based Kafka infra to a Strimzi based solution running on Kubernetes: www.reddit.com/r/RedditEng/...
reddit.com
From the RedditEng community on Reddit
Explore this post and more from the RedditEng community
230
Tom Cooper @tomcooper.dev · 03/06/2026
#StrimziCon2026 just kicked off, join us to hear from maintainers and users of Strimzi about how to use Strimzi to full effect and what is coming in the future! community2.cncf.io/events/detai...
community2.cncf.io
StrimziCon 2026 | CNCF
Virtual Event - StrimziCon is an event for developers, DevOps engineers, and solution architects who want to learn about Strimzi and event streaming. Strimzi is an operator for running Apache Kafka on...
021
Tom Cooper @tomcooper.dev · 20/05/2026
Last breakout session of #Current26 is sticking with my Kafka Streams theme, a walkthrough of designing a production grade application based on Kafka Streams
042
Tom Cooper @tomcooper.dev · 20/05/2026
Now attending the World Premiere conference talk on Hardwood: the new Apache Parquet parser by @gunnarmorling.dev at #Current26
141
Tom Cooper @tomcooper.dev · 20/05/2026
Another Kafka Streams talk at #Current26, this time from Michelin around KS automatic resource naming and all the "fun" that comes from that
022
Tom Cooper @tomcooper.dev · 20/05/2026
Continuing the rebalancing theme at #Current26, with a talk on the challenges of large rebalances in Kafka Streams and moving to KIP-1071 based rebalances
121
Tom Cooper @tomcooper.dev · 20/05/2026
Next up at #Current26, time to get into some Kafka internals and learn about broker-side partition assigners (post KIP-848)
110
Tom Cooper @tomcooper.dev · 20/05/2026
Kicking off #Current26 Day 2 with a talk from LinkedIn on dealing with trillion event CDC systems. Leaning about this Brooklin things I have been hearing about for years.
000
Tom Cooper @tomcooper.dev · 19/05/2026
Finishing the first day of #Current26 in style with the Strimzi AMA
120
Tom Cooper @tomcooper.dev · 19/05/2026
After bumping into an old Reddit colleague and chatting about CDC, the next talk at #current26 is hearing from @datadoghq.com about how they run their multi-PB streaming architecture. 10^4 brokers hosting 10^6 partitions 🤯
110
Tom Cooper @tomcooper.dev · 19/05/2026
Next up at #Current26: Writing Supersonic Kafka apps using @quarkus.io
121
Tom Cooper @tomcooper.dev · 19/05/2026
Next up at #current26 is a talk on keeping data private in your streaming pipelines, apparently Gremlins are involved.... I wonder if a particular gremlin blocking Crocodile (@kroxylicious.io) could help here too 🤔
110
Tom Cooper @tomcooper.dev · 19/05/2026
I'm having a @kafkastreams.bsky.social theme at #Current26, so I'm kicking things off with a talk about record headers in Kafka Streams state stores
021
Tom Cooper @tomcooper.dev · 19/05/2026
Great to catch up with @gunnarmorling.dev and @rmoff.net at #Current26, looking forward to Gunnar's talk tomorrow about the new Parquet parser he has created and what that might mean for Flink (and maybe Kafka Streams)!
030
Tom Cooper @tomcooper.dev · 19/05/2026
I have to compliment the audio setup at #Current26, the J-Arrays have some serious bass. The intro music lost me several Hz of my lower range....
010
Tom Cooper @tomcooper.dev · 19/05/2026
Kicking off #Current2026 with a thank you to the community that makes all this possible!
122
Reposted by Tom Cooper
kroxylicious.io @kroxylicious.io · 09/03/2026
Kroxylicious is the snappy open source proxy for Apache Kafka®. See how it works in 3 minutes: youtu.be/xLOjKScpJ3Q #ApacheKafka #Kroxylicious #EventStreaming #DataEngineering
youtu.be
Kroxylicious Introduction
YouTube video by Kroxylicious
012
Reposted by Tom Cooper
Ian Coldwater 🧊🚫 @lookitup.baby · 16/09/2025
Today is the 30th anniversary of Hackers
the cast of Hackers (1995) posing in a series of adjacent phone booths
7135761035
Tom Cooper @tomcooper.dev · 07/07/2025
A bit late, but the recording of my #StrimziCon2025 talk, Phased Upgrades of Strimzi Managed Kafka Fleets (hows that for a snappy title) is now up on Youtube: youtu.be/pEuYFFkQCUU?...
youtu.be
Phased upgrades of Strimzi managed Kafka fleets
YouTube video by Strimzi
020
Tom Cooper @tomcooper.dev · 30/06/2025
It's my last day at Red Hat. Tomorrow I & the rest of middleware move to IBM. I wanted to work at RH since I heard about Fedora on the Linux Action Show (RIP) decades ago & I've loved developing in the open with RH. That'll continue after the move & after all, no one got fired for buying IBM...
020
Reposted by Tom Cooper
Gunnar Morling @gunnarmorling.dev · 14/06/2025
🐊 Kroxylicious Proposal: "Routing API" This looks like a very useful addition to @kroxylicious.io (wire-protocol proxy for Apache Kafka): dynamic routing of requests to different upstream clusters, enabling use cases such as union clusters and client-based routing. 👉 github.com/kroxylicious...
0103
Tom Cooper @tomcooper.dev · 09/06/2025
Going from 1 to 13 PB/day 🤯 thanks to moving from a self-managed to a Strimzi-managed Kafka cluster! Great to hear these stories of how Strimzi not only made life easier for infra teams but improved the service they provide! strimzi.io/blog/2025/06...
strimzi.io
Taming the Kafka Chaos: How Strimzi Helped Us Scale with Confidence
Strimzi provides a way to run an Apache Kafka cluster on Kubernetes in various deployment configurations.
010
Tom Cooper @tomcooper.dev · 21/05/2025
Ending #Current25 with a talk on Polymorphic Table Functions in Flink🤘
120
Tom Cooper @tomcooper.dev · 21/05/2025
Great hallway track at #Current25, lots of ideas around Kafka connect, mirror maker, geo-replication, cluster balancing. Lots to mull over on the train home...
130
Tom Cooper @tomcooper.dev · 21/05/2025
"Vibe-coded database schemas" 😱
100
Tom Cooper @tomcooper.dev · 21/05/2025
Woooo 🎉 great to see Strimzi maintainers Kate Stanley and Paolo Patierno on stage at #Current25 talking about how Strimzi helps you migrate your K8s Kafka clusters from Zookeeper to KRaft
110
Tom Cooper @tomcooper.dev · 21/05/2025
After a very interesting lunch time at #Current25 speaking to folks from OpenAI about Mirror Maker and what we could do in Strimzi to make things easier, I'm watching the Flink AMA MC'd by @rmetzger.bsky.social
010
Tom Cooper @tomcooper.dev · 21/05/2025
My ⚡ talk choice at #Current25 is @hpgrahsl.bsky.social and vector stores in Flink
111
Tom Cooper @tomcooper.dev · 21/05/2025
Onto something a bit more concrete now at #Current25. Improving CDC performance using Kafka, Flink and Iceberg
100
Tom Cooper @tomcooper.dev · 21/05/2025
Kicking off day 2 of #Current25 by boarding the AI agent train🤖🚂 with MongoDB 🌿
000
Tom Cooper @tomcooper.dev · 20/05/2025
Final talk of the day at #Current25, Async processing with Flink SQL
110
Tom Cooper @tomcooper.dev · 20/05/2025
Learning about how OpenAI built its stream processing system using Kafka and Flink at #Current25
100
Tom Cooper @tomcooper.dev · 20/05/2025
Next up at #Current25 Flink 🐿️ but with robots 🤖 (AI agents)!
110
Tom Cooper @tomcooper.dev · 20/05/2025
Next at #Current25 a panel discussion on the past, present and future of @kafkastreams.bsky.social. I love the background...the likeness is uncanny...
062
Tom Cooper @tomcooper.dev · 20/05/2025
Starting #Current25 with an overview of anomaly detection in Flink SQL. This is from Confluent and AFAICS uses their proprietary ML functionality. But there is work in the upstream to support the same that builds on FLIP-437 which added the model syntax to Flink SQL cwiki.apache.org/confluence/d...
040
Tom Cooper @tomcooper.dev · 20/05/2025
Ready to start another Kafka and Flink filled couple of days in London at #Current25 Looking forward to hearing about stream processing with Flink, integrating with open table formats and this newfangled AI thing...
010
Tom Cooper @tomcooper.dev · 16/04/2025
The agenda for StrimziCon 2025 is out and yours-truly is 2nd on the bill! I'll be presenting my recent work on phased upgrades of Strimzi managed Kafka fleets. There are many other great talks on their so check out the full agenda: strimzi.io/blog/2025/04...
strimzi.io
StrimziCon 2025: Schedule announced!
Strimzi provides a way to run an Apache Kafka cluster on Kubernetes in various deployment configurations.
000
Tom Cooper @tomcooper.dev · 10/04/2025
If you're running Strimzi in production, you'll probably come up against the issue of wanting to upgrade the operator but not wanting to roll all its Kafka clusters right away. As this comes up a lot, I wrote a blog post with an example of how you could achieve this: strimzi.io/blog/2025/04...
strimzi.io
010
Tom Cooper @tomcooper.dev · 24/03/2025
Apache Flink 2.0.0 is out, featuring disaggregated state management (object storage), materialized tables unifying stream/batch processing, enhanced batch execution, deeper Paimon (Open table format) integration for creating streaming lakehouses and AI model support: flink.apache.org/2025/03/24/a...
flink.apache.org
Apache Flink 2.0.0: A new Era of Real-Time Data Processing
Today, the Flink PMC is proud to announce the official release of Apache Flink 2.0.0! This marks the first release in the Flink 2.x series and is the first major release since Flink 1.0 launched nine ...
010
Tom Cooper @tomcooper.dev · 05/03/2025
This got me right in the feels...
000