Sign in

Tom Cooper

@tomcooper.dev
219 followers 168 following 86 posts

Senior Principal Engineer at IBM, Ex-Red Hat, Ex-Reddit, Ex-Twitter, Distributed Systems PhD, interested in all things stream processing, also cycling

PostsRepliesMedia
Tom Cooper @tomcooper.dev · 29/09/2026
My site for tracking OSS improvement proposals (ossip.dev) has had lots of updates recently, including adding tracking for strimzi.io, @kroxylicious.io and streamshub.io. It also has its own update feed on blusky: @oss-ip.bsky.social I also got a shout out in @rmoff.net's excellent newsletter!
ossip.dev
OSSIP - Open Source Software Improvement Proposals
040
Tom Cooper @tomcooper.dev · 27/08/2026
First Dolly, then Tim and now Optimus www.bbc.co.uk/news/article... 'til all are one....
static.klipy.com
Transformers: Optimus Prime Injured
ALT: Transformers: Optimus Prime Injured
000
Tom Cooper @tomcooper.dev · 25/07/2026
OMG! It came! Now listening: Transformers The Movie OST - The Reformatted Edition
000
Tom Cooper @tomcooper.dev · 23/07/2026
Congratulations to Apache Storm on their 3.0.0 release: storm.apache.org/2026/07/22/s... I need to spend some time updating my knowledge of it, its been 6 years since I finished my PhD based on performance modelling of Storm Topologies tomcooper.dev/phd/
storm.apache.org
Apache Storm 3.0.0 Released
Apache Storm is a free and open source distributed realtime computation system. Storm makes it easy to reliably process unbounded streams of data, doing for realtime processing what Hadoop did for bat...
000
Tom Cooper @tomcooper.dev · 19/07/2026
I run Fedora Sway edition without a display manager, so I just launch straight into the shell. Sometimes, if I just want to write, I skip launching sway and just stick with tmux + vim, it works pretty well for distraction free working. I inevitably need to search for something and use kagi.micr.dev
kagi.micr.dev
Introduction - kagi
Complete guide to the kagi CLI - a command-line interface for Kagi search, automation, and structured terminal workflows.
010
Reposted by Tom Cooper
Kafka Streams @kafkastreams.bsky.social · 25/06/2026
Apache Kafka 4.3.1 was released. It contains a critical memory-leak bug fix for #KafkaStreams. Thanks to our RM Bill Bejeck for the quick turnaround on this downloads.apache.org/kafka/4.3.1/...
downloads.apache.org
Below is a summary of the JIRA issues addressed in the 4.3.1 release of Kafka. For full documentation of the release, a guide to get started, and information about the project, see the Kafka project site.
024
Tom Cooper @tomcooper.dev · 19/06/2026
Hummmm 🤔 www.theguardian.com/politics/liv...
theguardian.com
Starmer says he ‘will stand’ in any Labour leadership contest after Burnham’s decisive byelection win – UK politics live
Burnham hails a ‘turning point’ for the country after a resounding victory over Reform UK and Restore
000
Reposted by Tom Cooper
James O’Brien @mrjamesob.bsky.social · 19/06/2026
Memo to pretty much (but obviously not quite) everybody in the media…
792045529
Tom Cooper @tomcooper.dev · 19/06/2026
Burnham probably got most of the Lib Dem, Green and disaffected Tory votes. But damn... is it nice to see the Labor vote far ahead of the combined right-wing vote. Tactical voting FTW.
010
Tom Cooper @tomcooper.dev · 19/06/2026
Is that hope I feel.... www.theguardian.com/politics/202...
010
Tom Cooper @tomcooper.dev · 15/06/2026
We need to get to the bottom of Russian interference in our country and crucially hold those who work with them responsible. Please consider signing this petition from @hopenothate.org.uk to demand a wide reaching inquiry secure.hopenothate.org.uk/page/193695/...
secure.hopenothate.org.uk
Russia set Britain on fire. Demand an inquiry.
The men who tried to set fire to Kier Starmer’s house were taking orders from Russia. Our research shows this was not an isolated plot. It was part of a wider Russian operation on British soil. Add yo...
021
Tom Cooper @tomcooper.dev · 03/06/2026
I used to be part of Sky's team and played a part in the early planning of this migration. I am very proud to see what the team has achieved!
000
Tom Cooper @tomcooper.dev · 03/06/2026
Next up at #StrimziCon2026 is Sky Kistler from Reddit talking about how they migrated there massive AWS EC2 based Kafka infra to a Strimzi based solution running on Kubernetes: www.reddit.com/r/RedditEng/...
reddit.com
From the RedditEng community on Reddit
Explore this post and more from the RedditEng community
230
Tom Cooper @tomcooper.dev · 03/06/2026
#StrimziCon2026 just kicked off, join us to hear from maintainers and users of Strimzi about how to use Strimzi to full effect and what is coming in the future! community2.cncf.io/events/detai...
community2.cncf.io
StrimziCon 2026 | CNCF
Virtual Event - StrimziCon is an event for developers, DevOps engineers, and solution architects who want to learn about Strimzi and event streaming. Strimzi is an operator for running Apache Kafka on...
021
Tom Cooper @tomcooper.dev · 20/05/2026
Last breakout session of #Current26 is sticking with my Kafka Streams theme, a walkthrough of designing a production grade application based on Kafka Streams
042
Tom Cooper @tomcooper.dev · 20/05/2026
A really fascinating talk on the internal details of Parquet. Gunnar is now finishing with some guidance on using AI tools for creating low level infrastructure code
140
Tom Cooper @tomcooper.dev · 20/05/2026
Now attending the World Premiere conference talk on Hardwood: the new Apache Parquet parser by @gunnarmorling.dev at #Current26
141
Tom Cooper @tomcooper.dev · 20/05/2026
Another Kafka Streams talk at #Current26, this time from Michelin around KS automatic resource naming and all the "fun" that comes from that
022
Tom Cooper @tomcooper.dev · 20/05/2026
This was a really interesting talk with some great tips on using the new streams protocol and crucially some actual experimental results showing the clear improvement 👏👏👏
021
Tom Cooper @tomcooper.dev · 20/05/2026
Not sure I said "rebalance" enough there...anyway KIP-1071 is a beautiful thing
110
Tom Cooper @tomcooper.dev · 20/05/2026
Continuing the rebalancing theme at #Current26, with a talk on the challenges of large rebalances in Kafka Streams and moving to KIP-1071 based rebalances
121
Tom Cooper @tomcooper.dev · 20/05/2026
Buuuuuuut as the speaker highlights, assignment needs to be fast and shouldn't block 😔
010
Tom Cooper @tomcooper.dev · 20/05/2026
I wonder if we could make a service like Cruise Control but for Kafka Consumers and have a custom partition assigner that calls out to that for rebalancing decisions 🤔
110
Tom Cooper @tomcooper.dev · 20/05/2026
Next up at #Current26, time to get into some Kafka internals and learn about broker-side partition assigners (post KIP-848)
110
Tom Cooper @tomcooper.dev · 20/05/2026
Kicking off #Current26 Day 2 with a talk from LinkedIn on dealing with trillion event CDC systems. Leaning about this Brooklin things I have been hearing about for years.
000
Tom Cooper @tomcooper.dev · 19/05/2026
Discussing what's next for Strimzi after 1.0: Cert Manager support, Cruise Control self-healing support and Kubernetes Gateway API support as the replacement for NGINX Ingress Controller...
010
Tom Cooper @tomcooper.dev · 19/05/2026
This was my favourite #Current26 talk of the day, an interesting solution to a unique situation but some ideas that can apply to many other Kafka deployments. I am particularly interested in what we could do in upstream Kafka to make backfilling jobs less disruptive 🤔
000
Tom Cooper @tomcooper.dev · 19/05/2026
Finishing the first day of #Current26 in style with the Strimzi AMA
120
Tom Cooper @tomcooper.dev · 19/05/2026
After bumping into an old Reddit colleague and chatting about CDC, the next talk at #current26 is hearing from @datadoghq.com about how they run their multi-PB streaming architecture. 10^4 brokers hosting 10^6 partitions 🤯
110
Tom Cooper @tomcooper.dev · 19/05/2026
The demo gods have struck at #Current26 and sadly we can participate in the online quarkus race game but there is a backup script to simulate audience participation 😅
010
Tom Cooper @tomcooper.dev · 19/05/2026
Next up at #Current26: Writing Supersonic Kafka apps using @quarkus.io
121
Tom Cooper @tomcooper.dev · 19/05/2026
I reckon most, if not all of these privacy tools could be implemented with @kroxylicious.io filters
010
Tom Cooper @tomcooper.dev · 19/05/2026
@michaeldrogalis.bsky.social's ShadowTraffic gets a shout out for generating test data for developing streaming privacy tools.
110
Tom Cooper @tomcooper.dev · 19/05/2026
This #Current26 talk uses very Confluent specific tooling (unsurprisingly) but if you want encryption at rest you can use the OSS @kroxylicious.io Kafka proxy kroxylicious.io/use-cases/#e... Kroxy has a pluggable architecture so record masking and other privacy features can be added in easily
kroxylicious.io
Use Cases
Network proxy framework for Apache Kafka
121
Tom Cooper @tomcooper.dev · 19/05/2026
Next up at #current26 is a talk on keeping data private in your streaming pipelines, apparently Gremlins are involved.... I wonder if a particular gremlin blocking Crocodile (@kroxylicious.io) could help here too 🤔
110
Tom Cooper @tomcooper.dev · 19/05/2026
I'm having a @kafkastreams.bsky.social theme at #Current26, so I'm kicking things off with a talk about record headers in Kafka Streams state stores
021
Tom Cooper @tomcooper.dev · 19/05/2026
Great to catch up with @gunnarmorling.dev and @rmoff.net at #Current26, looking forward to Gunnar's talk tomorrow about the new Parquet parser he has created and what that might mean for Flink (and maybe Kafka Streams)!
030
Tom Cooper @tomcooper.dev · 19/05/2026
I have to compliment the audio setup at #Current26, the J-Arrays have some serious bass. The intro music lost me several Hz of my lower range....
010
Tom Cooper @tomcooper.dev · 19/05/2026
Nope, it's raining, which is very in keeping with the following water theme
010
Tom Cooper @tomcooper.dev · 19/05/2026
Turns out the hashtag is actually #Current26, hopefully there is a streaming join out there merging all these posts....
020
Tom Cooper @tomcooper.dev · 19/05/2026
Kicking off #Current2026 with a thank you to the community that makes all this possible!
122
Tom Cooper @tomcooper.dev · 23/03/2026
With the help of our friend Claude, I gave my KIP and FLIP tracking site a much needed overhaul: ossip.dev
ossip.dev
OSSIP - Open Source Software Improvement Proposals
010
Reposted by Tom Cooper
kroxylicious.io @kroxylicious.io · 09/03/2026
Kroxylicious is the snappy open source proxy for Apache Kafka®. See how it works in 3 minutes: youtu.be/xLOjKScpJ3Q #ApacheKafka #Kroxylicious #EventStreaming #DataEngineering
youtu.be
Kroxylicious Introduction
YouTube video by Kroxylicious
012
Reposted by Tom Cooper
Ian Coldwater 🧊🚫 @lookitup.baby · 16/09/2025
Today is the 30th anniversary of Hackers
the cast of Hackers (1995) posing in a series of adjacent phone booths
7135761035
Tom Cooper @tomcooper.dev · 07/07/2025
A bit late, but the recording of my #StrimziCon2025 talk, Phased Upgrades of Strimzi Managed Kafka Fleets (hows that for a snappy title) is now up on Youtube: youtu.be/pEuYFFkQCUU?...
youtu.be
Phased upgrades of Strimzi managed Kafka fleets
YouTube video by Strimzi
020
Tom Cooper @tomcooper.dev · 30/06/2025
It's my last day at Red Hat. Tomorrow I & the rest of middleware move to IBM. I wanted to work at RH since I heard about Fedora on the Linux Action Show (RIP) decades ago & I've loved developing in the open with RH. That'll continue after the move & after all, no one got fired for buying IBM...
020
Reposted by Tom Cooper
Gunnar Morling @gunnarmorling.dev · 14/06/2025
🐊 Kroxylicious Proposal: "Routing API" This looks like a very useful addition to @kroxylicious.io (wire-protocol proxy for Apache Kafka): dynamic routing of requests to different upstream clusters, enabling use cases such as union clusters and client-based routing. 👉 github.com/kroxylicious...
0103
Tom Cooper @tomcooper.dev · 09/06/2025
Going from 1 to 13 PB/day 🤯 thanks to moving from a self-managed to a Strimzi-managed Kafka cluster! Great to hear these stories of how Strimzi not only made life easier for infra teams but improved the service they provide! strimzi.io/blog/2025/06...
strimzi.io
Taming the Kafka Chaos: How Strimzi Helped Us Scale with Confidence
Strimzi provides a way to run an Apache Kafka cluster on Kubernetes in various deployment configurations.
010
Tom Cooper @tomcooper.dev · 21/05/2025
It was a really great talk, you covered a lot in 15mins! I am keen to work on an OSS library for embeddings wrapping Langchain4j so may ping you for opinions/reviews if you have time?
110
Tom Cooper @tomcooper.dev · 21/05/2025
Luckily we have 2 people on the Strimzi team who literally wrote the book on Kafka Connect and Strimiz could do something (TBD) to help.
110