If you're using Apache Kafka® with KRaft, then you probably understand the importance of controller quorum in keeping things working. But what to do when that goes wrong?

How Java, Kafka Streams, and MongoDB vector search combine to catch fraud in real time, from rule-based guardrails to behavioral similarity scoring.

Kubernetes controllers change production without asking because their scope is bounded. Why Kafka AI agents should work the same way, and where to start.

Event-driven systems sit at the intersection of several of the hardest problems in backend engineering — ordering, delivery guarantees, schema evolution, and operational trust — and this course was de...

Apache Kafka is one of the most important technologies in modern event-driven and microservices architectures.

Introduction

You can read the article for free from here.

Ask ten people what Kafka is, and you’ll get ten confident, slightly wrong answers. The business stakeholder thinks it’s a magic pipe that…

Learn practical ways to cut data streaming costs in Kafka and Flink by optimizing batching, serialization, state, network traffic, and capacity.

Use Testcontainers and JUnit to test Kafka consumer recovery contracts for duplicate delivery, malformed records, and offset-boundary failures.

Let’s suppose a Kafka cluster is handling roughly the same amount of traffic it did last year, but we now want to keep six months of data…

A customer uploaded a 900,000-row CSV and asked us how far along it was. We couldn’t tell them.

This article reflects lessons learned from my experience designing data, telemetry, and observability platforms over the past decade.

A simple guide to why Kafka copies data differently than your database does — and why that’s a good thing.

Imagine you've just joined an online shop as its first data engineer.

Production-ready Java implementation of the Transactional Outbox Pattern for Spring Boot 4, Kafka and PostgreSQL, with idempotency, batch publishing, recovery and low database polling. - KHolodilin...

Ask ten people what Kafka is, and you’ll get ten confident, slightly wrong answers. The business stakeholder thinks it’s a magic pipe that…

Kafka Has Officially Entered the AI Era

Apache Kafka runs the backend of almost every large-scale app you use daily — but most tutorials jump straight into commands without ever explaining why Kafk...

Friend link

Configure Kafka authentication in Strimzi using mTLS, custom principal builders, tenant-specific listeners, OAuth, and secure multi-tenant isolation.

Kafka only promises order inside a single partition. Here's how that works in practice, why things still arrive jumbled anyway, and how to keep order intact without getting burned in production.

An interactive Node.js + React simulator that shows how Kafka topics, partitions, offsets, brokers, producers, consumer groups and hot partitions actually work. - ChauhanParesh/kafka-explained

Part 2 of the Creating Reliable Business Systems series

Kafka Consumer Lag Is Not an Autoscaling Strategy While building my Distributed Job Scheduler, I came across an interesting question: How do you handle consumer lag for an ExecutorService, and what …

Diskless Kafka moves the active log to object storage. See how KIP1150, WarpStream, AutoMQ and Redpanda reshape Kafka’s write path, metadata and cost.

Kafka is great at storing and streaming events, but one thing it doesn’t provide out of the box is search.

How to propagate OpenTelemetry context across Kafka and gRPC in production: W3C Trace Context, headers, and the gotchas that break traces.

Java applications are usually associated with APIs, databases, messaging systems, and cloud infrastructure. But Java can also interact with the physical - by Igor De Souza

Compare Kafka and Iggy architectures, durability guarantees, and benchmarks to understand which streaming engine fits your workload before you decide.

Khaos is an open-source Kafka traffic generator, load-testing tool, and chaos engineering CLI. Generate realistic Kafka traffic and reproduce failure scenarios like consumer lag, hot partitions, rebal...

Interactive system architecture demonstrations — load balancers, rate limiters, message queues, and RabbitMQ vs Kafka. Watch each mechanism run live, tweak it, break it on purpose.

A production redesign using batching, safe offset commits, and record-level fallback raised Kafka consumer throughput from 4K to 25K without adding partitions.

Get a complete, working Apache Kafka® Streams example for Avro messages, and deploy it as an Aiven App linked to your Karapace schema registry.

Explore the architectural differences between logfirst systems like Apache Kafka and table-first engines like Apache Fluss for streaming data pipelines.

Imagine running a Java application that processes massive amounts of data in real time. Example financial transactions flowing…

Kafi Streams 1.0.0

Apache Kafka Fundamentals Course with Tim Berglund

You want to learn Kafka? This is the course for you! If you are a Data Architect or a Microservices Developer, you can't miss out on what Kafka has to offer....

Apache Fluss is an open-source storage layer designed to unify the infrastructure for real-time analytics. This paper traces the architecture that makes that possible

A topic is a named log sliced into partitions. The API writes the row, then publishes. Order lives on a partition, not on the topic.

Everything you need to understand Apache Kafka, from your first event to building scalable, fault-tolerant streaming systems.

Kafka offset-based consumer lag is misleading when message sizes vary. How to instrument time-based lag metrics for an accurate view of consumer group health.

Accompanying lecture notes: https://www.cl.cam.ac.uk/teaching/2122/ConcDisSys/dist-sys-notes.pdf These videos form an 8-lecture series on distributed systems...