Message Queues & Kafka Internals

Queues vs pub/sub vs logs, Kafka partitions, replication, ISR and acks, consumer groups, offsets, ordering and exactly-once — plus when RabbitMQ or SQS is the better tool.

About 120 minutes · 17 exam questions · 10 interview questions · 2 code labs

What you will learn

  1. Why messaging: synchronous calls vs asynchronous hand-off
  2. Queue vs pub/sub vs log: three different contracts
  3. Kafka architecture: brokers, topics, partitions and segments
  4. Replication, ISR, acks and leader election (and KRaft)
  5. Producers: keys, partitioning, batching and the idempotent producer
  6. Consumer groups and rebalancing
  7. Offsets and commit strategies
  8. Ordering guarantees: what Kafka does and does not promise
  9. Delivery semantics and Kafka exactly-once
  10. Kafka vs RabbitMQ vs SQS: picking the right broker
  11. Event-driven architecture: events, commands and contracts
  12. AWS messaging compared: SQS vs SNS vs EventBridge vs Kinesis

Next: Async Processing Failure Modes