Book 2 · Lesson 2.7

Backpressure and replayability

  • Define consumer lag
  • Simulate burst produce and catch-up
  • Explain offset rewind for dev replay

Prerequisites: 2.6

When producers outpace consumers, lag grows — that is backpressure visible in metrics.

Offsets

KafkaOffsetRewind — burst +5 messages, consume one-by-one, or replay from offset 0.

ActionDevProd
Reset consumer groupReprocess test dataDangerous — duplicate side effects
Scale consumersAdd llm-worker replicasSame

Idempotency

Replay requires idempotent writes (e.g. upsert by event id) or you duplicate Postgres rows.

Teach-back prompt

How would you alert when lag exceeds 1000 messages?

Replay from offset 0

Lesson 2.7 check

1. Consumer lag means…