Millipede Academy

Book 5 · Lesson 5.6

Kafka consumer in Python

  • Read consumer.poll loop in main.py
  • Configure input/output topics via env
  • Handle invalid JSON gracefully

Prerequisites: 5.5

pythonconsumer.poll(1.0)
pythonmsg.value() → JSON decode
pythonenrich_raw_event(raw)
pythonproducer.produce(enriched-dev-events)
pythonLOG enriched event_id sentiment risk
EnvDefault
KAFKA_INPUT_TOPICraw-dev-events
KAFKA_OUTPUT_TOPICenriched-dev-events
LLM_WORKER_GROUPmillipede-llm-worker

Teach-back prompt

What happens on JSONDecodeError?

Python Kafka poll

Lesson 5.6 check

1. Default input topic…