Kafka consumer groups
Consumer groups are the services that read your change data from Kafka.
AvailabilityAvailable to everyone with early access to Varqeni.
How it works
- Setup: Prometheus with the Kafka exporter, which most Kafka on Kubernetes setups already run.
- What it reads: for each group reading your pipeline's topic, its lag, how the lag changed over ten minutes, and how many members are running.
- What it cannot do: restart a reader or reset its offsets. A reader problem is a risk for a person, never a cause Varqeni fixes.
What you should see: The Kafka part of the diagram shows how many readers keep up.
What it can and cannot do
Can
- Read lag, its ten-minute change and running members for each group reading your pipeline's topic.
Cannot
- Restart a reader or reset its offsets.
Related articles
- A downstream reader stopped or is falling behindVarqeni tells you when something that reads your change data from Kafka stops or keeps falling behind. It does not restart readers.
- PrometheusVarqeni exports its own metrics for your dashboards, and reads Prometheus for consumer groups and the estate.
Still stuck? Contact support or email info@fortisdatagroup.com.