SoftwareMill

Kafka Visualization

Kafka
Apache Kafka is a distributed event streaming platform. Using the tool below you can simulate how data flows through a replicated Kafka topic, to gain a better understanding of the message processing model.
Choose the number of partitions - between which data will be evenly distributed. Experiment with various counts of nodes, turning them on and off, and seeing how the system adapts. Make sure to store data in replicas, so that they are not lost! Simulate load by increasing the consume interval. Finally, verify how offsets are commited, and see how this impacts redelivery when consumers or nodes are added/removed.
12345
12345
12345
ticks
Consumer 1
ticks
messages
A
Note that our simulation assumes default producer & broker configuration (for Kafka version <2.8.0) which accepts new messages, even if a majority of nodes is down. See this blog for more details.
SoftwareMill
Created by SoftwareMill
SoftwareMill offers architecture, development and consulting services for projects leveraging (or considering) Apache Kafka as well as tailored training programs.
P
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
1
A
1
2
1
1
2
A
1
1
1