When you configure Kafka, you must consider several key properties.
Kafka heap size:
- KAFKA_HEAP_OPTS - The Kafka-broker JVM is set to 1 Gb by default.
- KAFKA_JVM_PERFORMANCE_OPTS - JVM tuning.
General settings in the server.properties file:
- num.io.threads - Ensure that the value of this setting is greater than or equal to the number of disks that are dedicated for Kafka.
- num.network.threads - Ensure that the value of this setting is adjusted based on the number of producers, consumers, and the replication factor.
To view the main outline for this article, see Kafka as a streaming service.