Troubleshooting Kafka
Review the following troubleshooting scenarios to find solutions to problems with Kafka.
Stream service nodes are NORMAL, but data flow hangs
Even though all nodes are in the NORMAL state, the data flow hangs.
Reason
Some ports of any Kafka brokers within the cluster are unreachable.
Solution
Perform the following actions:
- Check whether the Kafka broker port is exposed for the rest of the nodes.
The default port is 9092.
- If the port is not exposed, change the pyBrokerPort setting in the prconfig.xml file.
Stream service nodes fail to run on WebSphere 8.5
Reason
By default, Java 6 is used, while Kafka supports Java 7 and later versions (in the case of IBM JVM 7.1).
Solution
Check which WebSphere version is used.
This node cannot be replaced in the current production level as data will be lost
Reason
The message appears during the replacement of the stream node if the Kafka data or metadata already exists.
Solution
Perform one of the following actions:
- If some Kafka data is present on the stream cluster and you want to keep that data, disregard the message because this is expected behavior.
- If no Kafka data exists on the stream cluster or if you want to remove the existing data, clean the Kafka metadata by running the following SQL command, and then retry replacing the node:
DELETE FROM pr_data_stream_nodes; DELETE FROM pr_data_stream_sessions;
To view the main outline for this article, see Kafka as a streaming service.
Previous topic Monitoring Kafka Next topic Kafka data sets in decision management