Kafka data set enhancements
Valid from Pega Version 8.6
The Kafka data set is a high-throughput and low-latency platform for handling real-time data feeds that you can use as input for Pega Platform event strategies.
For better integration of Pega Platform with externally hosted Kafka, the following enhancements are implemented:
- Support for Kafka message keys and headers - extended values data format (JSON Data Transform, Apache Avro)
- Custom value processing
- Configuring topic names by using Application Properties
- Data-Admin-Kafka enhancements - supporting a wide range of connection properties
For more information, see Improve your Kafka data set with new enhancements.
External data flow rules are removed
Valid from Pega Version 8.6
In previous versions of Pega Platform™, you could configure data flows to run in an external Hadoop environment. The external data flows functionality was deprecated and hidden from view in Pega Platform 8.5. The functionality has been now removed and is no longer available in Pega Platform 8.6.
For more information, see External data flow rules are deprecated.