Creating a Kinesis data set
You can create an instance of a Kinesis data set in Pega Platform to connect to an instance of Amazon Kinesis Data Streams. Amazon Kinesis Data Streams ingests a large amount of data in real time, durably stores it, and makes it available for lightweight processing. For Pega Cloud applications, you can use a Pega-provided Kinesis data stream or connect to your own Kinesis data stream.
- Create an instance of the Kinesis data set rule.For more information, see Data Set rules - Completing the Create, Save As, or Specialization form.
- In the Connection section, select a Kinesis configuration
instance and a region. For more information about the available regions, see the Amazon Web Services (AWS)
documentation.
- In the Stream section, select a stream that is available in your
Kinesis configuration instance.
- Optional: In the Partition key(s) section, define the data set
partitioning.By configuring partitioning, you ensure that related records are sent to the same partition. If you do not define partition keys, the Kinesis data set randomly assigns records to partitions, which can hinder its performance.
- Click Add key.
- In the Key field, press the Down Arrow key to select the
property that you want the Kinesis data set to use as a partitioning key.
- Click Save.
Previous topic Creating a Kafka configuration instance Next topic Data transfer