Skip to main content


         This documentation site is for previous versions. Visit our new documentation site for current releases.      
 

Configuring the Data Flow service

Updated on May 17, 2024

This content applies only to On-premises and Client-managed cloud environments

In the Data Flow service, you can run data flows in batch mode or real time (stream) mode. Specify the number of Pega Platform threads that you want to use for running data flows in each mode.

Before you begin: Assign the RealTime and Batch node types to Pega Platform nodes. To scale the Data Flow service horizontally, assign the corresponding node type to a higher number of nodes.

For more information, see Assigning node types to nodes for on-premises environments.

  1. In the header of Dev Studio, click ConfigureDecisioningInfrastructureServicesData flow.
  2. In the Service list, select the node types for which you want to configure the number of threads.
    Batch nodes process batch data flow runs. Real-time nodes process streaming data flows.
  3. In the Data flow nodes section, click Edit settings.
  4. In the Thread count field, enter the number of threads that you want to use for running data flows in the selected mode.
    To scale the Data Flow service vertically, increase the current number of threads.
    For example: If you divide the source of a data flow into five partitions, Pega Platform divides the data flow run into five assignments, and then processes the assignments simultaneously on separate threads, if five threads are available.

    Pega Platform calculates the number of available threads by multiplying the thread count by the number of nodes. For example, with two nodes and the thread count set to 5, the data flow run uses five threads and five threads remain idle.

  5. Click Submit.
  • Previous topic Configuring the Adaptive Decision Manager service for Pega Cloud environments
  • Next topic Configuring the Real Time Data Grid service

Related articles

Managing decision management nodesEnabling decision management servicesStatus of decision management nodes

Tags

Pega Platform 8.6 Decision Management

Have a question? Get answers now.

Visit the Support Center to ask questions, engage in discussions, share ideas, and help others.

Visit the Support Center

Did you find this content helpful?

Yes
No

Want to help us improve this content?
Suggest an edit

We'd prefer it if you saw us at our best.

Pega.com is not optimized for Internet Explorer. For the optimal experience, please use:

Close Deprecation Notice
Contact us