Types of data flows

Data flows are scalable data pipelines that you can build to sequence and combine data based on various data sources. Each data flow consists of components that transform data and enrich data processing with business rules.

You can create data flows that:

  • Run in batch - Data flow source is set to Database Table.

  • Detect events and decision in real-time - Data flow source is set to Stream and the data flow references an event strategy.

  • Run on request - Data flow source and destination are set to abstract.

Note: Data flow runs that are initiated through the Data Flows landing page run in the access group context. These data flows always use the checked-in instance of the Data Flow rule and the referenced rules. You can use a checked-out instance of the Data Flow if you initiate a local data flow run (by using the Run action in the Data Flow rule form) or a test run (a run initiated through the API).