Triggering the customer data ingestion process
This content applies only to Pega Cloud environments
For each data flow in your data ingestion process, configure an activity that invokes the pxRunDDFWithProgressPage activity and passes the correct parameters to run the data flow.
For information, see Processing data with data flows and Creating an activity.
- In the header of Dev Studio, click .
- Provide a label, class, and ruleset for the activity.
- Click Create and open.
- On the Pages & Classes tab, add pages with these
settings:
Page name Class RunOptionsPage Data-Decision-DDF-RunOptions Progress Data-Decision-DDF-Progress The Progress page contains details from the data flow run that can be used for reporting and validation.
- On the Steps tab, configure the activity steps as in the
following example.
Step 2
Method: Property-Set Method parameters: PropertiesName PropertiesValue RunOptionsPage.pyAppliesTo The class to which your data flow applies RunOptionsPage.pyRuleName The name of your data flow Step 3
Method: Call pxRunDDFWithProgressPage Step page:RunOptionsPage Step 4
Method: Property-Set Step page:Progress Method parameters: PropertiesName PropertiesValue local.dfstatus @(PegaMKT-Engine:PegaMKTUtilities).monitorDFProgress(tools,param.sleepTime) Param.DataFlowID Progress.pyWorkItemID Progress.pyStatus Progress.pyProcessedRecords Progress.pyDuration - monitorDFProgress
- This function forces the activity to wait till the data flow run is over.
- Progress.pyWorkItemID
- The data flow run instance ID. You can view this ID on the Batch processing data flow landing page.
- Progress.pyStatus
- The status of the data flow run. If the status is Failed, you m want to jump to Error Stage.
- Progress.pyProcessedRecords
- The number of records processed by a data flow run. This number needs to match the number of records in the manifest file (totalRecordCount) to confirm whether the data flow was able to read all the records from the file or not. Depending on your requirements, if these numbers do not match, you may or may not want to jump to Error Stage.
- Progress.pyDuration
- The duration of the data flow run.
- Configure additional steps for copying the data from the data flow run into a work page and for the required error handling.
- Click Save.
Previous topic Configuring data flows to ingest customer data Next topic Creating an ingestion case