Configuring the monitoring of model input and output
Monitor input, that is, predictors, and output of your models and predictions to observe whether they behave as you expect.
Models use predictors, such as age, income, location, or current product subscriptions, to predict customer responses or case outcomes. The output is the data that model generate, including propensities, numeric output for continuous models, and symbolic output (labels) for binary and categorical models.
Monitoring predictors and output can provide useful insights about the performance of your predictions and models. It helps in the early stages of model development, before you capture any responses. It also helps for certain model types that do not receive responses regularly or at all, such as predictive models.
- In the navigation pane of Prediction Studio, click .
- In the Monitor model input and output section, ensure that the Monitor model input and output data checkbox is selected.
- In the Monitor percentage field, define the amount of
data that you want to monitor.
- In the Monitoring coverage list, select which data you
want to monitor:
- Monitor output (propensities, numeric values, labels) and input (predictors) by selecting Monitor output and input.
- Monitor output only (propensities, numeric values, labels) by selecting Monitor output only.
You can find the metrics on the Analysis tab in predictions. For more information, see Monitoring predictions. - Optional: To record and save the monitoring data in the analytics repository, select Record monitoring data.
- Click Save.
- Estimating the model monitoring payload
Starting in Pega Platform version 8.7, the monitoring of model predictors (input) and output is enabled by default. The system requirements to support this feature are 250 GB of Stream service disk space and 15 GB of analytics repository disk space.
Previous topic Enabling Machine Learning Operations Next topic Estimating the model monitoring payload