Defining the training and testing samples

In the Sample construction step, split the data into the set that is used to train the model and the set that is used to test the model's accuracy.

1. Perform one of the following actions:

   • Select the User-defined sampling based on 'Type' column check box to assign only the records whose Type field in the file that you uploaded is set to Test to the testing sample. Use this option if you have specific sentences to be tested with every model generation for accuracy.

   • Select the Uniform sampling check box to manually specify the percentage of records that are randomly assigned to the training sample.

2. Correct any issues with the training and testing sample that are displayed in the Warnings section.

   The example issues that can be found include the following items:

   • Improperly formatted columns or missing values

   • The categories from the taxonomy that do not have a match in the training and testing sample

   • The categories from the training and testing sample that do not have a match in the taxonomy

     Note: It is recommended that you correct any missing values, file formatting, inconsistencies between the taxonomy and the training and testing sample, and any other issues to increase the quality of the model.

3. If any messages are displayed in the Warnings section about issues such as improperly formatted columns, missing values, the categories from the training and testing sample that do not have a match in the taxonomy, or the categories from the taxonomy that do not have a match in the training and testing sample, it is recommended to correct
4. Click Next.

Open topic with navigation