Skip to main content


         This documentation site is for previous versions. Visit our new documentation site for current releases.      
 

Deprecated: Configuring YARN settings

Updated on May 17, 2024

Configure the YARN Resource Manager settings to enable running external data flows (EDFs) on a Hadoop record. When an external data flow is started from Pega Platform, it triggers a YARN application directly on the Hadoop record for data processing.

  1. Access a Hadoop record from the navigation pane by clicking RecordsSysAdminHadoop.
  2. On the Connection tab, select the Use YARN configuration check box in the YARN section.
  3. In the User name field, provide the user name to be authenticated in the YARN Resource Manager.
  4. In the Port field, specify the YARN Resource Manager connection port. The default port is 8032.
  5. In the Work folder field, enter the location of the temporary work folder in the Hadoop environment where the execution data is stored.
  6. Optional: Configure the Response timeout field.
    1. Select the Advanced configuration check box.
    2. In the Response timeout field, set the time (in milliseconds) to wait for a server response.
      The default value is 3000.
  7. Optional: Enable secure connections.
    Note: To authenticate with Kerberos, you must configure your environment. For more details, see the Kerberos documentation about the Network Authentication Protocol.
    1. In the Authentication section for YARN configuration, select the Use authentication check box.
    2. In the Master kerberos principal field, enter the Kerberos principal name of the YARN Resource Manager, typically following the parttern rm/<hostname>@<REALM>.
    3. In the Client kerberos principal field, enter the Kerberos principal name of a user as defined in Kerberos, typically in the following format: <username>/<hostname>@<REALM>.
    4. In the Keystore field, enter the name of a keystore that contains a keytab file with the keys for the user who is defined in the Client Kerberos principal setting.
      Note: The keytab file is in a readable location in the Pega Platform server, for example, /etc/hdfs/conf/thisUser.keytab
  8. Optional: Click Test connectivity to verify your settings.
  9. Optional: View the status of the applications that are managed by the YARN Resource Manager.
    1. Click View applications. The YARN Applications modal dialog is displayed.
    2. Optional: Use the Application state drop-down menu to filter applications according to their progress status:
      All
      Displays all finished and running applications.
      Finished
      Displays applications with the FINISHED, KILLED, or FAILED status.
      Running
      Displays applications with SUBMITTED, ACCEPTED, NEW, NEW_SAVING, or RUNNING status.
  10. Click Save.
  • Previous topic Deprecated: Data flow tab on the External Data Flow form
  • Next topic Deprecated: Configuring run-time settings

Tags

Pega Platform 8.5 Decision Management

Have a question? Get answers now.

Visit the Support Center to ask questions, engage in discussions, share ideas, and help others.

Visit the Support Center

Did you find this content helpful?

Yes
No

Want to help us improve this content?
Suggest an edit

We'd prefer it if you saw us at our best.

Pega.com is not optimized for Internet Explorer. For the optimal experience, please use:

Close Deprecation Notice
Contact us