How to run Revolution R Enterprise in mixed-mode Hadoop environments

Revolution R Enterprise may be run in a mixed-mode Hadoop environments. That is, the ability to run Revolution R jobs using Yarn when the default cluster job mode is "classic" MR1. To configure Revolution R to run in this manner:

a. Temporarily set the cluster default mode to Yarn.

b. Rebuild the RevoHadoopEnvVars.site file to include environment for Yarn:
# cd /usr/lib64/Revo-7.4/scripts# ./getHadoopEnvVars.py
c. Edit /usr/lib64/Revo-7.4/scripts/RevoHadoopEnvVars.site and change
HADOOP_CMD=hadoop
to
HADOOP_CMD=hadoop2
d. Change the default cluster mode to classic.

Note that specifying the job queue in the Hadoop compute context in the script should use the Yarn format (mapreduce.jobs.queuename) but using the deprecated MR1 format (mapred.jobs.queue.name) may be tolerated.
Note This is a "FAST PUBLISH" article created directly from within the Microsoft support organization. The information contained herein is provided as-is in response to emerging issues. As a result of the speed in making it available, the materials may include typographical errors and may be revised at any time without notice. See Terms of Use for other considerations.
Vlastnosti

ID článku: 3104125 - Poslední kontrola: 10/31/2015 15:44:00 - Revize: 1.0

Revolution Analytics

  • KB3104125
Váš názor