MapR 4.0.1: Revolution R job fails with segfault

On a MapR 4.0.1 cluster, Revolution R mapreduce jobs may fail with the error:
2015-02-13 08:00:37,657 FATAL [IPC Server handler 2 on 52243] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1423734868663_0289_m_000000_0 - exited : R VM exited with exit code: 1, output: 
starting script 
[1] TRUE 
[1] NA 
[1] 0 
[1] 0 
Segmentation fault.

at com.revolutionanalytics.scaleR.hadoop.Rscript.waitFor( 
at org.apache.hadoop.mapred.MapTask.runNewMapper( 
at org.apache.hadoop.mapred.YarnChild$ 
at Method) 
at org.apache.hadoop.mapred.YarnChild.main(
On MapR 4.0.1 platforms, this is due to the Revolution R Enterprise environment configuration using the wrong library.

To work around the problem, confirm the following post-installation configuration steps have been taken for Revolution R 7.3 on MapR 4.0.1 clusters:

On the "client" node, create the native filesystem shared directory for each user:

1. sudo mkdir -p /var/RevoShare/mapr 
3. chmod 777 /var/RevoShare/mapr 
4. add . /usr/lib64/Revo-7.3/scripts/ to /home/mapr/.bash_profile

On EVERY worker node, make the following changes:

# cp scaleR-hadoop-0.1-SNAPSHOT.jar /opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/common/lib/ # ln -s /opt/mapr/hadoop/hadoop-0.20.2/c++/Linux-amd64-64/lib/ /usr/lib64 # mv /opt/mapr/hadoop/hadoop-2.4.1/lib/native/ /opt/mapr/hadoop/hadoop-2.4.1/lib/native/

The installation of Revolution R automatically creates a link to scaleR-hadoop-0.1-SNAPSHOT.jar in $HADOOP_HOME/lib. However, this is the incorrect directory (a bug has been reported) and the file should be linked or copied in /opt/mapr/hadoop/hadoop-2.4.1/share/hadoop/common/lib/.

Linking /opt/mapr/hadoop/hadoop-0.20.2/c++/Linux-amd64-64/lib/ in /usr/lib64 will ensure that the proper is found by Revolution R. The third step is necessary to move the problem out of the way.
Note This is a "FAST PUBLISH" article created directly from within the Microsoft support organization. The information contained herein is provided as-is in response to emerging issues. As a result of the speed in making it available, the materials may include typographical errors and may be revised at any time without notice. See Terms of Use for other considerations.

Article ID: 3104128 - Last Review: 10/31/2015 16:04:00 - Revision: 1.0

Revolution Analytics

  • KB3104128