Problems with SSH when running Hadoop tutorial

Asked

Viewed 73 times

2

I need to process some very large files and for that I am trying to use Hadoop (in version 2.4.1).

I am unable to run the official tutorial on Ubuntu 14.04 (64 bits) and Java (Oracle version 1.7.0_60-B19). When starting the DFS, even having configured the SSH as specified, the return is as follows:

ssh: Could not resolve hostname ???: Name or service not known

How to solve this problem?

ssh

1 answer

2


I found the answer in another post (in the OS): the problem seems to be related to the fact that the standard Hadoop libraries are for 32-bit architectures.

Some answers point to the possibility of recompiling things, but something much simpler solved for me: create environment variables that correctly configure Hadoop and these native libraries.

  • Add two new variables to your file etc/Hadoop/Hadoop-env.sh

    export HADOOP_COMMON_LIB_NATIVE_DIR=${HADOOP_PREFIX}/lib/native
export HADOOP_OPTS="-Djava.library.path=$HADOOP_PREFIX/lib"

Browser other questions tagged ssh

You are not signed in. Login or sign up in order to post.