install hadoop on xubuntu

0. install xubuntu

we recommend to set username as "hadoop"

after installation, set user "hadoop" as administrator

sudo addgroup hadoop

sudo adduser --ingroup hadoop hadoop

打开/etc/sudoers文件

sudo gedit /etc/sudoers

在root  ALL=(ALL:ALL)  ALL下添加hadoop  ALL=(ALL:ALL)  ALL

1. install java

.解压java压缩包到usr/java(新建的文件夹)中。解压后就可使用

.配置环境变量。如下

在etc/profile 文件中。在最后添加如下内容

#set java environment

export JAVA_HOME=/usr/java/jdk1..0_67

export JRE_HOME=/usr/java/jdk1..0_67/jre

export PATH=$PATH:/usr/java/jdk1..0_67/bin

export CLASSPATH=./:/usr/java/jdk1..0_67/lib:/usr/java/jdk1..0_67/jre/lib

.配置立即生效命令

  source /etc/profile

.检测是否配置成功

  java -version

如果不行，重启linux  

2. configure login in ssh without entering password

please operate under user "hadoop"

su - hadoop

sudo apt-get install openssh-server 
sudo /etc/init.d/ssh start  

cd ~/.ssh
ssh-keygen -t rsa -P ""  
cat ~/.ssh/id_rsa.pub>> ~/.ssh/authorized_keys  

3. install hadoop

. unzip hadoop.tar.gz into /usr/hadoop
　　then, ensure user "hadoop" owns /usr/hadoop
　　
sudo chown -R hadoop:hadoop hadoop  

. edit environment

    2.1 gedit /etc/profile    append these:

export JAVA_HOME=/usr/java/

export JRE_HOME=/usr/java/jre

export HADOOP_INSTALL=/usr/hadoop

export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin

export CLASSPATH=./:/usr/java/lib:/usr/java/jre/lib

    2.2 gedit /usr/hadoop/conf/hadoop-env.sh    append these:

# The java implementation to use.  Required.

export JAVA_HOME=/usr/java

export HADOOP_INSTALL=/usr/hadoop

export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin

. restart linux

4. test

hadoop@ms:~$

hadoop@ms:~$ java -version

java version "1.7.0_79"

Java(TM) SE Runtime Environment (build 1.7.0_79-b15)

Java HotSpot(TM) -Bit Server VM (build 24.79-b02, mixed mode)

hadoop@ms:~$ hadoop version

Hadoop 1.2.

Subversion https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r 1503152

Compiled by mattf on Mon Jul  :: PDT

From source with checksum 6923c86528809c4e7e6f493b6b413a9a

This command was run using /usr/hadoop/hadoop-core-1.2..jar

hadoop@ms:~$ 

5. hadoop 伪分布式

编辑三个文件：

). core-site.xml:

<configuration>

    <property>

        <name>fs.default.name</name>

        <value>hdfs://localhost:9000</value>

    </property>

    <property>

        <name>hadoop.tmp.dir</name>

        <value>/usr/local/hadoop/tmp</value>

    </property>

</configuration>

).hdfs-site.xml:

<configuration>

    <property>

        <name>dfs.replication</name>

        <value></value>

    </property>

    <property>

        <name>dfs.name.dir</name>

        <value>/usr/local/hadoop/datalog1,/usr/local/hadoop/datalog2</value>

    </property>

    <property>

        <name>dfs.data.dir</name>

        <value>/usr/local/hadoop/data1,/usr/local/hadoop/data2</value>

    </property>

</configuration>

). mapred-site.xml:

<configuration>

    <property>

        <name>mapred.job.tracker</name>

        <value>localhost:</value>

    </property>

</configuration>

. 启动Hadoop到相关服务，格式化namenode, secondarynamenode, tasktracker:

hadoop@derekUbun:/usr/local/hadoop$ source /usr/local/hadoop/conf/hadoop-env.sh

hadoop@derekUbun:/usr/local/hadoop$ hadoop namenode -format  

6*. install hbase[伪分布式]

. unzip hbase.tar.gz into /usr/hbase

　　then, ensure user "hadoop" owns /usr/hbase

　　

sudo chown -R hadoop:hadoop hbase

. edit environment

    2.1 gedit /etc/profile    append these:

export HBASE_HOME="/usr/hbase"

export PATH=$HBASE_HOME/bin:$PATH

    2.2 gedit /usr/hbase/conf/hbase-site.xml    append these:

<property>

     <name>hbase.rootdir</name>

     <!-- 对应hadoop中hdfs的配置项 -->

     <value>hdfs://localhost:9000/hbase</value>

 </property>

 <property>

     <name>hbase.cluster.distributed</name>

     <value>true</value>

</property>

<property>

     <name>hbase.master.info.port</name>

     <value></value>

</property>

    2.3 gedit /usr/hbase/hbase-env.sh    modify these:

# The java implementation to use.  Java 1.6 required.

export JAVA_HOME=/usr/java/

# Extra Java CLASSPATH elements.  Optional.

export HBASE_CLASSPATH=/usr/hadoop/conf

# Tell HBase whether it should manage it's own instance of Zookeeper or not.

export HBASE_MANAGES_ZK=true

. restart linux
    

#. references

http://blog.csdn.net/zhaoyl03/article/details/8657104#

http://www.tuicool.com/articles/VZn6zi

http://blog.csdn.net/zhaoyl03/article/details/8657104#

http://blog.csdn.net/pdw2009/article/details/21261417

http://www.th7.cn/db/nosql/201510/134214.shtml