User Tools

Site Tools


dwsc:hdfs:install

This is an old revision of the document!


HDFS install

Cloudera repo csomag letöltés: https://ccp.cloudera.com/display/CDH4DOC/CDH4+Installation#CDH4Installation-DebianPackage

dpkg -i cdh4-repository_1.0_all.deb ; apt-get update
apt-get install openjdk-7-jre-headless:amd64

Zookeeper install

apt-get install zookeeper-server zookeeper-bin

Jounal install

Namenode install

apt-get install hadoop-hdfs-namenode

Namenode configuration

/etc/hadoop/conf/core-site.xml

<property>
  <name>fs.defaultFS</name>
  <value>hdfs://vodstorage01</value>
</property>

Datanode install

apt-get install hadoop-hdfs-datanode

HDFS kliens install

apt-get install hadoop-client

HDFS FUSE install

apt-get install hadoop-hdfs-fuse

with all dependency:
apt-get install hadoop-hdfs-fuse hadoop-client hadoop-mapreduce hadoop-0.20-mapreduce libssl0.9.8

libssl0.9.8 is available in squeeze, need to build one for wheezy

FUSE mount:

hadoop-fuse-dfs dfs://<namenode> <mount point>
hadoop-fuse-dfs dfs://172.28.28.11:8020 /srv/users/default/content
dwsc/hdfs/install.1364857012.txt.gz · Last modified: 2013/04/02 00:56 by ivan