Wednesday, June 10, 2015

Hortonworks HDP installation using Local Yum Repo

Hadoop.HDP.LocalYumRepository
·         Setting up a local HDP Yum Repository
1.      Install required packages yum-utils, createrepo
yum install yum-utils
yum install createrepo
·         Create an HTTP server
yum install httpd
service httpd start
service iptables stop
chkconfig httpd on
chkconfig iptables off
3.      Create the folder to store repository tarballs
mkdir -p /var/www/html
4.      Copy the Ambari + HDP repository tarballs to the web server directory and untar
mkdir -p /var/www/html/hdp
cd /var/www/html/hdp
tar -xvf ambari-2.2.2.0-centos6.tar.gz
tar -xvf HDP-2.4.0.0-centos6-rpm.tar.gz
tar -xvf HDP-UTILS-1.1.0.20-centos6.tar.gz
5.      Copy the HDB (HAWQ) repository tarballs to the web server directory and untar
mkdir -p /var/www/html/hdb
cd /var/www/html/hdb
tar -xvf hdb-2.0.0.0-22126.tgz
tar -xvf hdb-ambari-plugin-2.0.0-448.tgz
6.      Copy the JDK and PostgreSQL RPM package to the web server directory
mkdir -p /var/www/html/Others
cd /var/www/html/Others

cp below files

jdk-8u77-linux-x64.rpm
postgresql95-9.5.3-2PGDG.rhel6.x86_64.rpm
postgresql95-contrib-9.5.3-2PGDG.rhel6.x86_64.rpm
postgresql95-libs-9.5.3-2PGDG.rhel6.x86_64.rpm
postgresql95-server-9.5.3-2PGDG.rhel6.x86_64.rpm

createrepo -v /var/www/html/Others
7.      Can burn a ISO file to store these repository files and mount it to the repository server