一、ambari架构解析

二、基础环境配置

以两台节点为例来组件Hadoop分布式集群，这里采用的系统版本为Centos7 1511，如下表所示：

主机名

 

内存

 

硬盘

 

IP地址

 

角色

 

master

 

8192MB

 

100G

 

192.168.200.6

 

Ambari-Server

Ambari-Agent

 

slaver

 

8192MB

 

100G

 

192.168.200.7

 

Ambari-Agent

 

搭建所需各软件版本信息

①ambari-2.7.1.0-centos7.tar.gz

②jdk-8u151-linux-x64.tar.gz

③HDP-3.0.1.0-centos7-rpm.tar.gz

④HDP-UTILS-1.1.0.22-centos7.tar

⑤CentOS-7-x86_64-DVD-1511.iso

1.在iaas平台创建两台云主机

主机名、主机名解析配置

vi /etc/hosts

挂载镜像并配置本地yum源

首先将所需镜像、安装包等，通过secureFX上传至master 的/opt目录

Master节点

3.1进入/opt目录，解压ambari.tar.gz压缩包

[[email protected] ~]# cd /opt

[[email protected] opt]# ls

ambari-2.7.1.0-centos7.tar.gz  HDP-3.0.1.0-centos7-rpm.tar.gz

centos                         HDP-UTILS-1.1.0.22-centos7.tar

[[email protected] opt]# tar -zxvf ambari-2.7.1.0-centos7.tar.gz

解压完成后获得一个ambari的文件夹

[[email protected] ~]# ls

CentOS-7-x86_64-DVD-1511.iso   

[[email protected] ~]# mount -o loop CentOS-7-x86_64-DVD-1511.iso /mnt/

[[email protected] ~]# mkdir /opt/centos

[[email protected] ~]# cp -rvf /mnt/* /opt/centos/

[[email protected] ~]# cd /etc/yum.repos.d/

[[email protected] yum.repos.d]# ls

CentOS-Base.repo  CentOS-Debuginfo.repo  CentOS-Sources.repo

CentOS-CR.repo    CentOS-fasttrack.repo  CentOS-Vault.repo

[[email protected] yum.repos.d]# rm -rf *

[[email protected] yum.repos.d]# vi local.repo

[centos]

name=centos

baseurl=file:///opt/centos

gpgcheck=0

enable=1

[ambari]

name=ambari

baseurl=file:///opt/ambari/centos7/2.7.1.0-169/

gpgcheck=0

enable=1

保存退出

清理源，并列出源

[[email protected] ~]# yum clean all

Loaded plugins: fastestmirror

Cleaning repos: ambari centos

Cleaning up everything

Cleaning up list of fastest mirrors

[[email protected] ~]# yum list

[[email protected] ~]# yum install vsftpd

[[email protected] ~]# vi /etc/vsftpd/vsftpd.conf

添加

anon_root=http://www.mamicode.com/opt/

3.2配置开机启动vsftpd

[[email protected] ~]# systemctl enable vsftpd

[[email protected] ~]# systemctl start vsftpd

Slaver节点

[[email protected] ~]# cd /etc/yum.repos.d/

[[email protected] yum.repos.d]# ls

CentOS-Base.repo  CentOS-Debuginfo.repo  CentOS-Sources.repo

CentOS-CR.repo    CentOS-fasttrack.repo  CentOS-Vault.repo

[[email protected] yum.repos.d]# rm -rf *

[[email protected] yum.repos.d]# vi ftp.repo

[centos]

name=centos

baseurl=ftp://192.168.200.6/centos

gpgcheck=0

enable=1

[ambari]

name=ambari

baseurl=ftp://192.168.200.6/ambari/centos7/2.7.1.0-169/

gpgcheck=0

enable=1

保存退出

配置NTP服务

Master节点

[[email protected] ~]# yum -y install ntp

[[email protected] ~]# vi /etc/ntp.conf

4.1将原有server注释

添加

server 127.127.1.0

fudge 127.127.1.0 stratum 10

[[email protected] ~]# systemctl enable ntpd

[[email protected] ~]# systemctl start  ntpd

Slaver节点

[[email protected] ~]# yum -y install ntpdate

[[email protected] ~]# ntpdate master

[[email protected] ~]# systemctl enable ntpdate

配置SSH 免密访问

Master节点

[[email protected] ~]# yum install openssh-clients

[[email protected] ~]# ssh-keygen

[[email protected] ~]# ssh-copy-id slaver.hadoop

Slaver节点

[[email protected] ~]# yum install openssh-clients

[[email protected] ~]# ssh-keygen

[[email protected] ~]# ssh-copy-id master.hadoop

禁用Transparent Huge Pages