阿里云centos7.8安装cdh6.3.1完整攻略_cdh centos7 关闭大页缓存-CSDN博客

本文链接：https://blog.csdn.net/u011555260/article/details/109636015

本文详细介绍了一种基于4台阿里云服务器部署Cloudera Distribution Including Hadoop (CDH)集群的过程，包括服务器配置、免密码SSH登录设置、软件安装、数据库配置、CDH组件安装等关键步骤。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

1.准备4台阿里云云服务器

修改/etc/hostname和/etc/hosts 重启4台机器

2.配置4台服务器ssh免密码登录

ssh-keygen -t rsa

修改authorized_keys的权限： chmod 600 ~/.ssh/authorized_keys

3.安装ntp：所有节点

yum install ntp -y

# 开机启动 chkconfig ntpd on

# 启动ntp service ntpd start

4.修改文件打开限制：所有节点

echo "* soft nofile 65536" >> /etc/security/limits.conf

echo "* hard nofile 65536" >> /etc/security/limits.conf

echo "* soft memlock unlimited" >> /etc/security/limits.conf

echo "* hard memlock unlimited" >> /etc/security/limits.conf

5.设置swap空间：所有节点

echo "vm.swappiness = 0" >> /etc/sysctl.conf

6.关闭大页面缓存：所有节点

echo never > /sys/kernel/mm/transparent_hugepage/enabled

echo never > /sys/kernel/mm/transparent_hugepage/defrag

7.关闭防火墙：所有节点

systemctl stop firewalld.service

systemctl disable firewalld.service

8.安装jdk,配置好/etc/profile：所有节点

9.安装数据库

yum -y install mariadb mariadb-server

启动MariaDB数据库服务，并设置未开机自启：

systemctl start mariadb
systemctl enable mariadb
systemctl status mariadb

配置mariadb，设置密码为password

/usr/bin/mysql_secure_installation

创建集群所需的数据库：

create database metastore default character set utf8;
CREATE USER 'hive'@'%' IDENTIFIED BY 'password';
GRANT ALL PRIVILEGES ON metastore.* TO 'hive'@'%';
FLUSH PRIVILEGES;
create database scm default character set utf8;
CREATE USER 'scm'@'%' IDENTIFIED BY 'password';
GRANT ALL PRIVILEGES ON scm.* TO 'scm'@'%';
FLUSH PRIVILEGES;
create database rm default character set utf8;
CREATE USER 'rm'@'%' IDENTIFIED BY 'password';
GRANT ALL PRIVILEGES ON rm.* TO 'rm'@'%';
FLUSH PRIVILEGES;

create database am default character set utf8;
CREATE USER 'am'@'%' IDENTIFIED BY 'password';
GRANT ALL PRIVILEGES ON am.* TO 'am'@'%';
FLUSH PRIVILEGES;
create database hue default character set utf8;
CREATE USER 'hue'@'%' IDENTIFIED BY 'password';
GRANT ALL PRIVILEGES ON hue.* TO 'hue'@'%';
FLUSH PRIVILEGES;
create database oozie default character set utf8;
CREATE USER 'oozie'@'%' IDENTIFIED BY 'password';
GRANT ALL PRIVILEGES ON oozie.* TO 'oozie'@'%';
FLUSH PRIVILEGES;
create database sentry default character set utf8;
CREATE USER 'sentry'@'%' IDENTIFIED BY 'password';
GRANT ALL PRIVILEGES ON sentry. * TO 'sentry'@'%';
FLUSH PRIVILEGES;
create database nav_ms default character set utf8;
CREATE USER 'nav_ms'@'%' IDENTIFIED BY 'password';
GRANT ALL PRIVILEGES ON nav_ms. * TO 'nav_ms'@'%';
FLUSH PRIVILEGES;
create database nav_as default character set utf8;
CREATE USER 'nav_as'@'%' IDENTIFIED BY 'password';
GRANT ALL PRIVILEGES ON nav_as. * TO 'nav_as'@'%';
FLUSH PRIVILEGES;