今日按照官方文档,装了一下cdh5 hadoop ,分享一下经验及用到的命令
cm 官方中文版地址 http://www.cloudera.com/content/www/zh-CN/documentation/enterprise/5-3-x/topics/search_solrctl_ref.html cdh 安装包 http://archive-primary.cloudera.com/cdh5/parcels/5.9.0.23/v cm 安装步骤 http://www.cloudera.com/documentation/enterprise/latest/topics/cm_ig_install_path_c.html#concept_fbv_2v3_3r__section_gkr_z31_v5 http://blog.csdn.net/u010824591/article/details/51174099
cm tar 下载 http://archive-primary.cloudera.com/cm5/cm/5/ pdsh mysql 配置中文 http://www.cloudera.com/content/www/zh-CN/documentation/enterprise/5-3-x/topics/cm_ig_mysql.html
赋予用户权限及建数据库 grant all PRIVILEGES on . to ‘root’@’localhost’ IDENTIFIED BY ‘admin’ with grant option ; grant all PRIVILEGES on . to ‘root’@’%’ IDENTIFIED BY ‘admin’ with grant option ; create database amon DEFAULT CHARSET utf8 COLLATE utf8_general_ci; create database rman DEFAULT CHARSET utf8 COLLATE utf8_general_ci; create database metastore DEFAULT CHARSET utf8 COLLATE utf8_general_ci; create database sentry DEFAULT CHARSET utf8 COLLATE utf8_general_ci; create database nav DEFAULT CHARSET utf8 COLLATE utf8_general_ci; create database hue DEFAULT CHARSET utf8 COLLATE utf8_general_ci; create database oozie DEFAULT CHARSET utf8 COLLATE utf8_general_ci; grant all PRIVILEGES on . to ‘scm’@’localhost’ IDENTIFIED BY ‘scm_abc’ with grant option ; grant all PRIVILEGES on . to ‘scm’@’%’ IDENTIFIED BY ‘scm_abc’ with grant option ; grant all PRIVILEGES on . to ‘amon’@’localhost’ IDENTIFIED BY ‘amon_abc’ with grant option ; grant all PRIVILEGES on . to ‘amon’@’%’ IDENTIFIED BY ‘amon_abc’ with grant option ; grant all PRIVILEGES on . to ‘rman’@’localhost’ IDENTIFIED BY ‘rman_abc’ with grant option ; grant all PRIVILEGES on . to ‘rman’@’%’ IDENTIFIED BY ‘rman_abc’ with grant option ; grant all PRIVILEGES on . to ‘hive’@’localhost’ IDENTIFIED BY ‘hive_abc’ with grant option ; grant all PRIVILEGES on . to ‘hive’@’%’ IDENTIFIED BY ‘hive_abc’ with grant option ; grant all PRIVILEGES on . to ‘sentry’@’localhost’ IDENTIFIED BY ‘sentry_abc’ with grant option ; grant all PRIVILEGES on . to ‘sentry’@’%’ IDENTIFIED BY ‘sentry_abc’ with grant option ; grant all PRIVILEGES on . to ‘nav’@’localhost’ IDENTIFIED BY ‘nav_abc’ with grant option ; grant all PRIVILEGES on . to ‘nav’@’%’ IDENTIFIED BY ‘nav_abc’ with grant option ; grant all PRIVILEGES on . to ‘hue’@’localhost’ IDENTIFIED BY ‘hue_abc’ with grant option ; grant all PRIVILEGES on . to ‘hue’@’%’ IDENTIFIED BY ‘hue_abc’ with grant option ; grant all PRIVILEGES on . to ‘oozie’@’localhost’ IDENTIFIED BY ‘oozie_abc’ with grant option ; grant all PRIVILEGES on . to ‘oozie’@’%’ IDENTIFIED BY ‘oozie_abc’ with grant option ;
mysql> flush privileges;
创建文件目录 ,更改权限 mkdir -p /var/log/cloudera-scm-agent mkdir -p /var/log/cloudera-scm-alertpublisher mkdir -p /var/log/cloudera-scm-eventserver mkdir -p /var/log/cloudera-scm-firehose mkdir -p /var/log/cloudera-scm-headlamp mkdir -p /var/log/cloudera-scm-server mkdir -p /var/lib/cloudera-scm-agent mkdir -p /var/lib/cloudera-scm-alertpublisher mkdir -p /var/lib/cloudera-scm-eventserver mkdir -p /var/lib/cloudera-scm-firehose mkdir -p /var/lib/cloudera-scm-headlamp mkdir -p /var/lib/cloudera-scm-server mkdir -p /var/lib/cloudera-host-monitor mkdir -p /var/lib/cloudera-service-monitor chown -R cloudera-scm:cloudera-scm /var/log/cloudera-scm-agent chown -R cloudera-scm:cloudera-scm /var/log/cloudera-scm-alertpublisher chown -R cloudera-scm:cloudera-scm /var/log/cloudera-scm-eventserver chown -R cloudera-scm:cloudera-scm /var/log/cloudera-scm-firehose chown -R cloudera-scm:cloudera-scm /var/log/cloudera-scm-headlamp chown -R cloudera-scm:cloudera-scm /var/log/cloudera-scm-server chown -R cloudera-scm:cloudera-scm /var/lib/cloudera-scm-agent chown -R cloudera-scm:cloudera-scm /var/lib/cloudera-scm-alertpublisher chown -R cloudera-scm:cloudera-scm /var/lib/cloudera-scm-eventserver chown -R cloudera-scm:cloudera-scm /var/lib/cloudera-scm-firehose chown -R cloudera-scm:cloudera-scm /var/lib/cloudera-scm-headlamp chown -R cloudera-scm:cloudera-scm /var/lib/cloudera-scm-server chown -R cloudera-scm:cloudera-scm /var/lib/cloudera-host-monitor chown -R cloudera-scm:cloudera-scm /var/lib/cloudera-service-monitor
设置自动启动 CM5服务器端: cp /opt/cloudera-manager/cm-5.0/etc/init.d/cloudera-scm-server /etc/init.d/cloudera-scm-server chkconfig cloudera-scm-server on CM5客户端: pdsh -R ssh -w root@hadoop00[7-9] pdsh> cp /opt/cloudera-manager/cm-5.0/etc/init.d/cloudera-scm-agent /etc/init.d/cloudera-scm-agent pdsh> chkconfig cloudera-scm-agent on
服务端: service cloudera-scm-server start 客户端: pdsh可以批量执行命令,使用pdsh-> pdsh -R ssh -w root@hadoop00[7-9] pdsh-> service cloudera-scm-agent start http://doc.okbase.net/1421929/archive/161829.html