Hadoop、HBase配置Ganglia指南（metrics1）

Server端：

yum install rrdtool ganglia ganglia-gmetad ganglia-gmond ganglia-web httpd php

Client端：

yum install ganglia-gmond

创建RRD目录

mkdir -p /var/lib/ganglia/rrds
chown ganglia:ganglia /var/lib/ganglia/rrds

编辑/etc/ganglia/gmond.conf

cluster {

  name = "DFS"

  owner = "unspecified"

  latlong = "unspecified"

  url = "unspecified"

}

udp_send_channel {

  #bind_hostname = yes # Highly recommended, soon to be default.

                       # This option tells gmond to use a source address

                       # that resolves to the machine's hostname. Without

                       # this, the metrics may appear to come from any

                       # interface and the DNS names associated with

                       # those IPs will be used to create the RRDs.

  mcast_join = master.hadoop.test

  port = 8649

  ttl = 1

}

 

/* You can specify as many udp_recv_channels as you like as well. */

udp_recv_channel {

  port = 8649

  bind = master.hadoop.test

}

 

/* You can specify as many tcp_accept_channels as you like to share

   an xml description of the state of the cluster */

tcp_accept_channel {

  bind = master.hadoop.test

  port = 8649

}

编辑/etc/ganglia/gmetad.conf

data_source "DFS" master.hadoop.test:8649

 

安装ganglia-web

cd /var/www/html

wget http://softlayer-dal.dl.sourceforge.net/project/ganglia/ganglia-web/3.5.10/ganglia-web-3.5.10.tar.gz

tar zxvf ganglia-web-3.5.7.tar.gz

mv ganglia-web-3.5.7 ganglia

修改Apache配置

vim /etc/httpd/conf.d/ganglia.conf

<Location /ganglia>

    Order deny,allow

    Allow from all

</Location>

# 开机运行采集进程
chkconfig --levels 235 gmond on
# 开机运行数据存储进程
chkconfig --levels 235 gmetad on
# 开机运行apache服务
chkconfig --levels 235 httpd on

启动服务

service gmond start
service gmetad start
service httpd restart

 

修改hadoop配置：

vim $HADOOP_HOME/conf/hadoop-metrics.properties

# Configuration of the "dfs" context for ganglia

dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext31

dfs.period=10

dfs.servers=master.hadoop.test:8649

 

# Configuration of the "mapred" context for ganglia

mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext31

mapred.period=10

mapred.servers=master.hadoop.test:8649

 

# Configuration of the "jvm" context for ganglia

jvm.class=org.apache.hadoop.metrics.ganglia.GangliaContext31

jvm.period=10

jvm.servers=master.hadoop.test:8649

 

rpc.class=org.apache.hadoop.metrics.ganglia.GangliaContext31

rpc.period=10

rpc.servers=master.hadoop.test:8649

重启Hadoop

修改HBase配置：

hbase.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
hbase.period=10
hbase.servers=master.hadoop.test:8649


jvm.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
jvm.period=10
jvm.servers=master.hadoop.test:8649


rpc.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
rpc.period=10
rpc.servers=master.hadoop.test:8649


rest.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
rest.period=10
rest.servers=master.hadoop.test:8649

重启Hbase

访问http://${ganglia_home}/ganglia