Install
Server node
1. install packages
sudo apt-get install ganglia-monitor ganglia-webfrontend gmetad2. edit /etc/ganglia/gmond.conf
sample gmond.conf setting:cluster {
name = "CDH5"
owner = "unspecified"
latlong = "unspecified"
url = "unspecified"
}
udp_send_channel {
/* mcast_join = xxx */
host = xxx.xxx.xxx.1 /* your ganglia server ip */
port = 8649
ttl = 1
}
/* mcast_join = xxx */
port = 8649
/* bind = xxx */
}
3. scp /etc/ganglia/gmond.conf to all the other nodes
4. edit /etc/ganglia/gmetad.conf
sample gmond.conf setting:data_source "CDH5" xxx.xxx.xxx.1 xxx.xxx.xxx.2 xxx.xxx.xxx.3 ...
Other nodes
1. install ganglia monitor
sudo apt-get install ganglia-monitor2. copy gmond.conf from server node to /etc/ganglia
sudo mv gmond.conf /etc/ganglia/3. restart ganglia monitor service
sudo service ganglia-monitor restartConfig: CDH5 components Hadoop Metrics2 setting
hadoop-metrics2.propertiesHDFS
NameNode
*.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31*.period=10
namenode.sink.ganglia.servers=10.10.114.120:8649
DataNode
*.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
*.period=10
datanode.sink.ganglia.servers=10.10.114.120:8649
SecondaryNameNode
*.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
*.period=10
secondarynamenode.sink.ganglia.servers=10.10.114.120:8649
YARN
ResourceManager
*.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
*.period=10
resourcemanager.sink.ganglia.servers=10.10.114.120:8649
maptask.sink.ganglia.servers=10.10.114.120:8649
reducetask.sink.ganglia.servers=10.10.114.120:8649
NodeManager
*.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
*.period=10
nodemanager.sink.ganglia.servers=10.10.114.120:8649
maptask.sink.ganglia.servers=10.10.114.120:8649
reducetask.sink.ganglia.servers=10.10.114.120:8649
HBase
Master Server
*.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
*.sink.ganglia.period=10
hbase.sink.ganglia.period=10
hbase.sink.ganglia.servers=10.10.114.120:8649
Region Server
*.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
*.sink.ganglia.period=10
hbase.sink.ganglia.period=10
hbase.sink.ganglia.servers=10.10.114.120:8649
*(there are too many metrics generated from RegionServer, each region of all of tables generates some metrics... be careful if you turn on the ganglia hadoop metrics2 sink on HBase RegionServer)
Hey! This is my first comment here so I just wanted to give a quick shout out and say usamagazine writersevoke pathofex oftenit dsnews I truly enjoy reading your articles. Can you recommend any other blogs/websites/forums that cover the same topics? Thank you so much!
ReplyDeleteAll EntrepreneurLikes have courage although they may not admit this to themselves or anyone else but they have this in abundance. They may present as confident but deep inside they are quaking with nerves and anticipation but at least they take action.
ReplyDeleteThe Wynn Casino | Dr.MCD
ReplyDeleteLas Vegas is a destination casino resort featuring fine dining, entertainment and a relaxing 여수 출장마사지 spa. The 강릉 출장안마 resort is designed to meet the needs 경기도 출장안마 of our Rating: 4.1 · 4 안성 출장마사지 reviews 동해 출장마사지
Titanium Carabiners for Sale
ReplyDeleteThe largest and best known titanium screws example of titanium headers the Ceramic titanium mens ring Carabiner titanium color for Sale is the carabiner. They are a beautifully crafted piece that is crafted using traditional ceramics omega seamaster titanium Rating: 4 · 1 review · $1.99
Department of Pre-University Education is the Official Agency that Governs the Syllabus and Exam for 2nd PUC, Students can Download Karnataka II PUC syllabus the Pdf Form of the Department of Pre-University, Government of Karnataka Official Website, 2nd PUC Students, we Suggested Simple steps to to Download Karnataka 2nd New Syllabus 2022 for Hindi, English Medium All Subject Pdf Download.The Department of Pre-University, Government of Karnataka is the Organization for Implementation of Higher Secondary Education in the State, Karnataka Govt Function under the Department of Primary & Secondary Education, PUE Courses Offered by the Department are Broadly Classified under the Categories of Humanities (Arts), Science & Commerce.
ReplyDeleteNice blog thanks for poosting
ReplyDelete