Set up Ganglia for EC2 with Hadoop and HBase
Ganglia is a very nice tool to help monitor several statistics in a cluster environment. Â For eg., you can track the CPU times for all the clusters in a single end point.
Setting up ganglia is fairly simple. Â You just have to start two daemon processes. Â gmond (Ganglia monitor) and gmetad (Ganglia meta). Â And you need to copy the web scripts, the php ones into proper apache directory ( assuming your web server is apache).
gmond - Â This has to run on every node in the cluster.
gmetad - Â This has to run where the end point is specified.
gmond collects statistics and stores in a location. Â It frequently sends data to gmetad. Â Usually gmond is set to support multicast (by default) the meta data. Â This can be set to unicast to gmetad. Once this setup is done, you should be able to see the webpage showing graphs.
For detailed setup follow this link. Â
As you follow the above link, make a note that EC2 supports only unicast and because of this you need to set  "send_metadata_interval" to a value greater than 0 in gmond.conf to support unicast. ( I lost about 2 hours figuring this out ).














