Saturday, April 28, 2012

install chukwa for hbase metrics log

Chukwa is claimed to provide log collection, analysis and results displaying solution based on HDFS and map/reduce framework, and now it is under Apache incubator project list.

Chukwa web interface




1.if you want to store into HBase and also HDFS, set it in chukwa-collector-conf.xml 
<name>chukwaCollector.pipeline</name> 
<value>org.apache.hadoop.chukwa.datacollection.writer.hbase.HBaseWriter,org.apache.

hadoop.chukwa.datacollection.writer.SeqFileWriter</value> 


noteshbase.HBaseWriter  must be written before SeqFileWriter, because SeqFileWriter does not pass data to next writer, this is the reason that it has to be the last writer in the pipeline as a workaround.  


2. if you have questions, please make a comment, or mail to me



No comments:

Post a Comment

scala project to support JDK 17

Compiling my Scala project with JDK 17. status: the project once used sbt version 1.2.8 and scala 2.12.8, and targets JDK 11. it works fin...