`
文章列表
flumeng agent collect log events to flumeng collector flumeng collector sends data into hbase flumeng property file is monitored and controlled by JMX   Other MBean Example existing in Flume ObjectName  org.apache.flume.channel:type=fc ClassName org.apache.flume.instrumentation.ChannelCounter ...
Delete Hbase rows example   $hadoop jar ./sponge-hserver.jar com.citi.sponge.mapreduce.MRDeleteRows -Dtable="elf_log" -DstartKey="10000:1365663164575:88888:testhome" -DstopKey="10000:1365663164575:88890:testhome" -Dquorum="vm-15c2-3bbf.nam.nsroot.net,vm-ab1f-dd2 ...
Spring AOP essentials 1. ProxyFactoryBean is used for declaring AOP 2. ProxyFactory is for programming AOP 3. AspectJFactoryBean is for AspectJ integration 4. For interface, JDK proxy is used 5. For class, CGLib is used 6. Ref InvocationHandler   Defining AOP terminology  ADVICE  In AOP t ...
Spring IOC 容器的两种实现  BeanFactory 和ApplicationContext DefaultListableBeanFactory作为一个功能完备的默认的IOC容器   ApplicationContext 除了基本的功能外,还支持不同的信息源,访问资源,支持应用事件,提供附加服务;比基本的BeanFactory提供了更高级的形态   IOC容器的初始化过程 1. BeanDefinitioin的Resource定位     对于不同的ApplicationContext,会对应不同的Rsource,例如ClassPathResource,Servle ...
Transactions are critical concept for FlumeNG. Sources produce events into Channel based on transaction batch size. Sinks consume events from Channel based on transaction batch size. It means the batch size is the key for performance tuning.   For agent. ExecSource is used to collect events an ...
Please ref flume user guide first http://flume.apache.org/FlumeUserGuide.html And the Cloudera flume blogs http://blog.cloudera.com/blog/category/flume/   How to define JAVA_HOME, java options and add our customized lib into flume-ng. All these information will be defined in FLUME_CONFI_DIR/f ...

Hadoop best practise

http://www.infoq.com/cn/articles/hadoop-ten-best-practice   http://www.infoq.com/cn/articles/MapReduce-Best-Practice-1
http://alvinalexander.com/git/git-show-change-username-email-address

Log Management

http://kibana.org/   http://graylog2.org/   http://www.elasticsearch.org/   http://logstash.net/   http://lucene.apache.org/core/3_6_1/queryparsersyntax.html   http://twitter.github.com/bootstrap/
http://www.williamlong.info/archives/919.html   http://qbox.io/   http://www.searchtb.com/   http://blogread.cn/it/    http://www.cnblogs.com/heaad/   http://blog.javachen.com/   Cloudera Search http://www.cloudera.com/content/cloudera/en/resources/library/recordedwebinar/big-data-sear ...
http://www.elasticsearch.org/guide/reference/index-modules/allocation.html     #disk usage aware allocator plugin https://github.com/sonian/elasticsearch-equilibrium     https://groups.google.com/forum/?fromgroups=#!topic/elasticsearch/PT5BZ9jUeJQ    
configuration file : $ES_HOME/conf/elasticsearch.yml   cluster.name : PPPPPP path.conf: /opt/PPPPPP/elasticsearch/conf index.number_of_replicas : 0 index.number_of_shards : 5 index.analysis.analyzer.default.pattern : "[^\\w]+" index.analysis.analyzer.default.type : pattern index.st ...
default mapping file : $ES_HOME/conf/default-mapping.json   {   "_default_" : {       "_ttl" : {         "enabled" : true,         "default" : 7776000000       },       "_source" : {         "enabled" : false       },       " ...

VisualVM

    博客分类:
  • java
VisualVM home http://visualvm.java.net/   How to start jstatd 1. go to $JAVA_HOME/bin vi jstatd.all.policy 2. add below content grant codebase "file:${java.home}/../lib/tools.jar" {permission java.security.AllPermission;}; 3. execute ./jstatd -J-Djava.security.policy=jstatd.all.poli ...
Data Visualization on ES http://www.elasticsearch.org/blog/2011/05/13/data-visualization-with-elasticsearch-and-protovis.html   Search Engine Indexing http://en.wikipedia.org/wiki/Index_(search_engine)#Inverted_indices     Faceted Search http://en.wikipedia.org/wiki/Faceted_search   Informa ...
Global site tag (gtag.js) - Google Analytics