ylzhj02
- 浏览: 246122 次
- 性别:
- 来自: 成都
-
最新评论
-
oldrat：
https://github.com/oldratlee/tr ...
Kafka: High Qulity Posts
文章列表
References
https://github.com/nathanmarz/storm-contrib
http://eugenedvorkin.com/implementing-top-10-most-popular-articles-in-real-time-with-storm-and-mongodb/
https://github.com/edvorkin/TrendingTopic
http://www.michael-noll.com/blog/2013/01/18/implementing-real-time-trending- ...
http://techkites.blogspot.com/2014/06/real-time-clickstream-analytics-using.html
when i use
there is a error
java.lang.NoClassDefFoundError: org/kitesdk/morphline/api/MorphlineCompilationException
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:190)
at org.apache.flume.sink.solr.morphline.MorphlineSink.start(MorphlineSink.java:93)
a ...
http://blog.csdn.net/menergy/article/details/17583823
tungsten-replicator-3.0.0-524-src
1. download
#git clone https://github.com/mvalleavila/flume-ng-sql-source.git
2. compile
#cd flume-ng-sql-source
#mvn package
error : source 1.3 (use -source 5 or higher to enable generics)
solution:
Add the below properties to your pom.xml.
<properties>
https://gridgaintech.wordpress.com/2013/11/07/hadoop-100x-faster-how-we-did-it/
Almost two years ago, Dmitriy and I stood in front of a white board at GridGain’s office thinking: “How can we deliver the real-time performance of GridGain’s in-memory technology to Hadoop customers without asking t ...
.1 Setting the Replication Master Configuration
/etc/my.cnf
[mysqld]
basedir = /usr/local/mysql
datadir = /var/lib/mysql
port = 3306
#socket = /var/lib/mysql/mysql.sock
user=mysql
bind_address = ::
#bin log conf
log_bin = mysql-bin
binlog_checksum = NONE
binlog_format = ROW
server-id ...
https://bitbucket.org/winebarrel/mysql-replication-listener
http://flume.apache.org/FlumeUserGuide.html#a-simple-example
https://www.cyberagent.co.jp/recruit/techreport/report/id=7474
https://docs.continuent.com/tungsten-replicator-3.0/index.html
1. download source code
#git clone https://git-wip-us.apache.org/repos/asf/flume.git
2. compile
#export MAVEN_OPTS="-Xms512m -Xmx1024m -XX:PermSize=256m -XX:MaxPermSize=512m"
#mvn clean install -DskipTests
an error comes
see:
https://issues.apache.org/jira/browse/FLUME-2184
...
基于Flume的美团日志收集系统(一)架构和设计
http://blog.newitfarmer.com/big_data/big-data_integration/flume-big-data-production/15472/repost-%E5%9F%BA%E4%BA%8Eflume%E7%9A%84%E7%BE%8E%E5%9B%A2%E6%97%A5%E5%BF%97%E6%94%B6%E9%9B%86%E7%B3%BB%E7%BB%9F%E4%B8%80%E6%9E%B6%E6%9E%84%E5%92%8C%E8%AE%BE%E8%AE%A1
基于Flume的美团日志收集 ...
HDFS is append only, yes. The short answer to your question is that, to modify any portion of a file that is already written, one must rewrite the entire file and replace the old file."Even for a single byte?" Yes, even for a single byte."Really?!" Yep, really. "Isn't that h ...
1.install and configure hadoop-2.6.0 ($HADOOP_HOME must be set).
2. download mysql-5.6.22.tar.gz source code from http://dev.mysql.com/downloads/mysql/
#tar xf mysql-5.6.22.tar.gz
#cd mysql-5.6.22
#cmake .
#make
#export MYSQL_DIR=/path/to/mysql-5.6.22
3. download mysql-connector-c-6.1.5- ...
Storm: books
- 博客分类：
- Storm
Big Data Analytics Beyond Hadoop: Real-Time Applications with Storm, Spark, and More Hadoop Alternatives Storm Applied: Strategies for Real-time Event Processing
Storm源码分析
Storm Real-Time Processing Coo
Flume: books
- 博客分类：
- Flume
Using Flume Flexible, Scalable, and Reliable Data Streaming By Hari Shreedharan
Apache Flume: Distributed Log Collection for Hadoop