Hadoop 部署

http://v.youku.com/v_show/id_XMzc5MzM1NDQw.html

VMware key
NY0K2-2ULDJ-LZUP1-MV154-8363F
4F4R4-AEK53-TZYU9-KK9X4-9AWPQ

Hadoop实战_1.avi 链接:http://pan.baidu.com/share/link?shareid=3449193448&uk=808459810 密码:8lw8
Hadoop实战_2.avi 链接:http://pan.baidu.com/share/link?shareid=3463589493&uk=808459810 密码:frok
Hadoop实战_3.avi 链接:http://pan.baidu.com/share/link?shareid=3464724818&uk=808459810 密码:35gi
Hadoop实战_4.avi 链接:http://pan.baidu.com/share/link?shareid=3465691991&uk=808459810 密码:x9dg
Hadoop实战_5.avi 链接:http://pan.baidu.com/share/link?shareid=3466551705&uk=808459810 密码:hkoz
Hadoop实战_6.avi 链接:http://pan.baidu.com/share/link?shareid=3467438876&uk=808459810 密码:fazc
Hadoop实战_7.avi 链接:http://pan.baidu.com/share/link?shareid=3468369694&uk=808459810 密码:6jif
Hadoop实战_8.avi 链接:http://pan.baidu.com/share/link?shareid=3472164752&uk=808459810 密码:4b04
Hadoop实战_9.avi 链接:http://pan.baidu.com/share/link?shareid=3473495428&uk=808459810 密码:7vr1
Hadoop实战_10.avi 链接:http://pan.baidu.com/share/link?shareid=3474335016&uk=808459810 密码:vnyt
Hadoop实战_11.avi 链接:http://pan.baidu.com/share/link?shareid=3475166376&uk=808459810 密码:9svs
Hadoop实战_12.avi 链接:http://pan.baidu.com/share/link?shareid=3477133427&uk=808459810 密码:m74p
Hadoop实战_13.avi 链接:http://pan.baidu.com/share/link?shareid=3478062824&uk=808459810 密码:7qda
Hadoop实战_14.avi 链接:http://pan.baidu.com/share/link?shareid=3478811683&uk=808459810 密码:bijp

hadoop+hbase+zookeeper完全分布式环境搭建
http://blog.csdn.net/chabale/article/details/8815131

hadoop学习之hadoop完全分布式集群安装
http://blog.csdn.net/ab198604/article/details/8250461
http://blog.chinaunix.net/uid-25266990-id-3900239.html

Hive安装
http://blog.csdn.net/daniel_ustc/article/details/12795627
http://blog.csdn.net/jimmylincole/article/details/14125175

VM
michael/test

ssh-keygen -t rsa -P ''

cat id_rsa.pub  >> authorized_keys

scp michael@master:~/.ssh/id_rsa.pub ./master_rsa.pub
scp id_rsa.pub michael@u11:~/.ssh/id_rsa10.pub

jdk1.7.0_51

/usr/local/jdk1.7.0_51

export JAVA_HOME=/usr/local/jdk1.7.0_51/
export JRE_HOME=/usr/local/jdk1.7.0_51/jre
export HADOOP_INSTALL=/usr/local/hadoop
export CLASSPATH=.:$CLASSPATH:$JAVA_HOME/lib:$JRE_HOME/lib
export PATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/bin:$HADOOP_INSTALL/bin

http://192.168.183.129:50030

dataLogDir=/usr/local/zookeeper-3.3.6/log
server.1=192.168.183.129:2888:3888
server.2=192.168.183.130:2888:3888
server.3=192.168.183.131:2888:3888

sudo scp -r michael@master:/usr/local/zookeeper-3.4.6 /usr/local

zookeeper_server.pid

zkCli.sh –server master:2181

export JAVA_HOME=/usr/local/jdk1.7.0_51

# Extra Java CLASSPATH elements.  Optional.
export HBASE_CLASSPATH=/usr/local/hadoop/conf

<property>
        <name>hbase.cluster.distributed</name>
        <value>true</value>
</property>
<property>
        <name>hbase.rootdir</name>
        <value>hdfs://master:9000/hbase</value>
</property>
<property>
        <name>hbase.master</name>
        <value>master:60000</value>
</property>
<property>
        <name>hbase.zookeeper.quorum</name>
        <value>master,slave1,slave2</value>
</property>

start-hbase.sh

sudo scp michael@master:/home/michael/Downloads/hbase-0.94.17-security/lib/zookeeper-3.4.5.jar .

scp michael@master:/home/michael/Downloads/hadoop-1.1.2-bin.tar.gz .

Eclipse WordCount.java
http://blog.sina.com.cn/s/blog_62186b4601012acs.html

Hadoop Eclipse plugin
https://code.google.com/p/hadoop-eclipse-plugin/downloads/list

hadoop dfs -cat /user/michael/wcoutput/*

 

hadoop dfs -mkdir input
hadoop dfs -copyFromLocal ../conf/* input

hadoop jar ../hadoop-examples-1.1.2.jar wordcount input output
hadoop jar /usr/local/hadoop-1.1.2/hadoop-examples-1.1.2.jar wordcount input out

Blog
http://blog.csdn.net/rzhzhz/article/category/948480
http://www.cnblogs.com/zhanghuijunjava/

http://blog.csdn.net/aaronhadoop/article/details/24859369
http://going.blog.51cto.com/7876557/1365883
http://www.tuicool.com/articles/RB3qAj
http://f.dataguru.cn/thread-209110-1-1.html
http://blog.csdn.net/zhangzhaokun/article/details/17427835
http://www.cnblogs.com/nb591/p/3535662.html
http://f.dataguru.cn/thread-209110-1-1.html

Nutch-2.2.1学习之三Nutch配置文件
http://blog.csdn.net/skywalker_only/article/details/16981699

Nutch 快速入门(Nutch 2.2.1)
http://cn.soulmachine.me/blog/20140201/
http://www.cnblogs.com/i80386/p/3540389.html

nutch-2.2.1 hadoop-1.2.1 hbase-0.92.1 集群部署
http://www.cnblogs.com/i80386/p/3540389.html

Hadoop1
start Hdfs
start-all.sh

zookeeper
zkServer.sh start
zkServer.sh status
zkServer.sh stop

Hbase
start-hbase.sh

bin/crawl ../../urls ../../TestCrawl http://localhost:8983/solr/ 2

http://my.oschina.net/mynote/blog?disp=2&p=1&catalog=316582

Nutch-2.2.1学习之四Nutch与Hbase结合使用时常见问题
http://blog.csdn.net/skywalker_only/article/details/17076851

Hbase
list
http://blog.csdn.net/shi1122/article/details/7676488