大数据系列9：Mahout – 机器学习

wget http://mirrors.ustc.edu.cn/apache/mahout/0.8/mahout-distribution-0.8.tar.gz

tar -xzvf mahout-distribution-0.8.tar.gz

cd mahout-distribution-0.8

sudo vi /etc/profile

增加：

    export PATH=$PATH:/home/ysc/mahout-distribution-0.8/bin

source /etc/profile

数据：hadoop fs -put clustering_material.txt testdata/clustering_material.txt

聚类1：mahoutorg.apache.mahout.clustering.syntheticcontrol.kmeans.Job

分析1：mahout clusterdump --input output/clusters-10-final --pointsDir output/clusteredPoints --output output/clusteranalyze_kmeans.txt

查看：

    hadoopfs -lsr output

    more  output/clusteranalyze_kmeans.txt

    VL-19代表这是一个cluster，n=161代表该cluster有161个点，c=[...]代表该cluster的中心向量点，r=[...]代表cluster的半径

聚类2：mahout org.apache.mahout.clustering.syntheticcontrol.canopy.Job

分析2：mahout clusterdump --input output/clusters-0-final --pointsDir output/clusteredPoints --output output/clusteranalyze_canopy.txt

聚类3：mahout org.apache.mahout.clustering.syntheticcontrol.fuzzykmeans.Job

分析3：mahout clusterdump --input output/clusters-6-final --pointsDir output/clusteredPoints --output output/clusteranalyze_fuzzykmeans.txt

聚类4：mahout org.apache.mahout.clustering.syntheticcontrol.dirichlet.Job

分析4：mahout clusterdump --input output/clusters-5-final --pointsDir output/clusteredPoints --output output/clusteranalyze_dirichlet.txt

聚类5：mahout org.apache.mahout.clustering.syntheticcontrol.meanshift.Job

分析5：mahout clusterdump --input output/clusters-3-final --pointsDir output/clusteredPoints --output output/clusteranalyze_meanshift.txt

 

 

 

 

 

 

APDPlat旗下十大开源项目