- 浏览: 2211002 次
- 性别:
- 来自: 北京
-
文章分类
- 全部博客 (682)
- 软件思想 (7)
- Lucene(修真篇) (17)
- Lucene(仙界篇) (20)
- Lucene(神界篇) (11)
- Solr (48)
- Hadoop (77)
- Spark (38)
- Hbase (26)
- Hive (19)
- Pig (25)
- ELK (64)
- Zookeeper (12)
- JAVA (119)
- Linux (59)
- 多线程 (8)
- Nutch (5)
- JAVA EE (21)
- Oracle (7)
- Python (32)
- Xml (5)
- Gson (1)
- Cygwin (1)
- JavaScript (4)
- MySQL (9)
- Lucene/Solr(转) (5)
- 缓存 (2)
- Github/Git (1)
- 开源爬虫 (1)
- Hadoop运维 (7)
- shell命令 (9)
- 生活感悟 (42)
- shell编程 (23)
- Scala (11)
- MongoDB (3)
- docker (2)
- Nodejs (3)
- Neo4j (5)
- storm (3)
- opencv (1)
最新评论
-
qindongliang1922:
粟谷_sugu 写道不太理解“分词字段存储docvalue是没 ...
浅谈Lucene中的DocValues -
粟谷_sugu:
不太理解“分词字段存储docvalue是没有意义的”,这句话, ...
浅谈Lucene中的DocValues -
yin_bp:
高性能elasticsearch ORM开发库使用文档http ...
为什么说Elasticsearch搜索是近实时的? -
hackWang:
请问博主,有用solr做电商的搜索项目?
Solr中Group和Facet的用法 -
章司nana:
遇到的问题同楼上 为什么会返回null
Lucene4.3开发之第八步之渡劫初期(八)
上篇shell脚本写了一键安装solr,本篇我们来看下如何一键安装zookeeper,散仙最近是最自动化安装脚本上迷了,咱们也不会复杂的,先从简单的开始联手,下面进入正题:
安装条件:
1,确保你的JAVA环境是OK的,JDK什么的
2,在root根目录下有一个zookeeper下好的压缩包
3,安装脚本默认放在root目录下
4,所有的安装目录,及压缩包命名,都在本脚本的前面几行定义,散仙为了方便写的比较固定,需要灵活的朋友们,可以做成动态的路径
5,确认上面的4步是ok的,下面就可以运行这个脚本了
6,安装完成后会在最后的状态里面打印出zk的运行情况
下面看散仙的安装日志:
注意散仙的是单机安装,如果想要分布式安装也是非常简单的,用for循环加上ssh,远程执行,再对myid和zoo.cfg稍作配置即可。
散仙上面运行的是多次,运行的,大于第一次运行的,会在后面检测如果已经有zk的进程,会杀死,重启,单机版本,zk成功的标志就是显示状态为standalone
脚本如下:
安装条件:
1,确保你的JAVA环境是OK的,JDK什么的
2,在root根目录下有一个zookeeper下好的压缩包
3,安装脚本默认放在root目录下
4,所有的安装目录,及压缩包命名,都在本脚本的前面几行定义,散仙为了方便写的比较固定,需要灵活的朋友们,可以做成动态的路径
5,确认上面的4步是ok的,下面就可以运行这个脚本了
6,安装完成后会在最后的状态里面打印出zk的运行情况
下面看散仙的安装日志:
zookeeper-3.4.5/contrib/zkfuse/src/event.cc zookeeper-3.4.5/contrib/zkfuse/src/event.h zookeeper-3.4.5/contrib/zkfuse/src/log.cc zookeeper-3.4.5/contrib/zkfuse/src/log.h zookeeper-3.4.5/contrib/zkfuse/src/log4cxx.properties zookeeper-3.4.5/contrib/zkfuse/src/Makefile.am zookeeper-3.4.5/contrib/zkfuse/src/mutex.h zookeeper-3.4.5/contrib/zkfuse/src/thread.cc zookeeper-3.4.5/contrib/zkfuse/src/thread.h zookeeper-3.4.5/contrib/zkfuse/src/zkadapter.cc zookeeper-3.4.5/contrib/zkfuse/src/zkadapter.h zookeeper-3.4.5/contrib/zkfuse/src/zkfuse.cc zookeeper-3.4.5/contrib/rest/zookeeper-3.4.5-rest.jar zookeeper-3.4.5/contrib/loggraph/build.xml zookeeper-3.4.5/contrib/loggraph/src/ zookeeper-3.4.5/contrib/loggraph/zookeeper-3.4.5-loggraph.jar zookeeper-3.4.5/contrib/loggraph/src/java/ zookeeper-3.4.5/contrib/loggraph/src/java/org/ zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/ zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/ zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/ zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/FilterException.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/FilterOp.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/filterops/ zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/FilterParser.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/JsonGenerator.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/Log4JEntry.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/Log4JSource.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/LogEntry.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/LogIterator.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/LogServer.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/LogSkipList.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/LogSource.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/MeasureThroughput.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/MergedLogSource.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/RandomAccessFileReader.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/servlets/ zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/TransactionEntry.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/TxnLogSource.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/servlets/FileLoader.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/servlets/Fs.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/servlets/GraphData.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/servlets/JsonServlet.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/servlets/NumEvents.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/servlets/StaticContent.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/servlets/Throughput.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/filterops/AndOp.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/filterops/Arg.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/filterops/EqualsOp.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/filterops/GreaterThanOp.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/filterops/LessThanOp.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/filterops/NotOp.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/filterops/NumberArg.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/filterops/OrOp.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/filterops/StringArg.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/filterops/SymbolArg.java zookeeper-3.4.5/contrib/loggraph/src/java/org/apache/zookeeper/graph/filterops/XorOp.java zookeeper-3.4.5/contrib/fatjar/build.xml zookeeper-3.4.5/contrib/fatjar/conf/ zookeeper-3.4.5/contrib/fatjar/src/ zookeeper-3.4.5/contrib/fatjar/zookeeper-3.4.5-fatjar.jar zookeeper-3.4.5/contrib/fatjar/src/java/ zookeeper-3.4.5/contrib/fatjar/src/java/org/ zookeeper-3.4.5/contrib/fatjar/src/java/org/apache/ zookeeper-3.4.5/contrib/fatjar/src/java/org/apache/zookeeper/ zookeeper-3.4.5/contrib/fatjar/src/java/org/apache/zookeeper/util/ zookeeper-3.4.5/contrib/fatjar/src/java/org/apache/zookeeper/util/FatJarMain.java zookeeper-3.4.5/contrib/fatjar/conf/mainClasses zookeeper-3.4.5/conf/configuration.xsl zookeeper-3.4.5/conf/log4j.properties zookeeper-3.4.5/conf/zoo_sample.cfg zookeeper-3.4.5/bin/README.txt zookeeper-3.4.5/bin/zkCleanup.sh zookeeper-3.4.5/bin/zkCli.cmd zookeeper-3.4.5/bin/zkCli.sh zookeeper-3.4.5/bin/zkEnv.cmd zookeeper-3.4.5/bin/zkEnv.sh zookeeper-3.4.5/bin/zkServer.cmd zookeeper-3.4.5/bin/zkServer.sh 解压完毕! 生成myid文件....... 写入zoo.cfg文件成功! zk进程号: 2575 检测到zookeeper进程存在,已关闭! 开始启动zk..... JMX enabled by default Using config: /root/izk/zookeeper/bin/../conf/zoo.cfg Starting zookeeper ... bin/zkServer.sh: line 103: [: /tmp/zookeeper: binary operator expected STARTED 启动完成....查看zookeeper状态 JMX enabled by default Using config: /root/izk/zookeeper/bin/../conf/zoo.cfg Mode: standalone [root@ganglia ~]# jps 2693 Jps 2651 QuorumPeerMain [root@ganglia ~]#
注意散仙的是单机安装,如果想要分布式安装也是非常简单的,用for循环加上ssh,远程执行,再对myid和zoo.cfg稍作配置即可。
散仙上面运行的是多次,运行的,大于第一次运行的,会在后面检测如果已经有zk的进程,会杀死,重启,单机版本,zk成功的标志就是显示状态为standalone
脚本如下:
zkpath=/root/zookeeper-3.4.5.tar.gz ipath=/root/izk ipaddress="192.168.46.21" if [ ! -e $ipath ] ; then echo "路径不存在,创建安装路径!" mkdir $ipath else rm -rf $ipath"/"* echo "路径存在,已清空完毕!" fi echo "解压zk到指定目录下!" sleep 2 tar -zxvf $zkpath -C $ipath echo "解压完毕!" cd $ipath mv zookeeper-3.4.5 zookeeper confpath=$ipath"/zookeeper" cd $confpath mkdir data cd data echo "1" >> myid echo "生成myid文件......." cd $confpath"/conf" mv zoo_sample.cfg zoo.cfg echo "tikcTime=2000" >> zoo.cfg echo "dataDir=$confpath/data" >> zoo.cfg echo "server.1=$ipaddress:2887:3887" >> zoo.cfg echo "写入zoo.cfg文件成功!" sleep 3 pid=`ps -ef | grep zookeeper | gawk '{ print $2}' | head -n 1` echo "zk进程号: $pid" sleep 2 #检查进程号是否为空 if [ ! -z $pid ] ; then kill -9 $pid echo "检测到zookeeper进程存在,已关闭!" fi echo "开始启动zk....." cd .. bin/zkServer.sh start echo "启动完成....查看zookeeper状态" bin/zkServer.sh status
- myzk.zip (762 Bytes)
- 下载次数: 33
发表评论
-
什么是操作系统的虚拟内存?
2019-07-17 10:04 823https://mp.weixin.qq.com/s?__bi ... -
关于Linux进程的基础知识
2018-12-17 15:58 1339### 前言 在计算机里面,一个进程通常指的是一个运行程序的 ... -
小知识之Linux系统中的最大进程数,最大文件描述,最大线程数
2018-01-19 22:16 2065今天来了解一下linux里面的一些小知识: (一)Lin ... -
Nginx配置的一些小功能
2018-01-12 21:28 1561前面的文章,已经介绍 ... -
理解正常代理与反向代理的区别
2017-12-21 09:57 731http://blog.csdn.net/u010454030 ... -
Nginx入门介绍与安装
2017-12-20 21:38 1309### Nginx是什么? Nginx ... -
给centos重新安装yum的base-repo源
2017-12-14 21:06 6288如果自己的centos的系统yum源出现问题了,如何才能修 ... -
如何在centos7上使用shadowsocks配置代理
2016-11-16 16:59 17466作为一名程序员,如 ... -
centos7安装mysql
2016-11-14 16:41 1332centos7的默认yum源已经 ... -
unbutu+mysql的root密码重置方法
2016-01-11 14:16 1312MySQL密码重置策略: 1,停止mysql服务 s ... -
诡异的SSH免密失效
2015-12-31 12:31 2854今天在开发环境,重启了下hadoop,发现log里面竟然打出 ... -
Linux远程ssh脚本执行命令问题
2015-12-04 13:20 3889总结下使用ssh远程执行命令需要注意点: 一般我们会使用s ... -
Linux网络神器之强大的NetCat命令
2015-10-15 21:40 6513名称:netcat命令在linux中别名为nc 作用:支持任意 ... -
vi使用技巧--批量加注释任意符号
2015-08-07 16:25 1370使用vi批量加注释“#”或者是// 等一些符号,看似简单但用处 ... -
使用shell分页读取600万+的MySQL数据脚本
2015-07-15 13:02 2785shell-mysql (1)脚本背景: 由于要在Linux ... -
解决Centos下vim粘贴内容格式混乱问题
2015-06-24 13:36 3570有时候,我们在向vim打开的一个xml,或者任意文件中,拷贝 ... -
如何在Linux下递归查看所有文件或目录?
2015-04-15 17:37 2644find命令,是个非常nice的命令,如果你还不了解这个命 ... -
如何在Centos下设置Vim的永久显示行号功能?
2015-03-19 17:32 2105在Linux系统中,我们经常会使用vi或vim命令,来操作文本 ... -
你有一个好的归档习惯吗?
2015-02-11 22:01 1930备忘和扯一扯最近散仙 ... -
centos6.5服务器时间同步
2014-10-30 18:54 1418实际的开发环境中,我们的一组服务器的时间都需要一致,这样在执行 ...
相关推荐
6,Zookeeper3.4.5 7,Hive0.13.13 全是Java有关的框架,主要目的在于安装Hadoop,其他的都是附带的基本配置 本脚本能够快速在Linux上安装JAVA环境,并部署hadoop,其中关于hadoop,hbase和Zookeeper的配置 分别在...
- Zookeeper:3.4.5 - SSH工具:SSH Secure Shell Client 3.2.9 2. **安装步骤** **2.1. 安装虚拟机** 首先在主机上安装VMware Workstation,然后在该环境中创建并安装CentOS虚拟机。 **2.2. 在CentOS上安装...
- **上传文档(shell脚本及加密解密程序)**: - 在投产当天,将调度脚本上传至生产LINUX服务器`/home/etl/crm/script`目录下。 以上步骤详细介绍了ETL服务器的安装和配置过程,包括用户创建、JDK安装配置、Kettle...
1. ZooKeeper:这里选择了zookeeper-3.4.5-cdh5.5.0.tar.gz 2. HBase:选用的是hbase-1.0.0-cdh5.5.0.tar.gz 3. Hadoop:推荐使用hadoop-2.6.0-cdh5.5.0.tar.gz 请注意,所有软件版本之间需保持一致,以避免兼容性...