LinkedIn 的分布式搜索sensei编译安装

 Sensei是LinkedIn的一个分布式搜索系统。安装步骤参考：

http://linkedin.jira.com/wiki/display/SENSEI/Getting+Started

 

需要：

• java 1.6 or higher
• maven 2.2.1 or higher
• zookeeper 3.2.0 http://hadoop.apache.org/zookeeper/
• lucene
• spring

linkedin自己的相关包：

     bobo-browse ,norbert ,zoie ,kafka （这些在git的lib目录下有）

 

1. 下载编译sensei：

git clone git://github.com/javasoze/sensei.git sensei

git 的安装参见：http://rabbit9898.iteye.com/blog/789809

 

运行ant编译 （需要在Linux下编译）

 

2. 启动Zookeeper

zookeeper-3.2.0/bin/zkServer.sh start

 

3. 启动sensei node

  

bin/start-sensei-node.sh 0 17071 0,1,2,3,4,5,6,7,8,9,10 node-conf/

 

   sensei node 会向zooKeeper注册.

 

4. 启动web 测试查询

 

4.1 因为jetty端口冲突需要修改build.xml

  <target name="server" depends="init" >
    <exec executable="mvn">
      <arg line="-Dlog4j.configuration=file:./resources/log4j.properties -Djetty.port=8081 jetty:run" />
    </exec>
  </target>

 

4.2 修改一下 resources/log4j.properties  可以将${log.home} 指向自己的目录

#log4j.appender.sensei.File=${log.home}/sensei-server.log
#log4j.appender.info.File=${log.home}/sensei-info.log

 

启动

ant server 

 

log里可以看到Jetty能够启动起来（JMX注册有问题，可以暂时不管）

 

 访问：

http://localhost:8081/

 

 可以看到：

 

 

 

 

Sensei Node 中的log可以看到：

2011/04/11 10:11:42.838 INFO [com.sensei.search.nodes.AbstractSenseiNodeMessageHandler] [] serving partitions: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10]
2011/04/11 10:11:42.841 INFO [com.sensei.search.nodes.AbstractSenseiNodeMessageHandler] [] searching partition: 0 browse took: 3
2011/04/11 10:11:42.842 INFO [com.sensei.search.nodes.AbstractSenseiNodeMessageHandler] [] searching partition: 1 browse took: 1
2011/04/11 10:11:42.843 INFO [com.sensei.search.nodes.AbstractSenseiNodeMessageHandler] [] searching partition: 2 browse took: 1
2011/04/11 10:11:42.845 INFO [com.sensei.search.nodes.AbstractSenseiNodeMessageHandler] [] searching partition: 3 browse took: 1
2011/04/11 10:11:42.846 INFO [com.sensei.search.nodes.AbstractSenseiNodeMessageHandler] [] searching partition: 4 browse took: 1
2011/04/11 10:11:42.848 INFO [com.sensei.search.nodes.AbstractSenseiNodeMessageHandler] [] searching partition: 5 browse took: 2
2011/04/11 10:11:42.849 INFO [com.sensei.search.nodes.AbstractSenseiNodeMessageHandler] [] searching partition: 6 browse took: 1
2011/04/11 10:11:42.850 INFO [com.sensei.search.nodes.AbstractSenseiNodeMessageHandler] [] searching partition: 7 browse took: 1
2011/04/11 10:11:42.852 INFO [com.sensei.search.nodes.AbstractSenseiNodeMessageHandler] [] searching partition: 8 browse took: 2
2011/04/11 10:11:42.853 INFO [com.sensei.search.nodes.AbstractSenseiNodeMessageHandler] [] searching partition: 9 browse took: 1
2011/04/11 10:11:42.854 INFO [com.sensei.search.nodes.AbstractSenseiNodeMessageHandler] [] searching partition: 10 browse took: 1
2011/04/11 10:11:42.857 INFO [com.sensei.search.nodes.AbstractSenseiNodeMessageHandler] [] searching partitions  [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10] took: 15