最近solr的load比较高，通过jstack查看：
写道
"catalina-exec-13600" daemon prio=10 tid=0x00002aabb1468800 nid=0x226b runnable [0x000000004b439000]
java.lang.Thread.State: RUNNABLE
at org.apache.lucene.search.FieldValueHitQueue$OneComparatorFieldValueHitQueue.lessThan(FieldValueHitQueue.java:85)
at org.apache.lucene.search.FieldValueHitQueue$OneComparatorFieldValueHitQueue.lessThan(FieldValueHitQueue.java:54)
at org.apache.lucene.util.PriorityQueue.downHeap(PriorityQueue.java:239)
at org.apache.lucene.util.PriorityQueue.pop(PriorityQueue.java:176)
at org.apache.lucene.search.TopFieldCollector.populateResults(TopFieldCollector.java:977)
at org.apache.lucene.search.TopDocsCollector.topDocs(TopDocsCollector.java:156)
at org.apache.solr.search.SolrIndexSearcher.sortDocSet(SolrIndexSearcher.java:1715)
at org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:1164)
at org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:375)
at org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:394)
at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:186)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376)
at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:291)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:396)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
"catalina-exec-13634" daemon prio=10 tid=0x00002aabf8b21000 nid=0x2292 runnable [0x000000004d85d000]
java.lang.Thread.State: RUNNABLE
at org.apache.lucene.index.SegmentTermPositions.next(SegmentTermPositions.java:103)
at org.apache.lucene.search.ExactPhraseScorer.nextDoc(ExactPhraseScorer.java:134)
at org.apache.lucene.search.Scorer.score(Scorer.java:89)
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:581)
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:364)
at org.apache.solr.search.SolrIndexSearcher.getDocSetNC(SolrIndexSearcher.java:863)
at org.apache.solr.search.SolrIndexSearcher.getDocSet(SolrIndexSearcher.java:617)
at org.apache.solr.search.SolrIndexSearcher.getDocSet(SolrIndexSearcher.java:936)
at org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:1157)
at org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:375)
at org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:394)
at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:186)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376)
at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
"pool-6-thread-1" prio=10 tid=0x0000000008c1a800 nid=0x4b3d runnable [0x000000004133c000]
java.lang.Thread.State: RUNNABLE
at org.apache.lucene.index.SegmentTermPositions.next(SegmentTermPositions.java:103)
at org.apache.lucene.index.SegmentTermDocs.skipTo(SegmentTermDocs.java:216)
at org.apache.lucene.search.ExactPhraseScorer.advance(ExactPhraseScorer.java:179)
at org.apache.lucene.util.ScorerDocQueue.topSkipToAndAdjustElsePop(ScorerDocQueue.java:124)
at org.apache.lucene.search.DisjunctionSumScorer.advance(DisjunctionSumScorer.java:230)
at org.apache.lucene.search.BooleanScorer2.advance(BooleanScorer2.java:320)
at org.apache.lucene.search.ConjunctionScorer.doNext(ConjunctionScorer.java:99)
at org.apache.lucene.search.ConjunctionScorer.nextDoc(ConjunctionScorer.java:128)
at org.apache.lucene.search.BooleanScorer2.score(BooleanScorer2.java:280)
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:581)
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:364)
at org.apache.solr.search.SolrIndexSearcher.getDocSetNC(SolrIndexSearcher.java:863)
at org.apache.solr.search.SolrIndexSearcher.getDocSet(SolrIndexSearcher.java:617)
at org.apache.solr.search.SolrIndexSearcher.cacheDocSet(SolrIndexSearcher.java:581)
at org.apache.solr.search.SolrIndexSearcher$2.regenerateItem(SolrIndexSearcher.java:330)
at org.apache.solr.search.LRUCache.warm(LRUCache.java:195)
at org.apache.solr.search.SolrIndexSearcher.warm(SolrIndexSearcher.java:1815)
at org.apache.solr.core.SolrCore$2.call(SolrCore.java:1166)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
java.lang.Thread.State: RUNNABLE
at org.apache.lucene.search.FieldValueHitQueue$OneComparatorFieldValueHitQueue.lessThan(FieldValueHitQueue.java:85)
at org.apache.lucene.search.FieldValueHitQueue$OneComparatorFieldValueHitQueue.lessThan(FieldValueHitQueue.java:54)
at org.apache.lucene.util.PriorityQueue.downHeap(PriorityQueue.java:239)
at org.apache.lucene.util.PriorityQueue.pop(PriorityQueue.java:176)
at org.apache.lucene.search.TopFieldCollector.populateResults(TopFieldCollector.java:977)
at org.apache.lucene.search.TopDocsCollector.topDocs(TopDocsCollector.java:156)
at org.apache.solr.search.SolrIndexSearcher.sortDocSet(SolrIndexSearcher.java:1715)
at org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:1164)
at org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:375)
at org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:394)
at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:186)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376)
at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:291)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:396)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
"catalina-exec-13634" daemon prio=10 tid=0x00002aabf8b21000 nid=0x2292 runnable [0x000000004d85d000]
java.lang.Thread.State: RUNNABLE
at org.apache.lucene.index.SegmentTermPositions.next(SegmentTermPositions.java:103)
at org.apache.lucene.search.ExactPhraseScorer.nextDoc(ExactPhraseScorer.java:134)
at org.apache.lucene.search.Scorer.score(Scorer.java:89)
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:581)
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:364)
at org.apache.solr.search.SolrIndexSearcher.getDocSetNC(SolrIndexSearcher.java:863)
at org.apache.solr.search.SolrIndexSearcher.getDocSet(SolrIndexSearcher.java:617)
at org.apache.solr.search.SolrIndexSearcher.getDocSet(SolrIndexSearcher.java:936)
at org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:1157)
at org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:375)
at org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:394)
at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:186)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376)
at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
"pool-6-thread-1" prio=10 tid=0x0000000008c1a800 nid=0x4b3d runnable [0x000000004133c000]
java.lang.Thread.State: RUNNABLE
at org.apache.lucene.index.SegmentTermPositions.next(SegmentTermPositions.java:103)
at org.apache.lucene.index.SegmentTermDocs.skipTo(SegmentTermDocs.java:216)
at org.apache.lucene.search.ExactPhraseScorer.advance(ExactPhraseScorer.java:179)
at org.apache.lucene.util.ScorerDocQueue.topSkipToAndAdjustElsePop(ScorerDocQueue.java:124)
at org.apache.lucene.search.DisjunctionSumScorer.advance(DisjunctionSumScorer.java:230)
at org.apache.lucene.search.BooleanScorer2.advance(BooleanScorer2.java:320)
at org.apache.lucene.search.ConjunctionScorer.doNext(ConjunctionScorer.java:99)
at org.apache.lucene.search.ConjunctionScorer.nextDoc(ConjunctionScorer.java:128)
at org.apache.lucene.search.BooleanScorer2.score(BooleanScorer2.java:280)
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:581)
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:364)
at org.apache.solr.search.SolrIndexSearcher.getDocSetNC(SolrIndexSearcher.java:863)
at org.apache.solr.search.SolrIndexSearcher.getDocSet(SolrIndexSearcher.java:617)
at org.apache.solr.search.SolrIndexSearcher.cacheDocSet(SolrIndexSearcher.java:581)
at org.apache.solr.search.SolrIndexSearcher$2.regenerateItem(SolrIndexSearcher.java:330)
at org.apache.solr.search.LRUCache.warm(LRUCache.java:195)
at org.apache.solr.search.SolrIndexSearcher.warm(SolrIndexSearcher.java:1815)
at org.apache.solr.core.SolrCore$2.call(SolrCore.java:1166)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
相关推荐
- 如果启动后出现错误，如`Could not load core configuration`或`ConfigSolr - /root/solr/home/solr.xml does not exist`，可能是因为`solr.xml`配置不正确。检查`solr.xml`文件，确保`docBase`和`solr/home`的...
## Project目标：生成随机文档和查询，以在实际数据可用之前执行合理准确的Solr负载测试。 这样，可以在项目的早期阶段分析资源密集型搜索功能对性能的影响## Dependencies：要运行该项目，您需要安装Python 麻木...
Solr搜索NodeBB ： Solr（发音为“ solar”）是来自Apache Lucene项目的开源企业搜索平台。 它的主要功能包括全文搜索，命中突出显示，多面搜索，动态聚类，数据库集成以及丰富的文档（例如Word，PDF）处理。 此...
(push #p"path/to/solr/source/directory" asdf:*central-registry*)(asdf:load-system :solr)访问数据库Solr服务器应该正在运行。 要访问服务器，您需要使用端点url创建一个solr实例。 例如，如果服务器在...
用法// Load dependencyconst solr = require ( 'solr-client' ) ;// Create a clientconst client = solr . createClient ( ) ;// Add a new documentclient . add ( { id : 12 , title_t : 'Hello' } , function ...
java8 看不到源码Solr 引导程序 设置 Solr 搜索平台的 Ansible 角色 要求 系统上需要有Java，推荐角色yauh.java8。...solr ...solr_source: http://apache.openmirror.de/lucene/solr ...solr solr_version: ...load
SolrCloud是Apache Solr的一个扩展模块，它提供了一种简单的方式来构建可扩展、高可用的全文搜索应用。SolrCloud通过引入ZooKeeper作为协调服务来管理Solr实例集群，并实现了数据的自动恢复、负载均衡等功能，从而...
props.load(in); in.close(); String paramValue = props.getProperty("parameterName"); ``` Solr，一个流行的全文搜索引擎，其源码中包含了处理配置文件的丰富经验。Solr使用了Apache Commons Configuration库来...
传统架构中，Walmart eCommerce搜索系统使用Solr作为搜索引擎，使用Load-balanced Shard VIP来分布式处理搜索请求。然而，这种架构存在一些问题，如性能瓶颈、difficult troubleshooting、不必要的重定向和不断增加...
Hue提供了高可靠性的实现机制，包括HA（高可用性）和 Load Balancing等技术，确保Hue服务的稳定运行和高可用性。 Hue的安装与配置 Hue的安装与配置相对复杂，需要了解Hue的架构和组件关系，才能正确地安装和配置...
Flume通过transaction机制确保数据传输过程中无丢失，同时支持Sink的Failover和Load Balance，实现高可用性。 Flume的事件(Event)由Headers（包含元数据）和Payload组成，用户可以通过SDK定制Source、Sink，甚至...
在大数据环境中，合理配置资源是实现高效能的关键。以下是一些基本原则： **原则1：CPU核数分配原则** - **数据节点**: 建议预留2～4个核心给操作系统和其他进程（如数据库、HBase等），剩下的核心分配给YARN。 - *...
复制对等服务器从源hbase同步同步接收WAL编辑，并写入目标存储（例如：solr / kafka等） 最初的复制对等节点某个区域服务器角色 3 bulkload示例 bulkload方式从hive import hbase有现成的sql可以使用 如果输入是CSV...
Solr正在运行以进行开发和测试 开发Web服务器启动 当您编辑文件时，以上所有操作都会重新启动 bundle install bundle exec spring rake db:create bundle exec spring rake db:schema:load RAILS_ENV=test bundle ...
Pig Latin的结构由一系列语句组成，这些语句可以是操作（如LOAD、FILTER、JOIN）或者命令（如DUMP、DESCRIBE）。一条语句可以用分号结束，虽然不是所有语句都必须如此，比如交互式的Hadoop命令可以不加分号。对于...
ETL（Extract, Transform, Load）是大数据处理中非常关键的一个环节。本章介绍了Pentaho和Talend等ETL工具，通过这些工具可以轻松完成数据抽取、清洗、转换和加载等操作。 - **第11章：使用Hadoop进行报告生成** ...
- **大数据搜索技术**：如Solr、ElasticSearch等，提供高性能全文检索功能。 - **大数据图数据库技术**：如Neo4j、ArangoDB等，适合处理复杂的关系数据。 - **大数据数据挖掘技术**：如Apache Singa、TensorFlow等，...
"Collection-API-ETL"项目，即针对澳大利亚国家博物馆的公共Web API，构建了一套完整的数据处理流程，涵盖了提取（Extract）、转换（Transform）和加载（Load）三个关键步骤，简称ETL。本文将深入探讨这一过程及其...
Extract, Transform, Load (ETL) processes are fundamental in preparing data for analysis. This chapter discusses: - **Pentaho**: An open-source data integration tool that supports ETL processes. - **...