`

advanced act_as_solr

    博客分类:
  • RoR
阅读更多

原文出处:http://www.quarkruby.com/2007/9/14/advanced-acts_as_solr

This article extends our acts_as_solr : search and faceting tutorial and talks about how to manage rails associations, solr indexes and more with acts_as_solr.

Table Of Contents

  1. Rebuild Solr index
  2. Import existing Solr index or your custom Solr schema.xml
  3. Highlight search term
  4. Rails associations and acts_as_solr
  5. Tips

Rebuild Solr Index

rebuild_solr_index is a class method to re-build your model indexes on import of external data.

For large tables rebuilding Solr index is a time consuming process. See the fifth line in the pseudo code below (index optimization call), it makes rebuild_solr_index a slow process. For large tables, you do not want optimization to take place for each object added to the table. Whereas, removing optimization calls slows down the process of updating solr index.

1
2
3
4
5
6
7
## pseudo code
def rebuild_solr_index
  for_each_row_in_table do |doc|
    doc.save_to_solr_index
    index.optimize
  end
end

The solution to the problem is to use batch_size in #rebuild_solr_index. With batch size, say for example 100, the index optimization call is executed after indexing 100 rows.

If you do not want to index the complete data but only few rows based on conditions, use optional arguments batch_size and finder in rebuild_solr_index.

  • batch_size : to optimize index after adding batch_size items. Default value is 1.
  • finder : it is used for conditional indexation. It takes a method as argument which returns objects to be indexed. Default method is :
    1
    2
    3
    
    def finder(ar, options)
      ar.find (:all, options.merge({:order => self.primary_key}))
    end

Import existing Solr index or your custom Solr schema.xml

Assumption: Column names in table definition are same as the names of the fields using which index has been/will be created.

  • Add your indexed fields to vendor/plugins/acts_as_solr/solr/solr/conf/schema.xml (continuing with example of our previous tutorial, we add name1, brand, resolution to schema.xml).
    Remember, to copy them to text field using solr's copyfield directive. text is the default field/column in which search is made, so using copyField we add all data to default search field. The new schema.xml looks like...
    1
    2
    3
    4
    5
    6
    7
    8
    
    <field name="text" type="text" indexed="true" stored="true" multiValued="true"/> 
    <field name="name1" type="text" indexed="true" stored="false" />
    <field name="brand" type="string" indexed="true" stored="false" />
    <field name="resolution" type="sfloat" indexed="true" stored="false" />
    
    <copyField source="*_facet" dest="text"/>
    <copyField source="brand" dest="text"/>
    <copyField source="name1" dest="text"/>
  • Apply our patch (download). For indexing and searching, acts_as_solr suffixes dataType (e.g. int, float, string etc) of column to the column name, this patch tells acts_as_solr not to do this since we have explicitly created entries for these columns in schema file:
    1
    2
    
    cd /path/to/rails/dir
    patch -p0 custom-schema.patch
  • Modify your acts_as_solr definition:
    1
    2
    3
    
    class Camera
      acts_as_solr :custom_schema=>true, :fields=>[:name,:brand,:resolution]
    end
  • ... and it works!

 

Highlight search terms

Goal is to highlight search term(s) in search results. Follow the steps below :

  • Modify solrConfig.xml to enable highlighting. Apply our patch (download) as:
    1
    2
    
    cd /path/to/rails/dir
    patch -p0 highlight-solrconfig.patch
  • acts_as_solr does not stores any of the field values as it is in its index. We need to modify the configuration file vendor/plugins/acts_as_solr/solr/solr/conf/schema.xml to enable storage of data, which is required to return the highlighted text data. For example, we modify configuration file to store the fields having text dataType to get highlighted matching terms for name1 field.
    1
    2
    3
    4
    
    <!-- Original config -->
    <dynamicField name="*_t" type="text" indexed="true" stored="false"/>
    <!-- New config -->
    <dynamicField name="*_t" type="text" indexed="true" stored="true"/>
  • Apply one more patch in the same way as the previous one. This patch enables acts_as_solr to handle the option of highlighting in find_by_solr queries and parses the results returned by solr. And now we are ready to roar...

  • Lets see it in action with an example
    1
    2
    3
    4
    5
    6
    7
    8
    9
    
    @results = Camera.find_by_solr("canon powershot", :highlight=>{:fields=>"name1"})
    @results.highlights
    ## returns hash of objects id and hash of the columns with matched text data
    {1=>{:name1=>"<em>Canon</em> <em>Powershot</em> sd1000"} ... }
    
    #You want to display names with highlighted terms:
    @results.docs.each do |doc|
       <%= @results.highlights[doc.id][:name1]  -%><br/>
    end
  • Options for highlighting (You can also refer them here)
    1. fields: columns to highlight terms for (default is none, and no highlighted text)
    2. prefix: You do not want to have "<em>" tag around matched search term(s), tell your tag here. (eg. "<span class='highlight'>")
    3. suffix: Ending tag for matched term(s)
    4. max_snippets: stop searching the column after max_snippets matched terms found
    Currenlty acts_as_solr does not implements these options at each column level, so you cannot ask to apply some of the options to only one (or few) columns. For e.g. you cannot ask acts_as_solr to use <em> tags for one field and <span class='highlight'> for other field.

 


Note: If you want both the functionalities Custom schema and Highlighting together, use these two patches. Patch 1 and Patch 2.

Rails associations and acts_as_solr

Lets say I have two models, User (columns: username, password) and UserProfile (columns: full name, location, favorite food .... and many more). These two models have one-to-one association (:has_one, :belongs_to) between them and I have two problems :

  1. When searching the User model, I also want to search UserProfile model.
  2. I want to allow faceting based on few columns in UserProfile lets say location and favorite food.

     

Fabio Confalonieri has written a small hack for the solution to both the problems along with good explanation.

Tips:

  1. Wanna see the statistics for created index?
    Download

  2. If your search results are not good enough because the text is not indexed properly, it might be due to presence of acronyms or words having apostrophes or html content in your data. Solr provides you with many options for analyzing and modifying text before it is indexed and searched. Read these options at Solr's Wiki page. Remember, you need to make these modifications in schema.xml file.

  3. Note : The default behaviour of acts_as_solr is to index model objects automatically upon save or update of a record.

<!---->

this xsl file as luke.xsl to vendor/plugins/acts_as_solr/solr/solr/conf/xslt/ and then open url: http://localhost:8982/solr/admin/luke?wt=xslt&tr=luke.xsl
分享到:
评论

相关推荐

    ikanalyzer-solr8.4.0_solr8_solr_ikanalyzer_中文分词_

    Solr8.4.0 是 Apache Solr 的一个版本,这是一个高度可配置、高性能的全文搜索和分析引擎,广泛用于构建企业级搜索应用。 在 Solr 中,ikanalyzer 是一个重要的组件,它通过自定义Analyzer来实现中文的分词处理。...

    solr-config_solrj-demo.rar_DEMO_solr_solr的j

    总之,"solr-config_solrj-demo.rar_DEMO_solr_solr的j"这个DEMO是一个全面了解和实践Solr配置及SolrJ使用的宝贵资源,它将引导你逐步掌握如何在实际项目中有效地运用Solr进行全文检索和数据分析。通过深入学习和...

    hive-solr-master.zip_hive_solr_solr-hive

    CREATE EXTERNAL TABLE solr_table (field1 STRING, field2 INT) STORED BY 'org.apache.hive.storage.solr.SolrStorageHandler' TBLPROPERTIES ( 'solr.zookeeper'='zk_host:zk_port/solr', 'solr.collection'='...

    solr服务器_solr_

    Solr服务器是Apache Lucene项目的一个子项目,是一款开源的企业级搜索平台,专门用于处理大量文本数据的全文检索、搜索和分析。它基于Java开发,能够处理多种数据源,包括XML、JSON、CSV等,提供了高效、可扩展的...

    sss.rar_solr_solr search

    **Solr:开源企业搜索引擎** Apache Solr,作为一款强大的开源全文搜索引擎,广泛应用于各种企业和组织,用于构建高效、可扩展的搜索解决方案。本教程旨在深入解析Solr的核心概念、功能以及实际应用,帮助读者掌握...

    solr_solr_lucene_

    Solr是一个高性能,采用Java开发,基于Lucene的全文搜索服务器。同时对其进行了扩展,提供了比Lucene更为丰富的查询语言,同时实现了可配置、可扩展并对查询性能进行了优化,并且提供了一个完善的功能管理界面,是一...

    es与solr的区别_solr_ES_es与solr的区别_elasticsearch_

    **Elasticsearch 与 Solr 比较详解** 在大数据和搜索引擎领域,Elasticsearch (ES) 和 Apache Solr 都是广泛使用的开源技术,它们都基于 Lucene 库,提供高性能、可扩展的全文搜索和分析能力。然而,两者在设计哲学...

    php_solr.dll

    windows环境php5.5的php_solr.dll

    ansj_solr_all

    《ANSJ与Solr的深度整合:构建高效全文搜索引擎》 在信息爆炸的时代,如何高效地从海量数据中检索出我们需要的信息,成为了企业和个人都亟待解决的问题。这就是全文搜索引擎的作用所在。ANSJ(Automatic NLP ...

    php_solr.dll ,php5.3版本

    Apache Solr 是一个开源的企业级搜索平台,它允许快速、可扩展的全文检索,以及丰富的搜索功能和结果排序。在 PHP 中集成 Solr 扩展,可以极大地提高开发效率,使开发者能够轻松地在网站中实现高级搜索功能。 标题...

    solr_Tomcat_lib包

    在搭建Solr环境时,`solr_Tomcat_lib`包扮演了关键角色,因为它是Solr在Tomcat容器中运行所需的库文件集合。 首先,让我们详细了解`lib`目录。这个目录通常包含Solr运行所必需的各种JAR文件,这些文件主要分为以下...

    bhl_rails_solr-源码.rar

    3. **app/models/solr_document.rb**:定义了Solr文档对象,用于映射Rails模型到Solr索引。 4. **config目录**:配置文件,如solr.yml,用于配置Solr服务器的连接信息。 5. **initializers/solr.rb**:初始化脚本,...

    acts_as_solr_reloaded:具有新功能的ActsAsSolr

    script/plugin install git://github.com/brauliobo/acts_as_solr_reloaded.git 下载Solr rake solr:download 要求 Oracle或OpenJDK的Java Runtime Environment(JRE)6.0(或更高版本) 配置 请参阅config

    Apache_solr_4_cookbook.pdf

    Apache Solr 是一个基于 Apache Lucene 的开源搜索引擎,为各种应用提供了搜索功能。它具有高效、可靠和强大的特点,广泛应用于企业级搜索、互联网搜索和数据分析。Solr 提供了包括全文搜索、高亮显示、自动拼写更正...

    Apache_Solr_初级教程

    ### Apache Solr 初级教程知识点总结 #### 一、Apache Solr 概述 - **全文检索技术的重要性**:随着互联网的发展,信息量日益膨胀,如何高效地从海量信息中提取有价值的内容变得至关重要。全文检索技术作为一种...

    apache-solr-1.4.0.zip_apache-solr _apache-solr-1.4.0_apache-solr

    Apache Solr 是一个开源的企业级搜索平台,由Apache软件基金会开发。它基于Java,并且是Lucene库的一个高级封装,提供了更加便捷和可扩展的全文检索、数据分析和搜索功能。在1.4.0版本中,Solr已经相当成熟,为用户...

    Lucene_Solr_搜索引擎解密.ppt

    Lucene Solr 搜索引擎解密 ppt

    solr_v440_5001+zookeeper2181

    在每个Solr节点上,我们需要配置solr.in.sh(在Unix/Linux系统中)或solr.in.cmd(在Windows系统中),设置`SOLR_HOME`、`JAVA_OPTS`等环境变量,并指定ZooKeeper集群的位置。 3. **启动SolrCloud**:启动每个Solr...

    solr_开发入门例子

    本文将基于"solr_开发入门例子"这一主题,详细解释Solr的基础知识,包括其核心概念、安装配置、索引创建与查询,以及相关的开发工具。 1. **Solr核心概念** - **索引**: Solr通过建立倒排索引来实现快速全文检索。...

    solr_3.5_配置及应用

    Solr 是一个开源的全文搜索引擎,它提供了高效且可扩展的搜索和索引能力。在3.5版本中,Solr 已经成为一个成熟的技术,广泛应用于网站的全文检索、商品搜索、文档检索等多个场景。本文将深入探讨 Solr 3.5 的配置...

Global site tag (gtag.js) - Google Analytics