Databases
StackOverflow2013
Postsdbo
POSolr NGram filtering not matching search term
Body
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POSolr NGram filtering not matching search term
    text
    copied!<p>I have NGram filtering enabled for a keywords field I am indexing, which contains the following comma separated terms:</p> <p>wwwdebenhams.com, ebenhams.com, dbenhams.com, deenhams.com, debnhams.com, debehams.com, debenams.com, debenhms.com, debenhas.com, debenham.com, debenhams.ocm, debenhams.con, debenhams.comn, debenhams.copm, debenhams.comm, debenhams.coom, debenhams.xom, debenhams.cpm, ebenhams.com, dbenhams.com, deenhams.com, debnhams.com, debehams.com, debenams.com, debenhms.com, debenhas.com, debenham.com,</p> <p>The schema for the core looks like this:</p> <pre><code>&lt;?xml version="1.0" ?&gt; &lt;schema name="merchant" version="1.0"&gt; &lt;types&gt; &lt;!-- Default numeric field types. For faster range queries, consider the tint/tfloat/tlong/tdouble types. --&gt; &lt;fieldType name="int" class="solr.TrieIntField" precisionStep="0" positionIncrementGap="0"/&gt; &lt;fieldType name="text_lowercase_ngram" class="solr.TextField" termPositions="false" omitNorms="true"&gt; &lt;analyzer type="index"&gt; &lt;tokenizer class="solr.WhitespaceTokenizerFactory"/&gt; &lt;filter class="solr.WordDelimiterFilterFactory" splitOnCaseChange="0" splitOnNumerics="0" stemEnglishPossessive="0" generateWordParts="1" generateNumberParts="1" catenateWords="0" catenateNumbers="0" catenateAll="0" preserveOriginal="1" types="wdfftypes.txt" /&gt; &lt;filter class="solr.NGramFilterFactory" minGramSize="3" maxGramSize="20"/&gt; &lt;/analyzer&gt; &lt;analyzer type="query"&gt; &lt;tokenizer class="solr.WhitespaceTokenizerFactory"/&gt; &lt;filter class="solr.WordDelimiterFilterFactory" splitOnCaseChange="0" splitOnNumerics="0" stemEnglishPossessive="0" generateWordParts="1" generateNumberParts="1" catenateWords="0" catenateNumbers="0" catenateAll="0" preserveOriginal="1" types="wdfftypes.txt" /&gt; &lt;filter class="solr.NGramFilterFactory" minGramSize="3" maxGramSize="20"/&gt; &lt;/analyzer&gt; &lt;/fieldType&gt; &lt;fieldType name="text_exact" class="solr.TextField"&gt; &lt;analyzer&gt; &lt;tokenizer class="solr.KeywordTokenizerFactory"/&gt; &lt;/analyzer&gt; &lt;/fieldType&gt; &lt;/types&gt; &lt;fields&gt; &lt;!-- Merchant Fields --&gt; &lt;field name="id" type="int" indexed="true" stored="true" required="true"/&gt; &lt;field name="site_id" type="int" indexed="true" stored="true" required="true"/&gt; &lt;field name="title" type="text_lowercase_ngram" indexed="true" stored="true"/&gt; &lt;field name="url" type="text_exact" indexed="true" stored="true"/&gt; &lt;field name="keywords" type="text_lowercase_ngram" indexed="true" stored="true" /&gt; &lt;field name="description" type="text_lowercase_ngram" indexed="true" stored="true" /&gt; &lt;field name="type" type="int" indexed="true" stored="true"/&gt; &lt;field name="popularity" type="int" indexed="true" stored="true"/&gt; &lt;field name="category" type="text_exact" indexed="true" stored="true" multiValued="true"/&gt; &lt;/fields&gt; &lt;!-- field to use to determine and enforce document uniqueness. --&gt; &lt;uniqueKey&gt;id&lt;/uniqueKey&gt; &lt;!-- field for the QueryParser to use when an explicit fieldname is absent --&gt; &lt;defaultSearchField&gt;title&lt;/defaultSearchField&gt; &lt;!-- SolrQueryParser configuration: defaultOperator="AND|OR" --&gt; &lt;solrQueryParser defaultOperator="OR"/&gt; </code></pre> <p></p> <p>Searching 'deb' returns the matching document with a score of 6.4406505. Searching 'debe', 'deben', 'debenh' and 'debenha' returns no results. Searching 'debenham' returns the matching document with a score of 41.740173 and 'debenhams' returns the document with a score of 111.30711.</p> <p>I have tried using the query analyzer which shows matching terms for each of the above queries, yet I am not seeing the matching document coming back in the results. Is there a way I can return ALL documents with corresponding scores regardless of whether they are a positive match or not in order to better understand why they are not being returned?</p>
 

Querying!

 
Guidance
An individual column

Larger individual text columns get their own page to allow for proper reading.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload