Databases
StackOverflow2013
Postsdbo
POWhat is the easiest way to implement terms association mining in Solr?
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POWhat is the easiest way to implement terms association mining in Solr?
    primarykey
    data
    text
    <p><strong>Association mining</strong> seems to give good results for retrieving <strong>related terms</strong> in text corpora. There are several works on this topic including well-known <a href="http://en.wikipedia.org/wiki/Latent_semantic_analysis">LSA</a> method. The most straightforward way to mine associations is to build co-occurrence matrix of <code>docs X terms</code> and find terms that occur in the same documents most often. In my previous projects I implemented it directly in Lucene by iteration over TermDocs (I got it by calling <a href="http://lucene.apache.org/java/3_3_0/api/all/org/apache/lucene/index/IndexReader.html#termDocs%28org.apache.lucene.index.Term%29">IndexReader.termDocs(Term)</a>). But I can't see anything similar in Solr. </p> <p>So, my <em>needs</em> are:</p> <ol> <li>To retrieve the <strong>most associated terms</strong> within particular field. </li> <li>To retrieve the <strong>term, that is closest to the specified one</strong> within particular field. </li> </ol> <p>I will <em>rate answers</em> in the following way: </p> <ol> <li>Ideally I would like to find Solr's component that directly covers specified needs, that is, something to get associated terms directly. </li> <li>If this is not possible, I'm seeking for the way to get co-occurrence matrix information for specified field. </li> <li>If this is not an option too, I would like to know the most straightforward way to 1) get all terms and 2) get ids (numbers) of documents these terms occur in. </li> </ol>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. This table or related slice is empty.
    1. USffriend
    plurals
    1. This table or related slice is empty.
    1. PL
      singulars
      1. LTLinked
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    2. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POWhat is the easiest way to implement terms association mining in Solr?
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. POWhat is the easiest way to implement terms association mining in Solr?
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. POWhat is the easiest way to implement terms association mining in Solr?
      1. USXodarap
      1. VTFavorite
    1. COI googled the topic and I am awaiting the answer myself. BTW, Solr's clustering capabilities is described "as a way to group together semantically related results/documents". Not close enough, right?
      singulars
      1. POWhat is the easiest way to implement terms association mining in Solr?
      1. USaitchnyu
    2. COClustering is a bit different thing. First of all, it works with documents, not terms, so you cannot cluster terms (at least I can't see any sense in terms clustering and don't know easy way to do it with Solr). Though it seems like the opposite thing is possible: you can use association mining over terms to perform clustering over documents.
      singulars
      1. POWhat is the easiest way to implement terms association mining in Solr?
      1. USffriend
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload