StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

POPHP word index, performance and reasonable results
text
Body
copied!<p>I'm currently working on an indexer for a search feature. The indexer will work over data from "fields". Fields looks like:</p> <pre><code> Field_id Field_type Field_name Field_Data - 101 text Name Intel i7 - 102 integer Cores 4 physical, 4 virtual - 103 select Vendor Intel - 104 multitext Description The i7 is intel's next gen range of cpus. </code></pre> <p>The indexer would generate the following results/index:</p> <pre><code> Keyword Occurrences - intel 101, 103, 104 - i7 101, 104 - physical 102 - virtual 102 - next 104 - gen 104 - range 104 - cpus 104 (*) - cpu 104 (*) </code></pre> <p>So it somewhat looks all nice and fine, however, there are some issues which I'd like to sort out:</p> <ul> <li>filtering out common words (as you perhaps noticed, "the" "is" "of" and "intel's" are missing from list)</li> <li>With regards to "cpus" (plurals vs singulars), would it be best to use a particular type (singular or plural), both or exact (ie, "cpus" is different "cpu")?</li> <li>Continuing with previous item, how can I determine a plural (different flavors: test=>tests fish=>fish and leaf=>leaves)</li> <li>I'm currently using MySql and I'm <strong>very concerned</strong> with performance issues; we have 500+ categories and we didn't even launch the site</li> <li>Let's say I wanted to use the search term "vendor:intel", where vendor specifies the field name (field_name), do you think there would be a huge impact on the sql server?</li> <li>Search throttling; I don't like this at all, but it's a possibility, and if you know of any workarounds, make yourself heard!</li> <li>There were other issues which I probably forgot about, if you spot any, you're welcome to yell at me ;-)</li> <li>I do not need the search engine to crawl links, in fact, I <strong>specifically want it to not crawl links</strong>.</li> </ul> <p><em>(by the way, I'm not biased towards intel, it simply happens that I own an i7-based pc ;-) )</em></p>

Querying!

Guidance

An individual column

Larger individual text columns get their own page to allow for proper reading.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload