| clear query|facets|time |
Search criteria: tokenfilter.
Results from 11 to 20 from
23 (3.305s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Solr Trunk Heap Space Issues - Solr - [mail # user]
|
|
...On Mon, Oct 5, 2009 at 1:00 PM, Jeff Newburn wrote: Do you have any custom Analyzers, Tokenizers, TokenFilters? Another change is that token streams are reused by caching in a thread...
|
|
|
Author: Yonik Seeley,
2009-10-05, 17:32
|
|
|
Re: svn commit: r411882 - in /incubator/solr/trunk: CHANGES.txt src/java/org/apache/solr/analysis/KeywordTokenizerFactory.java src/test/org/apache/solr/BasicFunctionalityTest.java src/test/test-files/ - Solr - [mail # dev]
|
|
.... For simpler tokenizers or token filters, it would be nice to be able to use them directly. Perhaps we could look at the class type, and if it's a lucene Tokenizer or TokenFilter, try instantiating...
|
|
... it directly with newInstance(). At schema creation time, we should probably check if the specified Tokenizer or TokenFilter has a default constructor. If it doesn't we should throw an error right...
|
|
|
Author: Yonik Seeley,
2006-06-05, 19:30
|
|
|
Re: Analyzer thread safety; Stop words - Lucene - [mail # dev]
|
|
...On 11/29/06, Antony Bowesman wrote: But you can duplicate most Analyzers (all the ones in Lucene?) with a chain of Tokenizers and TokenFilters (since that is how almost all of them...
|
|
|
Author: Yonik Seeley,
2006-11-29, 21:35
|
|
|
Re: Searching with "1" - Lucene - [mail # dev]
|
|
...On 9/22/06, djd0383 wrote: It's often not the right thing to do, but it's all under your control. It depends on exactly what your analyzer looks like (what tokenizers and tokenfilters...
|
|
|
Author: Yonik Seeley,
2006-09-23, 00:47
|
|
|
Re: Using wildcard with accented words - Solr - [mail # user]
|
|
... be based on the TokenFilter level, then things like synonym filters, stemmers, etc, would do nothing. Perhaps add some new methods to BaseTokenFilterFactory to do prefix, wildcard, etc...
|
|
|
Author: Yonik Seeley,
2007-10-23, 01:03
|
|
|
DoubleMetaphone bugs? - Solr - [mail # dev]
|
|
...I'm converting many of the TokenFilters to the new Lucene attribute API... I'm currently on DoubleMetaphone, but something looks wrong. // If we did not add something, then go...
|
|
|
Author: Yonik Seeley,
2009-08-12, 20:29
|
|
|
Re: Solr is indexing XML only? - Solr - [mail # user]
|
|
... Read through the Solr example schema.xml and it should hopefully be apparent how to use it. If the additional content has nothing to do with HTML, it should be developed as a separate TokenFilter...
|
|
|
Author: Yonik Seeley,
2006-04-27, 13:55
|
|
|
Re: Payload API - Lucene - [mail # dev]
|
|
... in any case. A TokenFilter could reuse the same Payload object for each term in a Field, so the CPU allocation savings is closer to a single Payload per field using payloads. If we used...
|
|
|
Author: Yonik Seeley,
2007-11-20, 00:43
|
|
|
Re: Analyzer thread safety; Stop words - Lucene - [mail # dev]
|
|
... approach. TokenFilters are preffered over Analyzers.... you can plug them together in any way you see fit to solve your analysis problem. For Solr, an added bonus of using chains of filters...
|
|
|
Author: Yonik Seeley,
2006-11-30, 04:10
|
|
|
Re: Results (Re: Survey: Lucene and Java 1.4 vs. 1.5) - Lucene - [mail # dev]
|
|
...On 6/22/06, DM Smith wrote: Absolutely... I wrote some new code recently that uses Java 1.5 (ArrayQueue and BufferedTokenFilter) that is meant to make it easier to write TokenFilters...
|
|
|
Author: Yonik Seeley,
2006-06-23, 00:37
|
|
|
|
