Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: throttle merge.   Results from 1 to 10 from 39 (0.502s).
Loading phrases to help you
refine your search...
Throttling merges - Lucene - [mail # dev]
...It may be useful to allow users to throttle merges. A callback that IW passes into SegmentMerger would suffice where individual SM methods make use of the callback. I suppose this could...
... slow down overall merging by adding a potentially useless method call. However if merging typically consumes IO resources for an extended period of time, this offers a way for the user to tune...
   Author: Jason Rutherglen, 2009-07-18, 14:37
Exposing merge throttling in Solr - Lucene - [mail # dev]
...Hi,  Lucene has segment merge throttling, but I think that's not exposed in Solr anywhere, is it?  Should I open a JIRA?  Otis  ...
   Author: Otis Gospodnetic, 2013-06-09, 03:08
[LUCENE-2898] CMS merge throttling is not aggressive enough - Lucene - [issue]
...I hit this crab while working on the NRT benchmarker (in luceneutil). CMS today forcefully idles any incoming threads, when there are too many merges pending. This is the last line...
... of defense that it has, since it also juggles thread priorities (and forcefully idles the biggest merges) to try to reduce the outstanding merge count. But when it cannot keep up it has no choice...
[+ show more]
http://issues.apache.org/jira/browse/LUCENE-2898    Author: Michael McCandless, 2011-03-30, 16:50
Re: IO bandwidth throttling - Lucene - [mail # user]
... see maxMergeDocs, but not maxBufferedDocs with the IndexWriter. Otis, is there really some parameter with that name? I think maxMergeDocs may not work well here because the size...
   Author: Gopikrishnan Subramani, 2005-08-02, 20:27
TestIdeas - Lucene - Lucene - [wiki]
... coverage in DW if tests are single threaded. Randomize FlushPolicy in RandomIndexWriter Add a MockRandomMergeScheduler IndexOutput should not write all bytes out on close() unless the file...
... is fsynced unless there an exception occurs. that way we might be able to detect fsync problems earlier Add ThrottledIndexInput just like ThrottledIndexOutput RandomIndexWriter should randomly...
[+ show more]
http://wiki.apache.org/lucene-java/TestIdeas    Author: MikeMcCandless, 2012-03-20, 16:21
ConcurrentMergeScheduler (Lucene 4.6.1 API) - Lucene - [web site]
... completes.   If more than getMaxMergeCount() merges are   requested then this class will forcefully throttle the   incoming threads by pausing until one more more merges   complete...
... ConcurrentMergeScheduler (Lucene 4.6.1 API) JavaScript is disabled on your browser. Overview Package Class Use Tree Deprecated Help PREV CLASS NEXT CLASS...
[+ show more]
http://lucene.apache.org/java/4_6_1/core/org/a.../ConcurrentMergeScheduler.html    2014-01-27, 20:11
ConcurrentMergeScheduler - Lucene - [javadoc] - [see source code]
...Count} merges are  requested then this class will forcefully throttle the  incoming threads by pausing until one more more merges  complete. ...
...A {@link MergeScheduler} that runs each merge using a  separate thread.  Specify the max number of threads that may run at  once, and the maximum number of simultaneous merges  with {@link...
[+ show more]
http://search-lucene.com/jd/lucene/core/org/ap.../ConcurrentMergeScheduler.html   
[LUCENE-4472] Add setting that prevents merging on updateDocument - Lucene - [issue]
...Currently we always call maybeMerge if a segment was flushed after updateDocument. Some apps and in particular ElasticSearch uses some hacky workarounds to disable that ie for merge...
... throttling. It should be easier to enable this kind of behavior. ...
http://issues.apache.org/jira/browse/LUCENE-4472    Author: Simon Willnauer, 2013-01-24, 06:34
Re: setSegmentsPerTier >= setMaxMergeAtOnce ? - Lucene - [mail # user]
... to bytes read-ahead, whether you have an SSD, whether you throttle merge rate (RateLimitedDirWrapper), etc.   Mike McCandless  http://blog.mikemccandless.com   On Sun, Jun 9, 2013 at 7:08 AM, Boaz...
...Hi Boaz,  That's correct!  But what is "too big" of a merge is an app-level decision / requires testing in the "real" context / depends on things like how much free RAM the OS can dedicate...
   Author: Michael McCandless, 2013-06-09, 12:31
Is ConcurrentMergeScheduler useful for multiple running IndexWriter's? - Lucene - [mail # user]
... IW.  I think this effectively disables CMS's max thread merge throttling feature?  ...
...ConcurrentMergeScheduler is tied to a specific IndexWriter, however if we're running in an environment (such as Solr's multiple cores, and other similar scenarios) then we'd have a CMS per...
   Author: Jason Rutherglen, 2011-03-04, 15:02
Sort:
project
ElasticSearch (142)
Lucene (39)
Solr (6)
ManifoldCF (2)
Nutch (1)
type
web site (18)
mail # user (9)
issue (5)
mail # dev (5)
javadoc (1)
wiki (1)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (17)
last 9 months (34)
author
Michael McCandless (6)
Jason Rutherglen (3)
Robert Muir (2)
Earwin Burrfoot (1)
Gopikrishnan Subramani (1)
Jake Mannix (1)
MikeMcCandless (1)
Otis Gospodnetic (1)
Paul_Murdoch@... (1)
Simon Willnauer (1)
builder@... (1)
jwang@... (1)