Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: throttle merge.   Results from 1 to 10 from 31 (0.251s).
Loading phrases to help you
refine your search...
[LUCENE-2898] CMS merge throttling is not aggressive enough - Lucene - [issue]
...I hit this crab while working on the NRT benchmarker (in luceneutil). CMS today forcefully idles any incoming threads, when there are too many merges pending. This is the last line...
... of defense that it has, since it also juggles thread priorities (and forcefully idles the biggest merges) to try to reduce the outstanding merge count. But when it cannot keep up it has no choice...
[+ show more]
http://issues.apache.org/jira/browse/LUCENE-2898    Author: Michael McCandless, 2011-03-30, 16:50
[LUCENE-6119] Add auto-io-throttle to ConcurrentMergeScheduler - Lucene - [issue]
...Limiter). For example, an application that does hardly any indexing but finally triggered a large merge can afford to heavily throttle that large merge so it won't interfere with ongoing searches...
.... But an application that's causing IW to write new bytes at 50 MB/sec must set a correspondingly higher IO throttling otherwise merges will clearly fall behind....
[+ show more]
http://issues.apache.org/jira/browse/LUCENE-6119    Author: Michael McCandless, 2015-02-19, 20:45
TestIdeas - Lucene - Lucene - [wiki]
... coverage in DW if tests are single threaded. Randomize FlushPolicy in RandomIndexWriter Add a MockRandomMergeScheduler IndexOutput should not write all bytes out on close() unless the file...
... is fsynced unless there an exception occurs. that way we might be able to detect fsync problems earlier Add ThrottledIndexInput just like ThrottledIndexOutput RandomIndexWriter should randomly...
[+ show more]
http://wiki.apache.org/lucene-java/TestIdeas    Author: MikeMcCandless, 2012-03-20, 16:21
[expand - 1 more] - ConcurrentMergeScheduler - Lucene - [javadoc] - [see source code]
...Count} merges are  requested then this class will forcefully throttle the  incoming threads by pausing until one more more merges  complete. ...
...A {@link MergeScheduler} that runs each merge using a  separate thread.  Specify the max number of threads that may run at  once, and the maximum number of simultaneous merges  with {@link...
[+ show more]
http://search-lucene.com/jd/lucene/core/org/ap.../ConcurrentMergeScheduler.html   
[LUCENE-4472] Add setting that prevents merging on updateDocument - Lucene - [issue]
...Currently we always call maybeMerge if a segment was flushed after updateDocument. Some apps and in particular ElasticSearch uses some hacky workarounds to disable that ie for merge...
... throttling. It should be easier to enable this kind of behavior. ...
http://issues.apache.org/jira/browse/LUCENE-4472    Author: Simon Willnauer, 2013-01-24, 06:34
ConcurrentMergeScheduler (Lucene 4.6.1 API) - Lucene - [web site]
... completes.   If more than getMaxMergeCount() merges are   requested then this class will forcefully throttle the   incoming threads by pausing until one more more merges   complete...
... ConcurrentMergeScheduler (Lucene 4.6.1 API) JavaScript is disabled on your browser. Overview Package Class Use Tree Deprecated Help PREV CLASS NEXT CLASS...
[+ show more]
http://lucene.apache.org/java/4_6_1/core/org/a.../ConcurrentMergeScheduler.html    2014-01-27, 20:11
[LUCENE-6197] ConcurrentMergeScheduler should not stall its own merge threads! - Lucene - [issue]
...http://build-eu-00.elasticsearch.org/job/lucene_trunk_linux_java8_64_analyzers/25834 uncovered this issue. I accidentally introduced this with auto-IO-throttle (LUCENE-6119) ... the CMS...
....maybeStall method, which is supposed to block "segment producing" threads so indexing slows down when merges cannot keep up, can now sometimes block its own merge threads.  This happens when the merge...
[+ show more]
http://issues.apache.org/jira/browse/LUCENE-6197    Author: Michael McCandless, 2015-02-23, 05:02
Index of /core/4_6_1/test-framework/org/apache/lucene/util/class-use - Lucene - [web site]
....7K   English.html 2014-01-27 20:11   4.6K   FailOnNonBulkMergesInfoStream.html 2014-01-27 20:11   4.8K   LineFileDocs.html 2014-01-27 20:11   4.6K   LuceneJUnit3Method...
...:11   7.7K   TestRuleStoreClassName.html 2014-01-27 20:11   4.7K   TestSecurityManager.html 2014-01-27 20:11   4.7K   ThrottledIndexOutput.html 2014-01-27 20:11   6.9K   Time...
http://lucene.apache.org/java/4_6_1/test-framework/org/apache/lucene/util/c.../   
Index of /core/4_6_1/test-framework/org/apache/lucene/util - Lucene - [web site]
...                                                   -    BaseDocIdSetTestCase.html                     2014-01-27 20:11   48K    English.html                                  2014-01-27 20:11   12K    FailOnNonBulkMerges...
...SecurityManager.html                      2014-01-27 20:11   22K    ThrottledIndexOutput.html                     2014-01-27 20:11   31K    TimeUnits.html                                2014-01-27 20:11   11K    _Test...
http://lucene.apache.org/java/4_6_1/test-framework/org/apache/lucene/util/   
org.apache.lucene.util (Lucene 4.6.1 API) - Lucene - [web site]
...org.apache.lucene.util Interfaces TestRuleIgnoreTestSuites.NestedTestSuite Classes _TestUtil BaseDocIdSetTestCase English FailOnNonBulkMergesInfoStream LineFileDocs Lucene...
...RuleIgnoreAfterMaxFailures TestRuleIgnoreTestSuites TestRuleMarkFailure TestRuleStoreClassName TestSecurityManager ThrottledIndexOutput TimeUnits Annotation Types LuceneTestCase.AwaitsFix Lucene...
http://lucene.apache.org/java/4_6_1/test-framework/org/ap.../package-frame.html    2014-01-27, 20:11
Sort:
project
ElasticSearch (205)
Solr (37)
Lucene (31)
ManifoldCF (2)
Nutch (2)
type
web site (18)
issue (8)
mail # dev (3)
javadoc (1)
wiki (1)
date
last 7 days (0)
last 30 days (0)
last 90 days (2)
last 6 months (6)
last 9 months (28)
author
Michael McCandless (6)
Anshum Gupta (1)
MikeMcCandless (1)
Per Steffensen (1)
Robert Muir (1)
Shawn Heisey (1)
Simon Willnauer (1)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB