Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: throttle merge.   Results from 1 to 10 from 20 (0.301s).
Loading phrases to help you
refine your search...
[LUCENE-2898] CMS merge throttling is not aggressive enough - Lucene - [issue]
...I hit this crab while working on the NRT benchmarker (in luceneutil). CMS today forcefully idles any incoming threads, when there are too many merges pending. This is the last line...
... of defense that it has, since it also juggles thread priorities (and forcefully idles the biggest merges) to try to reduce the outstanding merge count. But when it cannot keep up it has no choice...
[+ show more]
http://issues.apache.org/jira/browse/LUCENE-2898    Author: Michael McCandless, 2011-03-30, 16:50
[LUCENE-6119] Add auto-io-throttle to ConcurrentMergeScheduler - Lucene - [issue]
... (RateLimiter). For example, an application that does hardly any indexing but finally triggered a large merge can afford to heavily throttle that large merge so it won't interfere with ongoing searches...
.... But an application that's causing IW to write new bytes at 50 MB/sec must set a correspondingly higher IO throttling otherwise merges will clearly fall behind....
[+ show more]
http://issues.apache.org/jira/browse/LUCENE-6119    Author: Michael McCandless, 2015-02-19, 20:45
[LUCENE-4472] Add setting that prevents merging on updateDocument - Lucene - [issue]
...Currently we always call maybeMerge if a segment was flushed after updateDocument. Some apps and in particular ElasticSearch uses some hacky workarounds to disable that ie for merge...
... throttling. It should be easier to enable this kind of behavior. ...
http://issues.apache.org/jira/browse/LUCENE-4472    Author: Simon Willnauer, 2013-01-24, 06:34
[LUCENE-6197] ConcurrentMergeScheduler should not stall its own merge threads! - Lucene - [issue]
...http://build-eu-00.elasticsearch.org/job/lucene_trunk_linux_java8_64_analyzers/25834 uncovered this issue. I accidentally introduced this with auto-IO-throttle (LUCENE-6119...
...) ... the CMS.maybeStall method, which is supposed to block "segment producing" threads so indexing slows down when merges cannot keep up, can now sometimes block its own merge threads.  This happens when...
[+ show more]
http://issues.apache.org/jira/browse/LUCENE-6197    Author: Michael McCandless, 2015-02-23, 05:02
[expand - 4 more] - ConcurrentMergeScheduler # getForceMergeMBPerSec() - Lucene - [javadoc] - [see source code]
...Get the per-merge IO throttle rate for forced merges. ...
http://search-lucene.com/jd/lu...entMergeScheduler.html#getForceMergeMBPerSec()   
Apache Lucene - - Lucene - [web site]
... handling and safer commits. Every Lucene segment now stores a unique id per-segment and per-commit to aid in accurate replication of index files. During merging, IndexWriter now always...
... checks the incoming segments for corruption before merging. This can mean, on upgrading to 5.0.0, that merging may uncover long-standing latent corruption in an older 4.x index. Reduced heap...
[+ show more]
http://lucene.apache.org/java/docs/corenews.html    2015-06-15, 16:47
Apache Lucene - - Lucene - [web site]
... handling and safer commits. Every Lucene segment now stores a unique id per-segment and per-commit to aid in accurate replication of index files. During merging, IndexWriter now always...
... checks the incoming segments for corruption before merging. This can mean, on upgrading to 5.0.0, that merging may uncover long-standing latent corruption in an older 4.x index. Reduced heap...
[+ show more]
http://lucene.apache.org/java/corenews.html    2015-06-15, 16:47
Apache Lucene - - Lucene - [web site]
... handling and safer commits. Every Lucene segment now stores a unique id per-segment and per-commit to aid in accurate replication of index files. During merging, IndexWriter now always...
... checks the incoming segments for corruption before merging. This can mean, on upgrading to 5.0.0, that merging may uncover long-standing latent corruption in an older 4.x index. Reduced heap...
[+ show more]
http://lucene.apache.org/core/corenews.html    2015-06-15, 16:47
Lucene Change Log - Lucene - [web site]
... or BEST_COMPRESSION for stored fields. (Adrien Grand, Robert Muir) LUCENE-6119: Add auto-IO-throttling to ConcurrentMergeScheduler, to rate limit IO writes for each merge depending on incoming merge rate...
... infoStream now also logs time to write FieldInfos during merge (Lee Hinman via Mike McCandless) LUCENE-6339: Added Near-real time Document Suggester via custom postings format (Areek Zillur, Mike...
[+ show more]
http://lucene.apache.org/core/5_2_1/changes/Changes.html    2015-06-14, 23:01
Lucene Change Log - Lucene - [web site]
.... (Lee Hinman via Adrien Grand) LUCENE-6341: Add a -fast option to CheckIndex. (Robert Muir) LUCENE-6355: IndexWriter's infoStream now also logs time to write FieldInfos during merge (Lee...
... fields and term vectors when merging segments without deletions. Lucene50Codec's BEST_COMPRESSION mode uses a higher deflate level for more compact storage. (Robert Muir) LUCENE-6184: Make...
[+ show more]
http://lucene.apache.org/core/5_2_0/changes/Changes.html    2015-06-06, 19:44
Sort:
project
ElasticSearch (141)
Solr (21)
Lucene (20)
ManifoldCF (1)
Nutch (1)
OpenRelevance (1)
type
issue (7)
web site (7)
source code (3)
mail # dev (2)
javadoc (1)
date
last 7 days (0)
last 30 days (5)
last 90 days (7)
last 6 months (12)
last 9 months (16)
author
Michael McCandless (6)
Anshum Gupta (1)
Shawn Heisey (1)
Simon Willnauer (1)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB