Home | About | Sematext search-lucene.com search-hadoop.com search-devops.com metrics + logs = try SPM and Logsene for free
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: throttle merge.   Results from 1 to 10 from 20 (0.884s).
Loading phrases to help you
refine your search...
[LUCENE-2898] CMS merge throttling is not aggressive enough - Lucene - [issue]
...I hit this crab while working on the NRT benchmarker (in luceneutil). CMS today forcefully idles any incoming threads, when there are too many merges pending. This is the last line...
... of defense that it has, since it also juggles thread priorities (and forcefully idles the biggest merges) to try to reduce the outstanding merge count. But when it cannot keep up it has no choice...
[+ show more]
http://issues.apache.org/jira/browse/LUCENE-2898    Author: Michael McCandless, 2011-03-30, 16:50
[LUCENE-6119] Add auto-io-throttle to ConcurrentMergeScheduler - Lucene - [issue]
... (RateLimiter). For example, an application that does hardly any indexing but finally triggered a large merge can afford to heavily throttle that large merge so it won't interfere with ongoing searches...
.... But an application that's causing IW to write new bytes at 50 MB/sec must set a correspondingly higher IO throttling otherwise merges will clearly fall behind....
[+ show more]
http://issues.apache.org/jira/browse/LUCENE-6119    Author: Michael McCandless, 2015-02-19, 20:45
[LUCENE-4472] Add setting that prevents merging on updateDocument - Lucene - [issue]
...Currently we always call maybeMerge if a segment was flushed after updateDocument. Some apps and in particular ElasticSearch uses some hacky workarounds to disable that ie for merge...
... throttling. It should be easier to enable this kind of behavior. ...
http://issues.apache.org/jira/browse/LUCENE-4472    Author: Simon Willnauer, 2013-01-24, 06:34
[LUCENE-6197] ConcurrentMergeScheduler should not stall its own merge threads! - Lucene - [issue]
...http://build-eu-00.elasticsearch.org/job/lucene_trunk_linux_java8_64_analyzers/25834 uncovered this issue. I accidentally introduced this with auto-IO-throttle (LUCENE-6119...
...) ... the CMS.maybeStall method, which is supposed to block "segment producing" threads so indexing slows down when merges cannot keep up, can now sometimes block its own merge threads.  This happens when...
[+ show more]
http://issues.apache.org/jira/browse/LUCENE-6197    Author: Michael McCandless, 2015-02-23, 05:02
Apache Lucene - - Lucene - [web site]
... the previous defaults (tuned for spinning disks). Auto-IO-throttling has been added to ConcurrentMergeScheduler, to rate limit IO writes for each merge depending on incoming merge rate...
.... Every Lucene segment now stores a unique id per-segment and per-commit to aid in accurate replication of index files. During merging, IndexWriter now always checks the incoming segments...
[+ show more]
http://lucene.apache.org/java/docs/corenews.html    2016-01-24, 02:42
Apache Lucene - - Lucene - [web site]
... the previous defaults (tuned for spinning disks). Auto-IO-throttling has been added to ConcurrentMergeScheduler, to rate limit IO writes for each merge depending on incoming merge rate...
.... Every Lucene segment now stores a unique id per-segment and per-commit to aid in accurate replication of index files. During merging, IndexWriter now always checks the incoming segments...
[+ show more]
http://lucene.apache.org/java/corenews.html    2016-01-24, 02:42
Apache Lucene - - Lucene - [web site]
... the previous defaults (tuned for spinning disks). Auto-IO-throttling has been added to ConcurrentMergeScheduler, to rate limit IO writes for each merge depending on incoming merge rate...
.... Every Lucene segment now stores a unique id per-segment and per-commit to aid in accurate replication of index files. During merging, IndexWriter now always checks the incoming segments...
[+ show more]
http://lucene.apache.org/core/corenews.html    2016-01-24, 02:42
Re: [JENKINS] Lucene-Solr-Tests-5.x-Java7 - Build # 2215 - Still Failing - Lucene - [mail # dev]
..., in LuceneTestCase's newIndexWriterConfig, I sometimes randomly subclass ConcurrentMergeScheduler (to turn off merge throttling) in the random IWC that's returned.  Does this make Solr unhappy?  Why is Solr...
... trying to instantiate the merge scheduler class that's already instantiated on IWC?  I'm confused... Mike McCandless http://blog.mikemccandless.com On Wed, Nov 19, 2014 at 1:00 PM, Alan...
   Author: Michael McCandless, 2014-11-19, 18:11
Lucene Change Log - Lucene - [web site]
..., Adrien Grand) LUCENE-6579: IndexWriter now sacrifices (closes) itself to protect the index when an unexpected, tragic exception strikes while merging. (Robert Muir, Mike McCandless) LUCENE...
..., Mike McCandless) LUCENE-6645: Optimized the way we merge postings lists in multi-term queries and TermsQuery. This should especially help when there are lots of small postings lists. (Adrien...
[+ show more]
http://lucene.apache.org/core/5_3_2/changes/Changes.html    2016-01-24, 00:50
Lucene Change Log - Lucene - [web site]
...: Speed up SlowCompositeReaderWrapper.getSortedSetDocValues() by avoiding merging FieldInfos just to check doc value type. (Paul Vasilyev, Yuriy Pakhomov, Mikhail Khludnev, yonik)   Bug Fixes...
...: RangeTreeWriter was failing to close all file handles it opened, leading to intermittent failures on Windows (Dawid Weiss, Robert Muir, Mike McCandless) LUCENE-6826: Fix ClassCastException when merging...
[+ show more]
http://lucene.apache.org/core/5_4_1/changes/Changes.html    2016-01-22, 15:13
Sort:
project
ElasticSearch (120)
Solr (24)
Lucene (20)
ManifoldCF (1)
Nutch (1)
OpenRelevance (1)
author
Michael McCandless (7)
Anshum Gupta (1)
Shawn Heisey (1)
Simon Willnauer (1)
type
web site (10)
issue (7)
mail # dev (3)
date
last 7 days (0)
last 30 days (5)
last 90 days (5)
last 6 months (6)
last 9 months (20)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB