https://issues.apache.org/jira/browse/LUCENE-3855

Ehm, either I'm going crazy or my machines are somehow different from
anybody else's ;)

If you have a spare cycle could you:

cd lucene
ant test-core -Dtestcase=TestStressNRT -Dtestmethod=test
-Dtests.seed=69468941c1bbf693:19e66d58475da929:69e9d2f81769b6d0
-Dargs="-Dfile.encoding=UTF-8"

A few times? In my case (a few different machines, different hardware,
JVMs, but all Linuxes) the above yields errors in about 25-30% of
executions.

Dawid

---------------------------------------------------------------------

Not a linux box, but -Dtests.iter=1000 and no failures on my
Macbook Pro.

FWIW
Erick

On Wed, Mar 7, 2012 at 5:52 PM, Dawid Weiss <[EMAIL PROTECTED]> wrote:
> https://issues.apache.org/jira/browse/LUCENE-3855
>
> Ehm, either I'm going crazy or my machines are somehow different from
> anybody else's ;)
>
> If you have a spare cycle could you:
>
> cd lucene
> ant test-core -Dtestcase=TestStressNRT -Dtestmethod=test
> -Dtests.seed=69468941c1bbf693:19e66d58475da929:69e9d2f81769b6d0
> -Dargs="-Dfile.encoding=UTF-8"
>
> A few times? In my case (a few different machines, different hardware,
> JVMs, but all Linuxes) the above yields errors in about 25-30% of
> executions.
>
> Dawid
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [EMAIL PROTECTED]
> For additional commands, e-mail: [EMAIL PROTECTED]
>

---------------------------------------------------------------------

I let it run for 100 or so iterations in a shell while loop, and I got zero failures.

This is on a Windows 7 box, 4 cores + HT (=> OS thinks 8 cores).

-----Original Message-----
From: Erick Erickson [mailto:[EMAIL PROTECTED]]
Sent: Thursday, March 08, 2012 7:45 AM
To: [EMAIL PROTECTED]
Subject: Re: TestStressNRT failures.

Not a linux box, but -Dtests.iter=1000 and no failures on my Macbook Pro.

FWIW
Erick

On Wed, Mar 7, 2012 at 5:52 PM, Dawid Weiss <[EMAIL PROTECTED]> wrote:
> https://issues.apache.org/jira/browse/LUCENE-3855
>
> Ehm, either I'm going crazy or my machines are somehow different from
> anybody else's ;)
>
> If you have a spare cycle could you:
>
> cd lucene
> ant test-core -Dtestcase=TestStressNRT -Dtestmethod=test
> -Dtests.seed=69468941c1bbf693:19e66d58475da929:69e9d2f81769b6d0
> -Dargs="-Dfile.encoding=UTF-8"
>
> A few times? In my case (a few different machines, different hardware,
> JVMs, but all Linuxes) the above yields errors in about 25-30% of
> executions.
>
> Dawid
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [EMAIL PROTECTED] For
> additional commands, e-mail: [EMAIL PROTECTED]
>

---------------------------------------------------------------------
mmands, e-mail: [EMAIL PROTECTED]
---------------------------------------------------------------------

> I let it run for 100 or so iterations in a shell while loop, and I got zero failures.

I couldn't repeat it on a similar Windows box as well.

Dawid

---------------------------------------------------------------------

I got a failure on second run:

    [junit] ------------- Standard Error -----------------
    [junit] NOTE: reproduce with: ant test -Dtestcase=TestStressNRT
-Dtestmethod=test
-Dtests.seed=69468941c1bbf693:19e66d58475da929:69e9d2f81769b6d0
-Dargs="-Dfile.encoding=UTF-8"
    [junit] NOTE: test params are: codec=Lucene3x,
sim=RandomSimilarityProvider(queryNorm=true,coord=false): {},
locale=ro, timezone=JST
    [junit] NOTE: all tests run in this JVM:
    [junit] [TestStressNRT]
    [junit] NOTE: Linux 2.6.42.3-2.fc15.x86_64 amd64/Sun Microsystems
Inc. 1.6.0_25 (64-bit)/cpus=4,threads=1,free=92473168,total=165806080
    [junit] ------------- ---------------- ---------------
    [junit] Testcase:
test(org.apache.lucene.index.TestStressNRT): Caused an ERROR
    [junit] MockDirectoryWrapper: cannot close: there are still open
files: {_a6.frq=1, _a6.fdx=1, _a6.fdt=1, _a6.tis=1}
    [junit] java.lang.RuntimeException: MockDirectoryWrapper: cannot
close: there are still open files: {_a6.frq=1, _a6.fdx=1, _a6.fdt=1,
_a6.tis=1}
    [junit] at
org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:555)
    [junit] at
org.apache.lucene.index.TestStressNRT.test(TestStressNRT.java:385)
    [junit] at
org.apache.lucene.util.LuceneTestCase$SubclassSetupTeardownRule$1.evaluate(LuceneTestCase.java:743)
    [junit] at
org.apache.lucene.util.LuceneTestCase$InternalSetupTeardownRule$1.evaluate(LuceneTestCase.java:639)
    [junit] at
org.apache.lucene.util.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:22)
    [junit] at
org.apache.lucene.util.LuceneTestCase$TestResultInterceptorRule$1.evaluate(LuceneTestCase.java:538)
    [junit] at
org.apache.lucene.util.LuceneTestCase$RememberThreadRule$1.evaluate(LuceneTestCase.java:600)
    [junit] at
org.apache.lucene.util.LuceneTestCaseRunner.runChild(LuceneTestCaseRunner.java:164)
    [junit] at
org.apache.lucene.util.LuceneTestCaseRunner.runChild(LuceneTestCaseRunner.java:57)
    [junit] at
org.apache.lucene.util.StoreClassNameRule$1.evaluate(StoreClassNameRule.java:21)
    [junit] at
org.apache.lucene.util.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:22)
    [junit] Caused by: java.lang.RuntimeException: unclosed IndexInput: _a6.tis
    [junit] at
org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:479)
    [junit] at
org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:504)
    [junit] at
org.apache.lucene.codecs.lucene3x.TermInfosReader.<init>(TermInfosReader.java:112)
    [junit] at
org.apache.lucene.codecs.lucene3x.Lucene3xFields.<init>(Lucene3xFields.java:84)
    [junit] at
org.apache.lucene.codecs.lucene3x.PreFlexRWPostingsFormat$1.<init>(PreFlexRWPostingsFormat.java:51)
    [junit] at
org.apache.lucene.codecs.lucene3x.PreFlexRWPostingsFormat.fieldsProducer(PreFlexRWPostingsFormat.java:51)
    [junit] at
org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:108)
    [junit] at
org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:51)
    [junit] at
org.apache.lucene.index.IndexWriter$ReadersAndLiveDocs.getMergeReader(IndexWriter.java:521)
    [junit] at
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3587)
    [junit] at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3257)
    [junit] at
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:382)
    [junit] at
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:451)
    [junit]
    [junit]
    [junit] Test org.apache.lucene.index.TestStressNRT FAILED

--
 Sami Siren

---------------------------------------------------------------------

The test seems to fail in different ways, here's couple more examples:

    [junit] ------------- Standard Error -----------------
    [junit] NOTE: reproduce with: ant test -Dtestcase=TestStressNRT
-Dtestmethod=test
-Dtests.seed=69468941c1bbf693:19e66d58475da929:69e9d2f81769b6d0
-Dargs="-Dfile.encoding=UTF-8"
    [junit] NOTE: test params are: codec=Lucene3x,
sim=RandomSimilarityProvider(queryNorm=true,coord=false): {},
locale=ro, timezone=JST
    [junit] NOTE: all tests run in this JVM:
    [junit] [TestStressNRT]
    [junit] NOTE: Linux 2.6.42.3-2.fc15.x86_64 amd64/Sun Microsystems
Inc. 1.6.0_25 (64-bit)/cpus=4,threads=1,free=104981544,total=194838528
    [junit] ------------- ---------------- ---------------
    [junit] Testcase:
test(org.apache.lucene.index.TestStressNRT): Caused an ERROR
    [junit] MockDirectoryWrapper: cannot close: there are still open
files: {_27.frq=1, _27.tis=1, _27.fdt=1, _27.fdx=1, _27.tvx=1,
_eq.cfs=8, _27.tvd=1, _27.tvf=1}
    [junit] java.lang.RuntimeException: MockDirectoryWrapper: cannot
close: there are still open files: {_27.frq=1, _27.tis=1, _27.fdt=1,
_27.fdx=1, _27.tvx=1, _eq.cfs=8, _27.tvd=1, _27.tvf=1}
    [junit] at
org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:555)
    [junit] at
org.apache.lucene.index.TestStressNRT.test(TestStressNRT.java:385)
    [junit] at
org.apache.lucene.util.LuceneTestCase$SubclassSetupTeardownRule$1.evaluate(LuceneTestCase.java:743)
    [junit] at
org.apache.lucene.util.LuceneTestCase$InternalSetupTeardownRule$1.evaluate(LuceneTestCase.java:639)
    [junit] at
org.apache.lucene.util.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:22)
    [junit] at
org.apache.lucene.util.LuceneTestCase$TestResultInterceptorRule$1.evaluate(LuceneTestCase.java:538)
    [junit] at
org.apache.lucene.util.LuceneTestCase$RememberThreadRule$1.evaluate(LuceneTestCase.java:600)
    [junit] at
org.apache.lucene.util.LuceneTestCaseRunner.runChild(LuceneTestCaseRunner.java:164)
    [junit] at
org.apache.lucene.util.LuceneTestCaseRunner.runChild(LuceneTestCaseRunner.java:57)
    [junit] at
org.apache.lucene.util.StoreClassNameRule$1.evaluate(StoreClassNameRule.java:21)
    [junit] at
org.apache.lucene.util.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:22)
    [junit] Caused by: java.lang.RuntimeException: unclosed IndexInput: _27.frq
    [junit] at
org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:479)
    [junit] at
org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:504)
    [junit] at
org.apache.lucene.codecs.lucene3x.Lucene3xFields.<init>(Lucene3xFields.java:96)
    [junit] at
org.apache.lucene.codecs.lucene3x.PreFlexRWPostingsFormat$1.<init>(PreFlexRWPostingsFormat.java:51)
    [junit] at
org.apache.lucene.codecs.lucene3x.PreFlexRWPostingsFormat.fieldsProducer(PreFlexRWPostingsFormat.java:51)
    [junit] at
org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:108)
    [junit] at
org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:51)
    [junit] at
org.apache.lucene.index.IndexWriter$ReadersAndLiveDocs.getMergeReader(IndexWriter.java:521)
    [junit] at
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3587)
    [junit] at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3257)
    [junit] at
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:382)
    [junit] at
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:451)
    [junit]
    [junit]
    [junit] Test org.apache.lucene.index.TestStressNRT FAILED
    [junit] ------------- Standard Error -----------------
    [junit] NOTE: reproduce with: ant test -Dtestcase=TestStressNRT
-Dtestmethod=test
-Dtests.seed=69468941c1bbf693:19e66d58475da929:69e9d2f81769b6d0
-Dargs="-Dfile.encoding=UTF-8"
    [junit] NOTE: test params are: codec=Lucene3x,
sim=RandomSimilarityProvider(queryNorm=true,coord=false): {},
locale=ro, timezone=JST
    [junit] NOTE: all tests run in this JVM:
    [junit] [TestStressNRT]
    [junit] NOTE: Linux 2.6.42.3-2.fc15.x86_64 amd64/Sun Microsystems
Inc. 1.6.0_25 (64-bit)/cpus=4,threads=1,free=151905320,total=195821568
    [junit] ------------- ---------------- ---------------
    [junit] Testcase: test(org.apache.lucene.index.TestStressNRT): FAILED
    [junit] info=_ir(4.0):Cv23/3 isn't live
    [junit] junit.framework.AssertionFailedError: info=_ir(4.0):Cv23/3
isn't live
    [junit] at
org.apache.lucene.index.IndexWriter$ReaderPool.infoIsLive(IndexWriter.java:663)
    [junit] at
org.apache.lucene.index.IndexWriter$ReaderPool.dropAll(IndexWriter.java:717)
    [junit] at
org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1136)
    [junit] at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1069)
    [junit] at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1033)
    [junit] at
org.apache.lucene.index.RandomIndexWriter.close(RandomIndexWriter.java:408)
    [junit] at
org.apache.lucene.index.TestStressNRT.test(TestStressNRT.java:380)
    [junit] at
org.apache.lucene.util.LuceneTestCase$SubclassSetupTeardownRule$1.evaluate(LuceneTestCase.java:743)
    [junit] at
org.apache.lucene.util.LuceneTestCase$InternalSetupTeardownRule$1.evaluate(LuceneTestCase.java:639)
    [junit] at
org.apache.lucene.util.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:22)
    [junit] at
org.apache.lucene.util.LuceneTestCase$TestResultInterceptorRule$1.evaluate(LuceneTestCase.java:538)
    [junit] at
org.apache.lucene.util.LuceneTestCase$RememberThreadRule$1.evaluate(LuceneTestCase.java:600)
    [junit] at
org.apache.lucene.util.LuceneTestCaseRunner.runChild(LuceneTestCaseRunner.java:164)
    [junit] at
org.apache.lucene.util.LuceneTestCaseR

> The test seems to fail in different ways, here's couple more examples:

Yes, it does. They all seem to be related to CMS though -- I attached
a few stacks to the issue.

Thanks for helping Sami (and everyone).

Dawid

---------------------------------------------------------------------

I also don't get any failures. I ran the test on a linux box (latest
checkout) and with -Dtests.iter=1000

Martijn

On 8 March 2012 13:45, Erick Erickson <[EMAIL PROTECTED]> wrote:

> Not a linux box, but -Dtests.iter=1000 and no failures on my
> Macbook Pro.
>
> FWIW
> Erick
>
> On Wed, Mar 7, 2012 at 5:52 PM, Dawid Weiss <[EMAIL PROTECTED]> wrote:
> > https://issues.apache.org/jira/browse/LUCENE-3855
> >
> > Ehm, either I'm going crazy or my machines are somehow different from
> > anybody else's ;)
> >
> > If you have a spare cycle could you:
> >
> > cd lucene
> > ant test-core -Dtestcase=TestStressNRT -Dtestmethod=test
> > -Dtests.seed=69468941c1bbf693:19e66d58475da929:69e9d2f81769b6d0
> > -Dargs="-Dfile.encoding=UTF-8"
> >
> > A few times? In my case (a few different machines, different hardware,
> > JVMs, but all Linuxes) the above yields errors in about 25-30% of
> > executions.
> >
> > Dawid
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: [EMAIL PROTECTED]
> > For additional commands, e-mail: [EMAIL PROTECTED]
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [EMAIL PROTECTED]
> For additional commands, e-mail: [EMAIL PROTECTED]
>
>
--
Met vriendelijke groet,

Martijn van Groningen

> I also don't get any failures. I ran the test on a linux box (latest
> checkout) and with -Dtests.iter=1000

Did you run with any of the known failing seeds though? For example this one?

-Dtests.seed=69468941c1bbf693:19e66d58475da929:69e9d2f81769b6d0
-Dargs="-Dfile.encoding=UTF-8"

Dawid

---------------------------------------------------------------------