Hi Everyone,

A candidate for the Apache Nutch 2.0 RC2 is available at:

http://people.apache.org/~lewismc/apache-nutch-2.0rc2

The release candidate is a src.zip and src.tar.gz ONLY
archive of the sources in:

http://svn.apache.org/repos/asf/nutch/tags/release-2.0rc2

We release Nutch 2.0 in this fashion due to the inclusion of
Apache Gora and the likelihood that users will regularly recompile
the code to suit dynamic requirements.

Further, a staged Maven repository of the 2.0 jar, sources.jar and
javadoc.jar is available here:

https://repository.apache.org/content/repositories/orgapachenutch-244/

Please vote on releasing this package as Apache Nutch 2.0.
The vote is open for the next 72 hours and passes if a majority of at
least three +1 Nutch PMC votes are cast.

 [ ] +1 Release this package as Apache Nutch 2.0
 [ ] -1 Do not release this package because...

Many Thanks and heres to plenty more.

Kind Regards,
Lewis

P.S. Here's my +1.

Hi Lewis

The tests still fail but will be fixed with
https://issues.apache.org/jira/browse/NUTCH-1399 and I don't think it is a
blocker.
The signatures are fine and the content of the Maven repo looks OK .

+1 for releasing

Thanks a lot.

Julien

On 15 June 2012 13:48, lewis john mcgibbney <[EMAIL PROTECTED]> wrote:

> Hi Everyone,
>
> A candidate for the Apache Nutch 2.0 RC2 is available at:
>
> http://people.apache.org/~lewismc/apache-nutch-2.0rc2
>
> The release candidate is a src.zip and src.tar.gz ONLY
> archive of the sources in:
>
> http://svn.apache.org/repos/asf/nutch/tags/release-2.0rc2
>
> We release Nutch 2.0 in this fashion due to the inclusion of
> Apache Gora and the likelihood that users will regularly recompile
> the code to suit dynamic requirements.
>
> Further, a staged Maven repository of the 2.0 jar, sources.jar and
> javadoc.jar is available here:
>
> https://repository.apache.org/content/repositories/orgapachenutch-244/
>
> Please vote on releasing this package as Apache Nutch 2.0.
> The vote is open for the next 72 hours and passes if a majority of at
> least three +1 Nutch PMC votes are cast.
>
>  [ ] +1 Release this package as Apache Nutch 2.0
>  [ ] -1 Do not release this package because...
>
> Many Thanks and heres to plenty more.
>
> Kind Regards,
> Lewis
>
> P.S. Here's my +1.
>

--
*
*Open Source Solutions for Text Engineering

http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
http://twitter.com/digitalpebble

Hi,

Tested it with HBase but there is a slight issue with the dependencies.
After building rc2 with ivy-enabled HBase, it seems a test HBase jar is
deployed in local/lib, even though it's called hbase-0.90.4.jar. (I do not
know yet how this is caused!) But since a user should have a separate HBase
installation anyway, I don't think it's a blocker for now. A user should
simply copy its HBase core lib from the HBase installation into the
local/lib directory. This works for me. We should add this to
http://wiki.apache.org/nutch/GORA_HBase (btw does anyone know why I cannot
edit this one anymore?)

Crawling/parsing works fine after the workaround, so +1 from me. If anyone
disagrees with the above, I'm fine with that too and fixing it prior to
releasing.

Ferdy

On Mon, Jun 18, 2012 at 11:23 AM, Julien Nioche <
[EMAIL PROTECTED]> wrote:

> Hi Lewis
>
> The tests still fail but will be fixed with
> https://issues.apache.org/jira/browse/NUTCH-1399 and I don't think it is
> a blocker.
> The signatures are fine and the content of the Maven repo looks OK .
>
> +1 for releasing
>
> Thanks a lot.
>
> Julien
>
>
> On 15 June 2012 13:48, lewis john mcgibbney <[EMAIL PROTECTED]> wrote:
>
>> Hi Everyone,
>>
>> A candidate for the Apache Nutch 2.0 RC2 is available at:
>>
>> http://people.apache.org/~lewismc/apache-nutch-2.0rc2
>>
>> The release candidate is a src.zip and src.tar.gz ONLY
>> archive of the sources in:
>>
>> http://svn.apache.org/repos/asf/nutch/tags/release-2.0rc2
>>
>> We release Nutch 2.0 in this fashion due to the inclusion of
>> Apache Gora and the likelihood that users will regularly recompile
>> the code to suit dynamic requirements.
>>
>> Further, a staged Maven repository of the 2.0 jar, sources.jar and
>> javadoc.jar is available here:
>>
>> https://repository.apache.org/content/repositories/orgapachenutch-244/
>>
>> Please vote on releasing this package as Apache Nutch 2.0.
>> The vote is open for the next 72 hours and passes if a majority of at
>> least three +1 Nutch PMC votes are cast.
>>
>>  [ ] +1 Release this package as Apache Nutch 2.0
>>  [ ] -1 Do not release this package because...
>>
>> Many Thanks and heres to plenty more.
>>
>> Kind Regards,
>> Lewis
>>
>> P.S. Here's my +1.
>>
>
>
>
> --
> *
> *Open Source Solutions for Text Engineering
>
> http://digitalpebble.blogspot.com/
> http://www.digitalpebble.com
> http://twitter.com/digitalpebble
>
>

+1
with a documentation issue about the dependencies:

> simply copy its HBase core lib from the HBase installation into the
> local/lib directory. This works for me.
Removing lib/hbase-0.90.4.jar and copying hbase-0.94.jar from the HBase installation
into lib/ caused a
 Exception in thread "main" java.lang.NoSuchMethodError:
    org.apache.hadoop.hbase.HColumnDescriptor.setMaxVersions(I)V
Which version of HBase are you using?

> After building rc2 with ivy-enabled HBase, it seems a test HBase jar is
> deployed in local/lib, even though it's called hbase-0.90.4.jar.
In my case, it's definitely HBase 0.90.4

Trying to run Nutch with hbase-0.90.4.jar and HBase 0.94 installed
also failed (see
http://mail-archives.apache.org/mod_mbox/hbase-user/201201.mbox/%[EMAIL PROTECTED]%3E).

>From the wiki:
> (N.B. Gora 0.2 uses HBase 0.90.4, however the setup is known to work
> with more recent versions of HBase.)
We should specify which versions are definitely working when following the
procedure in the tutorial. It's not the user's task to try it out.

Sebastian
On 06/18/2012 12:27 PM, Ferdy Galema wrote:
> Hi,
>
> Tested it with HBase but there is a slight issue with the dependencies.
> After building rc2 with ivy-enabled HBase, it seems a test HBase jar is
> deployed in local/lib, even though it's called hbase-0.90.4.jar. (I do not
> know yet how this is caused!) But since a user should have a separate HBase
> installation anyway, I don't think it's a blocker for now. A user should
> simply copy its HBase core lib from the HBase installation into the
> local/lib directory. This works for me. We should add this to
> http://wiki.apache.org/nutch/GORA_HBase (btw does anyone know why I cannot
> edit this one anymore?)
>
> Crawling/parsing works fine after the workaround, so +1 from me. If anyone
> disagrees with the above, I'm fine with that too and fixing it prior to
> releasing.
>
> Ferdy
>
> On Mon, Jun 18, 2012 at 11:23 AM, Julien Nioche <
> [EMAIL PROTECTED]> wrote:
>
>> Hi Lewis
>>
>> The tests still fail but will be fixed with
>> https://issues.apache.org/jira/browse/NUTCH-1399 and I don't think it is
>> a blocker.
>> The signatures are fine and the content of the Maven repo looks OK .
>>
>> +1 for releasing
>>
>> Thanks a lot.
>>
>> Julien
>>
>>
>> On 15 June 2012 13:48, lewis john mcgibbney <[EMAIL PROTECTED]> wrote:
>>
>>> Hi Everyone,
>>>
>>> A candidate for the Apache Nutch 2.0 RC2 is available at:
>>>
>>> http://people.apache.org/~lewismc/apache-nutch-2.0rc2
>>>
>>> The release candidate is a src.zip and src.tar.gz ONLY
>>> archive of the sources in:
>>>
>>> http://svn.apache.org/repos/asf/nutch/tags/release-2.0rc2
>>>
>>> We release Nutch 2.0 in this fashion due to the inclusion of
>>> Apache Gora and the likelihood that users will regularly recompile
>>> the code to suit dynamic requirements.
>>>
>>> Further, a staged Maven repository of the 2.0 jar, sources.jar and
>>> javadoc.jar is available here:
>>>
>>> https://repository.apache.org/content/repositories/orgapachenutch-244/
>>>
>>> Please vote on releasing this package as Apache Nutch 2.0.
>>> The vote is open for the next 72 hours and passes if a majority of at
>>> least three +1 Nutch PMC votes are cast.
>>>
>>>  [ ] +1 Release this package as Apache Nutch 2.0
>>>  [ ] -1 Do not release this package because...
>>>
>>> Many Thanks and heres to plenty more.
>>>
>>> Kind Regards,
>>> Lewis
>>>
>>> P.S. Here's my +1.
>>>
>>
>>
>>
>> --
>> *
>> *Open Source Solutions for Text Engineering
>>
>> http://digitalpebble.blogspot.com/
>> http://www.digitalpebble.com
>> http://twitter.com/digitalpebble
>>
>>
>

Hi,

Responses inline.

On Mon, Jun 18, 2012 at 10:51 PM, Sebastian Nagel <
[EMAIL PROTECTED]> wrote:

> +1
> with a documentation issue about the dependencies:
>
> > simply copy its HBase core lib from the HBase installation into the
> > local/lib directory. This works for me.
> Removing lib/hbase-0.90.4.jar and copying hbase-0.94.jar from the HBase
> installation
> into lib/ caused a
>  Exception in thread "main" java.lang.NoSuchMethodError:
>    org.apache.hadoop.hbase.HColumnDescriptor.setMaxVersions(I)V
> Which version of HBase are you using?
>

I've tested with the official 0.90.4. (Just the one that should be included
using ivy.xml). I will check for certain at my workstation tomorrow.

>
> > After building rc2 with ivy-enabled HBase, it seems a test HBase jar is
> > deployed in local/lib, even though it's called hbase-0.90.4.jar.
> In my case, it's definitely HBase 0.90.4
>

Weird. Do you clean the build properly? I get HBaseConfiguration class not
found exceptions after building and running local jobs. (Because it's not
in the hbase jar that is).

Trying to run Nutch with hbase-0.90.4.jar and HBase 0.94 installed
> also failed (see
>
> http://mail-archives.apache.org/mod_mbox/hbase-user/201201.mbox/%[EMAIL PROTECTED]%3E
> ).
>
> From the wiki:
> > (N.B. Gora 0.2 uses HBase 0.90.4, however the setup is known to work
> > with more recent versions of HBase.)
>

That's right. However for RC testing and for instructions I'd like to use
the ivy.xml supplied versions.
> We should specify which versions are definitely working when following the
> procedure in the tutorial. It's not the user's task to try it out.
>
> I agree. But again, I like to stick to a single version. It's already
pretty darn hard to support a single version of HBase (dependency wise for
example), let alone multiple versions.

Sebastian
>
>
Thanks,
Ferdy.
>
> On 06/18/2012 12:27 PM, Ferdy Galema wrote:
> > Hi,
> >
> > Tested it with HBase but there is a slight issue with the dependencies.
> > After building rc2 with ivy-enabled HBase, it seems a test HBase jar is
> > deployed in local/lib, even though it's called hbase-0.90.4.jar. (I do
> not
> > know yet how this is caused!) But since a user should have a separate
> HBase
> > installation anyway, I don't think it's a blocker for now. A user should
> > simply copy its HBase core lib from the HBase installation into the
> > local/lib directory. This works for me. We should add this to
> > http://wiki.apache.org/nutch/GORA_HBase (btw does anyone know why I
> cannot
> > edit this one anymore?)
> >
> > Crawling/parsing works fine after the workaround, so +1 from me. If
> anyone
> > disagrees with the above, I'm fine with that too and fixing it prior to
> > releasing.
> >
> > Ferdy
> >
> > On Mon, Jun 18, 2012 at 11:23 AM, Julien Nioche <
> > [EMAIL PROTECTED]> wrote:
> >
> >> Hi Lewis
> >>
> >> The tests still fail but will be fixed with
> >> https://issues.apache.org/jira/browse/NUTCH-1399 and I don't think it
> is
> >> a blocker.
> >> The signatures are fine and the content of the Maven repo looks OK .
> >>
> >> +1 for releasing
> >>
> >> Thanks a lot.
> >>
> >> Julien
> >>
> >>
> >> On 15 June 2012 13:48, lewis john mcgibbney <[EMAIL PROTECTED]> wrote:
> >>
> >>> Hi Everyone,
> >>>
> >>> A candidate for the Apache Nutch 2.0 RC2 is available at:
> >>>
> >>> http://people.apache.org/~lewismc/apache-nutch-2.0rc2
> >>>
> >>> The release candidate is a src.zip and src.tar.gz ONLY
> >>> archive of the sources in:
> >>>
> >>> http://svn.apache.org/repos/asf/nutch/tags/release-2.0rc2
> >>>
> >>> We release Nutch 2.0 in this fashion due to the inclusion of
> >>> Apache Gora and the likelihood that users will regularly recompile
> >>> the code to suit dynamic requirements.
> >>>
> >>> Further, a staged Maven repository of the 2.0 jar, sources.jar and
> >>> javadoc.jar is available here:
> >>>
> >>> https://repository.apache.org/content/repositories/orgapachenutch-244/

Hi Ferdy,

On Mon, Jun 18, 2012 at 11:27 AM, Ferdy Galema <[EMAIL PROTECTED]>wrote:

> Tested it with HBase but there is a slight issue with the dependencies.
> After building rc2 with ivy-enabled HBase, it seems a test HBase jar is
> deployed in local/lib, even though it's called hbase-0.90.4.jar. (I do not
> know yet how this is caused!)
>

This actually happened to me a while back when we were fixing the upgrade
to gora-0.2 dependencies... for some reason Ivy was pulling gora-core, it
was packaged as gora-core but for some reason the tests were pulled... I
got absolutely no feedback from the guys at ivy-user so I just left it
until it suddenly seemed to resolve and we were able to upgrade.

> But since a user should have a separate HBase installation anyway, I don't
> think it's a blocker for now. A user should simply copy its HBase core lib
> from the HBase installation into the local/lib directory.
>

+1 we will document this.
> This works for me. We should add this to
> http://wiki.apache.org/nutch/GORA_HBase (btw does anyone know why I
> cannot edit this one anymore?)
>

The tutorial has now changed to http://wiki.apache.org/nutch/Nutch2Tutorial,
this is covered in the README within 2.X

Can you please give me your wiki username and I'll add you to the AdminGroup
>
> Crawling/parsing works fine after the workaround, so +1 from me. If anyone
> disagrees with the above, I'm fine with that too and fixing it prior to
> releasing.
>
> Ferdy
>
>