Good Evening Everyone,

A candidate for the Apache Nutch 2.0 RC1 is available at:

http://people.apache.org/~lewismc/nutch-2.0

The release candidate is a src.zip, bin.zip, src.tar.gz and bin.tar.gz
archive of the sources in:

http://svn.apache.org/repos/asf/nutch/tags/release-2.0rc1

Further, a staged Maven repository of the 2.0 jar, sources.jar and
javadoc.jar is available here:

https://repository.apache.org/content/repositories/orgapachenutch-215

Please vote on releasing this package as Apache Nutch 2.0.
The vote is open for the next 72 hours and passes if a majority of at
least three +1 Nutch PMC votes are cast.

 [ ] +1 Release this package as Apache Nutch 2.0
 [ ] -1 Do not release this package because...

Many Thanks and heres to plenty more.

Have a great weekend, Kind Regards,
Lewis

P.S. Here's my +1.

Hi Everyone,

I appreciate that most of the core dev's are using trunk, however I
would appeal to you guys to at least check out the artifacts and check
sigs, tests, license headers if possible. Although this does not fully
satisfy the requirements of a thoroughly reviewed RC, hopefully the
thorough stuff can be undertaken by those directly using the artifacts
and code in development/production.

Thanks very much in advance

Best

Lewis

On Fri, Jun 8, 2012 at 3:49 PM, lewis john mcgibbney <[EMAIL PROTECTED]> wrote:
> Good Evening Everyone,
>
> A candidate for the Apache Nutch 2.0 RC1 is available at:
>
> http://people.apache.org/~lewismc/nutch-2.0
>
> The release candidate is a src.zip, bin.zip, src.tar.gz and bin.tar.gz
> archive of the sources in:
>
> http://svn.apache.org/repos/asf/nutch/tags/release-2.0rc1
>
> Further, a staged Maven repository of the 2.0 jar, sources.jar and
> javadoc.jar is available here:
>
> https://repository.apache.org/content/repositories/orgapachenutch-215
>
> Please vote on releasing this package as Apache Nutch 2.0.
> The vote is open for the next 72 hours and passes if a majority of at
> least three +1 Nutch PMC votes are cast.
>
>  [ ] +1 Release this package as Apache Nutch 2.0
>  [ ] -1 Do not release this package because...
>
> Many Thanks and heres to plenty more.
>
> Have a great weekend, Kind Regards,
> Lewis
>
> P.S. Here's my +1.

--
Lewis

Hey Lewis,

I will get to this tonight, for sure.

Thanks!

Cheers,
Chris

On Jun 12, 2012, at 1:16 PM, Lewis John Mcgibbney wrote:

> Hi Everyone,
>
> I appreciate that most of the core dev's are using trunk, however I
> would appeal to you guys to at least check out the artifacts and check
> sigs, tests, license headers if possible. Although this does not fully
> satisfy the requirements of a thoroughly reviewed RC, hopefully the
> thorough stuff can be undertaken by those directly using the artifacts
> and code in development/production.
>
> Thanks very much in advance
>
> Best
>
> Lewis
>
> On Fri, Jun 8, 2012 at 3:49 PM, lewis john mcgibbney <[EMAIL PROTECTED]> wrote:
>> Good Evening Everyone,
>>
>> A candidate for the Apache Nutch 2.0 RC1 is available at:
>>
>> http://people.apache.org/~lewismc/nutch-2.0
>>
>> The release candidate is a src.zip, bin.zip, src.tar.gz and bin.tar.gz
>> archive of the sources in:
>>
>> http://svn.apache.org/repos/asf/nutch/tags/release-2.0rc1
>>
>> Further, a staged Maven repository of the 2.0 jar, sources.jar and
>> javadoc.jar is available here:
>>
>> https://repository.apache.org/content/repositories/orgapachenutch-215
>>
>> Please vote on releasing this package as Apache Nutch 2.0.
>> The vote is open for the next 72 hours and passes if a majority of at
>> least three +1 Nutch PMC votes are cast.
>>
>>  [ ] +1 Release this package as Apache Nutch 2.0
>>  [ ] -1 Do not release this package because...
>>
>> Many Thanks and heres to plenty more.
>>
>> Have a great weekend, Kind Regards,
>> Lewis
>>
>> P.S. Here's my +1.
>
>
>
> --
> Lewis
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: [EMAIL PROTECTED]
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Thank you

On Tue, Jun 12, 2012 at 9:19 PM, Mattmann, Chris A (388J)
<[EMAIL PROTECTED]> wrote:
> Hey Lewis,
>
> I will get to this tonight, for sure.
>
> Thanks!
>
> Cheers,
> Chris
>
> On Jun 12, 2012, at 1:16 PM, Lewis John Mcgibbney wrote:
>
>> Hi Everyone,
>>
>> I appreciate that most of the core dev's are using trunk, however I
>> would appeal to you guys to at least check out the artifacts and check
>> sigs, tests, license headers if possible. Although this does not fully
>> satisfy the requirements of a thoroughly reviewed RC, hopefully the
>> thorough stuff can be undertaken by those directly using the artifacts
>> and code in development/production.
>>
>> Thanks very much in advance
>>
>> Best
>>
>> Lewis
>>
>> On Fri, Jun 8, 2012 at 3:49 PM, lewis john mcgibbney <[EMAIL PROTECTED]> wrote:
>>> Good Evening Everyone,
>>>
>>> A candidate for the Apache Nutch 2.0 RC1 is available at:
>>>
>>> http://people.apache.org/~lewismc/nutch-2.0
>>>
>>> The release candidate is a src.zip, bin.zip, src.tar.gz and bin.tar.gz
>>> archive of the sources in:
>>>
>>> http://svn.apache.org/repos/asf/nutch/tags/release-2.0rc1
>>>
>>> Further, a staged Maven repository of the 2.0 jar, sources.jar and
>>> javadoc.jar is available here:
>>>
>>> https://repository.apache.org/content/repositories/orgapachenutch-215
>>>
>>> Please vote on releasing this package as Apache Nutch 2.0.
>>> The vote is open for the next 72 hours and passes if a majority of at
>>> least three +1 Nutch PMC votes are cast.
>>>
>>>  [ ] +1 Release this package as Apache Nutch 2.0
>>>  [ ] -1 Do not release this package because...
>>>
>>> Many Thanks and heres to plenty more.
>>>
>>> Have a great weekend, Kind Regards,
>>> Lewis
>>>
>>> P.S. Here's my +1.
>>
>>
>>
>> --
>> Lewis
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: [EMAIL PROTECTED]
> WWW:   http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>

--
Lewis

Hi Lewis,

my first steps with 2.0 (to be continued, still struggling).

Two points (I'll try to give a final vote tomorrow):

1 some guidance would be nice. README.txt points
to http://wiki.apache.org/nutch/NutchTutorial which refers to 1.x
(I'm using http://sujitpal.blogspot.de/2012/01/exploring-nutch-gora-with-cassandra.html)

2 the package contains your nutch-site.xml:
    <name>http.agent.email</name>
    <value>[EMAIL PROTECTED]</value>
I guess that's not intended :)

Cheers,
Sebastian

On 06/12/2012 10:16 PM, Lewis John Mcgibbney wrote:
> Hi Everyone,
>
> I appreciate that most of the core dev's are using trunk, however I
> would appeal to you guys to at least check out the artifacts and check
> sigs, tests, license headers if possible. Although this does not fully
> satisfy the requirements of a thoroughly reviewed RC, hopefully the
> thorough stuff can be undertaken by those directly using the artifacts
> and code in development/production.
>
> Thanks very much in advance
>
> Best
>
> Lewis
>
> On Fri, Jun 8, 2012 at 3:49 PM, lewis john mcgibbney <[EMAIL PROTECTED]> wrote:
>> Good Evening Everyone,
>>
>> A candidate for the Apache Nutch 2.0 RC1 is available at:
>>
>> http://people.apache.org/~lewismc/nutch-2.0
>>
>> The release candidate is a src.zip, bin.zip, src.tar.gz and bin.tar.gz
>> archive of the sources in:
>>
>> http://svn.apache.org/repos/asf/nutch/tags/release-2.0rc1
>>
>> Further, a staged Maven repository of the 2.0 jar, sources.jar and
>> javadoc.jar is available here:
>>
>> https://repository.apache.org/content/repositories/orgapachenutch-215
>>
>> Please vote on releasing this package as Apache Nutch 2.0.
>> The vote is open for the next 72 hours and passes if a majority of at
>> least three +1 Nutch PMC votes are cast.
>>
>>  [ ] +1 Release this package as Apache Nutch 2.0
>>  [ ] -1 Do not release this package because...
>>
>> Many Thanks and heres to plenty more.
>>
>> Have a great weekend, Kind Regards,
>> Lewis
>>
>> P.S. Here's my +1.
>
>
>

Hey Guys,

#2 is probably reason enough for a respin.

Lewis if you don't have time to do it before Thursday, I could probably
give it a whack. Let me know.

Cheers,
Chris

On Jun 12, 2012, at 3:33 PM, Sebastian Nagel wrote:

> Hi Lewis,
>
> my first steps with 2.0 (to be continued, still struggling).
>
> Two points (I'll try to give a final vote tomorrow):
>
> 1 some guidance would be nice. README.txt points
> to http://wiki.apache.org/nutch/NutchTutorial which refers to 1.x
> (I'm using http://sujitpal.blogspot.de/2012/01/exploring-nutch-gora-with-cassandra.html)
>
> 2 the package contains your nutch-site.xml:
>    <name>http.agent.email</name>
>    <value>[EMAIL PROTECTED]</value>
> I guess that's not intended :)
>
> Cheers,
> Sebastian
>
> On 06/12/2012 10:16 PM, Lewis John Mcgibbney wrote:
>> Hi Everyone,
>>
>> I appreciate that most of the core dev's are using trunk, however I
>> would appeal to you guys to at least check out the artifacts and check
>> sigs, tests, license headers if possible. Although this does not fully
>> satisfy the requirements of a thoroughly reviewed RC, hopefully the
>> thorough stuff can be undertaken by those directly using the artifacts
>> and code in development/production.
>>
>> Thanks very much in advance
>>
>> Best
>>
>> Lewis
>>
>> On Fri, Jun 8, 2012 at 3:49 PM, lewis john mcgibbney <[EMAIL PROTECTED]> wrote:
>>> Good Evening Everyone,
>>>
>>> A candidate for the Apache Nutch 2.0 RC1 is available at:
>>>
>>> http://people.apache.org/~lewismc/nutch-2.0
>>>
>>> The release candidate is a src.zip, bin.zip, src.tar.gz and bin.tar.gz
>>> archive of the sources in:
>>>
>>> http://svn.apache.org/repos/asf/nutch/tags/release-2.0rc1
>>>
>>> Further, a staged Maven repository of the 2.0 jar, sources.jar and
>>> javadoc.jar is available here:
>>>
>>> https://repository.apache.org/content/repositories/orgapachenutch-215
>>>
>>> Please vote on releasing this package as Apache Nutch 2.0.
>>> The vote is open for the next 72 hours and passes if a majority of at
>>> least three +1 Nutch PMC votes are cast.
>>>
>>> [ ] +1 Release this package as Apache Nutch 2.0
>>> [ ] -1 Do not release this package because...
>>>
>>> Many Thanks and heres to plenty more.
>>>
>>> Have a great weekend, Kind Regards,
>>> Lewis
>>>
>>> P.S. Here's my +1.
>>
>>
>>
>
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: [EMAIL PROTECTED]
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Findings about Nutch-2.0 RC 1.

The Nutch job jar is not present in the binary archive. This means
distributed running of jobs is not supported. I'm not sure if this is a
problem (since users can always build one themselves), merely pointing it
out. The recently released 1.5 also lacks this job jar, so at least no
difference there.

Parse text is limited to 100 characters for html. We noticed this when our
index wasn't showing enough terms for some documents. This is a pretty
severe bug that I will commit a fix for right away.

Building runtime with the default SqlStore and HBaseStore works fine. Will
perform some more functionality tests when there is a new RC.

Ferdy.

On Wed, Jun 13, 2012 at 4:24 AM, Mattmann, Chris A (388J) <
[EMAIL PROTECTED]> wrote:

> Hey Guys,
>
> #2 is probably reason enough for a respin.
>
> Lewis if you don't have time to do it before Thursday, I could probably
> give it a whack. Let me know.
>
> Cheers,
> Chris
>
> On Jun 12, 2012, at 3:33 PM, Sebastian Nagel wrote:
>
> > Hi Lewis,
> >
> > my first steps with 2.0 (to be continued, still struggling).
> >
> > Two points (I'll try to give a final vote tomorrow):
> >
> > 1 some guidance would be nice. README.txt points
> > to http://wiki.apache.org/nutch/NutchTutorial which refers to 1.x
> > (I'm using
> http://sujitpal.blogspot.de/2012/01/exploring-nutch-gora-with-cassandra.html
> )
> >
> > 2 the package contains your nutch-site.xml:
> >    <name>http.agent.email</name>
> >    <value>[EMAIL PROTECTED]</value>
> > I guess that's not intended :)
> >
> > Cheers,
> > Sebastian
> >
> > On 06/12/2012 10:16 PM, Lewis John Mcgibbney wrote:
> >> Hi Everyone,
> >>
> >> I appreciate that most of the core dev's are using trunk, however I
> >> would appeal to you guys to at least check out the artifacts and check
> >> sigs, tests, license headers if possible. Although this does not fully
> >> satisfy the requirements of a thoroughly reviewed RC, hopefully the
> >> thorough stuff can be undertaken by those directly using the artifacts
> >> and code in development/production.
> >>
> >> Thanks very much in advance
> >>
> >> Best
> >>
> >> Lewis
> >>
> >> On Fri, Jun 8, 2012 at 3:49 PM, lewis john mcgibbney <
> [EMAIL PROTECTED]> wrote:
> >>> Good Evening Everyone,
> >>>
> >>> A candidate for the Apache Nutch 2.0 RC1 is available at:
> >>>
> >>> http://people.apache.org/~lewismc/nutch-2.0
> >>>
> >>> The release candidate is a src.zip, bin.zip, src.tar.gz and bin.tar.gz
> >>> archive of the sources in:
> >>>
> >>> http://svn.apache.org/repos/asf/nutch/tags/release-2.0rc1
> >>>
> >>> Further, a staged Maven repository of the 2.0 jar, sources.jar and
> >>> javadoc.jar is available here:
> >>>
> >>> https://repository.apache.org/content/repositories/orgapachenutch-215
> >>>
> >>> Please vote on releasing this package as Apache Nutch 2.0.
> >>> The vote is open for the next 72 hours and passes if a majority of at
> >>> least three +1 Nutch PMC votes are cast.
> >>>
> >>> [ ] +1 Release this package as Apache Nutch 2.0
> >>> [ ] -1 Do not release this package because...
> >>>
> >>> Many Thanks and heres to plenty more.
> >>>
> >>> Have a great weekend, Kind Regards,
> >>> Lewis
> >>>
> >>> P.S. Here's my +1.
> >>
> >>
> >>
> >
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: [EMAIL PROTECTED]
> WWW:   http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>

Hmm please ignore "the parse text limited to 100 chars", this is actually
not the case. (Only in our branch that has a fix for limiting anchor texts;
not yet present in in the nutchgora branch because it still needs
polishing). So no need to wait for commits on my part.

On Wed, Jun 13, 2012 at 11:00 AM, Ferdy Galema <[EMAIL PROTECTED]>wrote:

> Findings about Nutch-2.0 RC 1.
>
> The Nutch job jar is not present in the binary archive. This means
> distributed running of jobs is not supported. I'm not sure if this is a
> problem (since users can always build one themselves), merely pointing it
> out. The recently released 1.5 also lacks this job jar, so at least no
> difference there.
>
> Parse text is limited to 100 characters for html. We noticed this when our
> index wasn't showing enough terms for some documents. This is a pretty
> severe bug that I will commit a fix for right away.
>
> Building runtime with the default SqlStore and HBaseStore works fine. Will
> perform some more functionality tests when there is a new RC.
>
> Ferdy.
>
> On Wed, Jun 13, 2012 at 4:24 AM, Mattmann, Chris A (388J) <
> [EMAIL PROTECTED]> wrote:
>
>> Hey Guys,
>>
>> #2 is probably reason enough for a respin.
>>
>> Lewis if you don't have time to do it before Thursday, I could probably
>> give it a whack. Let me know.
>>
>> Cheers,
>> Chris
>>
>> On Jun 12, 2012, at 3:33 PM, Sebastian Nagel wrote:
>>
>> > Hi Lewis,
>> >
>> > my first steps with 2.0 (to be continued, still struggling).
>> >
>> > Two points (I'll try to give a final vote tomorrow):
>> >
>> > 1 some guidance would be nice. README.txt points
>> > to http://wiki.apache.org/nutch/NutchTutorial which refers to 1.x
>> > (I'm using
>> http://sujitpal.blogspot.de/2012/01/exploring-nutch-gora-with-cassandra.html
>> )
>> >
>> > 2 the package contains your nutch-site.xml:
>> >    <name>http.agent.email</name>
>> >    <value>[EMAIL PROTECTED]</value>
>> > I guess that's not intended :)
>> >
>> > Cheers,
>> > Sebastian
>> >
>> > On 06/12/2012 10:16 PM, Lewis John Mcgibbney wrote:
>> >> Hi Everyone,
>> >>
>> >> I appreciate that most of the core dev's are using trunk, however I
>> >> would appeal to you guys to at least check out the artifacts and check
>> >> sigs, tests, license headers if possible. Although this does not fully
>> >> satisfy the requirements of a thoroughly reviewed RC, hopefully the
>> >> thorough stuff can be undertaken by those directly using the artifacts
>> >> and code in development/production.
>> >>
>> >> Thanks very much in advance
>> >>
>> >> Best
>> >>
>> >> Lewis
>> >>
>> >> On Fri, Jun 8, 2012 at 3:49 PM, lewis john mcgibbney <
>> [EMAIL PROTECTED]> wrote:
>> >>> Good Evening Everyone,
>> >>>
>> >>> A candidate for the Apache Nutch 2.0 RC1 is available at:
>> >>>
>> >>> http://people.apache.org/~lewismc/nutch-2.0
>> >>>
>> >>> The release candidate is a src.zip, bin.zip, src.tar.gz and bin.tar.gz
>> >>> archive of the sources in:
>> >>>
>> >>> http://svn.apache.org/repos/asf/nutch/tags/release-2.0rc1
>> >>>
>> >>> Further, a staged Maven repository of the 2.0 jar, sources.jar and
>> >>> javadoc.jar is available here:
>> >>>
>> >>> https://repository.apache.org/content/repositories/orgapachenutch-215
>> >>>
>> >>> Please vote on releasing this package as Apache Nutch 2.0.
>> >>> The vote is open for the next 72 hours and passes if a majority of at
>> >>> least three +1 Nutch PMC votes are cast.
>> >>>
>> >>> [ ] +1 Release this package as Apache Nutch 2.0
>> >>> [ ] -1 Do not release this package because...
>> >>>
>> >>> Many Thanks and heres to plenty more.
>> >>>
>> >>> Have a great weekend, Kind Regards,
>> >>> Lewis
>> >>>
>> >>> P.S. Here's my +1.
>> >>
>> >>
>> >>
>> >
>>
>>
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: [EMAIL PROTECTED]
>> WWW:   http

Hi Seb,

As Chris said, the issues you highlight well justify another RC.

I can shift it by the end of play today.

Thanks very much for having a look through guys

Lewis

On Tue, Jun 12, 2012 at 11:33 PM, Sebastian Nagel
<[EMAIL PROTECTED]> wrote:
> Hi Lewis,
>
> my first steps with 2.0 (to be continued, still struggling).
>
> Two points (I'll try to give a final vote tomorrow):
>
> 1 some guidance would be nice. README.txt points
> to http://wiki.apache.org/nutch/NutchTutorial which refers to 1.x
> (I'm using http://sujitpal.blogspot.de/2012/01/exploring-nutch-gora-with-cassandra.html)
>
> 2 the package contains your nutch-site.xml:
>    <name>http.agent.email</name>
>    <value>[EMAIL PROTECTED]</value>
> I guess that's not intended :)
>
> Cheers,
> Sebastian
>
> On 06/12/2012 10:16 PM, Lewis John Mcgibbney wrote:
>> Hi Everyone,
>>
>> I appreciate that most of the core dev's are using trunk, however I
>> would appeal to you guys to at least check out the artifacts and check
>> sigs, tests, license headers if possible. Although this does not fully
>> satisfy the requirements of a thoroughly reviewed RC, hopefully the
>> thorough stuff can be undertaken by those directly using the artifacts
>> and code in development/production.
>>
>> Thanks very much in advance
>>
>> Best
>>
>> Lewis
>>
>> On Fri, Jun 8, 2012 at 3:49 PM, lewis john mcgibbney <[EMAIL PROTECTED]> wrote:
>>> Good Evening Everyone,
>>>
>>> A candidate for the Apache Nutch 2.0 RC1 is available at:
>>>
>>> http://people.apache.org/~lewismc/nutch-2.0
>>>
>>> The release candidate is a src.zip, bin.zip, src.tar.gz and bin.tar.gz
>>> archive of the sources in:
>>>
>>> http://svn.apache.org/repos/asf/nutch/tags/release-2.0rc1
>>>
>>> Further, a staged Maven repository of the 2.0 jar, sources.jar and
>>> javadoc.jar is available here:
>>>
>>> https://repository.apache.org/content/repositories/orgapachenutch-215
>>>
>>> Please vote on releasing this package as Apache Nutch 2.0.
>>> The vote is open for the next 72 hours and passes if a majority of at
>>> least three +1 Nutch PMC votes are cast.
>>>
>>>  [ ] +1 Release this package as Apache Nutch 2.0
>>>  [ ] -1 Do not release this package because...
>>>
>>> Many Thanks and heres to plenty more.
>>>
>>> Have a great weekend, Kind Regards,
>>> Lewis
>>>
>>> P.S. Here's my +1.
>>
>>
>>
>

--
Lewis

Hi Seb,

Quick update

On Tue, Jun 12, 2012 at 11:33 PM, Sebastian Nagel
<[EMAIL PROTECTED]> wrote:
>1 some guidance would be nice. README.txt points
> to http://wiki.apache.org/nutch/NutchTutorial which refers to 1.x

Please see http://wiki.apache.org/nutch/Nutch2Tutorial which is an
update of Julien's (I think) page on GORA_HBase. Thsi will get you
rocking with HBase. The changes between Cassandra, Accumulo and the
other data stores are fairly trivial.

> 2 the package contains your nutch-site.xml:
>    <name>http.agent.email</name>
>    <value>[EMAIL PROTECTED]</value>
> I guess that's not intended :)

I'll deal with this when I spin RC2. Thanks

Lewis

Ferdy

>
> The Nutch job jar is not present in the binary archive. This means
> distributed running of jobs is not supported. I'm not sure if this is a
> problem (since users can always build one themselves), merely pointing it
> out. The recently released 1.5 also lacks this job jar, so at least no
> difference there.
>

The binary distrib corresponds to runtime/local and as such should NOT have
the job file there. This is now the norm since 1.5

Will try and do some testing of the RC

Thanks

Julien

--
*
*Open Source Solutions for Text Engineering

http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
http://twitter.com/digitalpebble

Hi Guys,

Whilst updating the Nutch2Tutorial I got thinking that within Gora we don't
supply binary distributions of the code, this is because when using Gora a
user may wish/require to recompile the code to accomodate config changes
etc. We only supply src distributions...

Does this principle apply to Nutch 2 as well? I mean, what if your using
the gora-sql dependency, then you wish to switch to HBase and recompile, is
this possible within the binary distribution?

Best

Lewis

On Wed, Jun 13, 2012 at 3:38 PM, Julien Nioche <
[EMAIL PROTECTED]> wrote:

> Ferdy
>
>>
>> The Nutch job jar is not present in the binary archive. This means
>> distributed running of jobs is not supported. I'm not sure if this is a
>> problem (since users can always build one themselves), merely pointing it
>> out. The recently released 1.5 also lacks this job jar, so at least no
>> difference there.
>>
>
> The binary distrib corresponds to runtime/local and as such should NOT
> have the job file there. This is now the norm since 1.5
>
> Will try and do some testing of the RC
>
> Thanks
>
> Julien
>
>
>
> --
> *
> *Open Source Solutions for Text Engineering
>
> http://digitalpebble.blogspot.com/
> http://www.digitalpebble.com
> http://twitter.com/digitalpebble
>
>
--
*Lewis*

Hi Lewis,

> Please see http://wiki.apache.org/nutch/Nutch2Tutorial which is an
> update of Julien's (I think) page on GORA_HBase. Thsi will get you
> rocking with HBase. The changes between Cassandra, Accumulo and the
> other data stores are fairly trivial.

I'll managed to perform a crawl with 2.0 and HBase: it rocks, indeed.
Much simpler than 1.x (no segments!).

Below a couple of problems I've run into (possible issues to be adressed in 2.1).

Cheers,
Sebastian

% ./bin/nutch readdb -stats
WebTable statistics start
WebTableReader: java.io.EOFException
        at java.io.DataInputStream.readFully(DataInputStream.java:197)
        at java.io.DataInputStream.readFully(DataInputStream.java:169)
        at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1508)
        at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1486)
        at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1475)
        at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1470)
        at
org.apache.hadoop.mapred.SequenceFileOutputFormat.getReaders(SequenceFileOutputFormat.java:89)
        at org.apache.nutch.crawl.WebTableReader.run(WebTableReader.java:537)
        at org.apache.nutch.crawl.WebTableReader.processStatJob(WebTableReader.java:218)
        at org.apache.nutch.crawl.WebTableReader.run(WebTableReader.java:479)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.nutch.crawl.WebTableReader.main(WebTableReader.java:412)
--> readdb -dump works.

% ./bin/nutch fetch 1339621550-203073321 -threads 1 -parse
Exception in thread "main" java.lang.IllegalArgumentException: arg -parse not recognized

% ./bin/nutch parse -all -force -resume
ParserJob: starting
ParserJob: resuming:    false           <<< -resume and
ParserJob: forced reparse:      false   <<< -force obviously ignored ?
ParserJob: parsing all

% ./bin/nutch generate
--> generates batchid, but should show help as in 1.x ?
--> is there an option -topN ?

The 2.0 Solr schema and mappings still contain the field "site"
which has been removed in 1.x (NUTCH-1232).
Should be done also in 2.0: it's easier to maintain only one Solr installation
for all Nutch versions.

Hi Sebastian,

On Wed, Jun 13, 2012 at 11:30 PM, Sebastian Nagel
<[EMAIL PROTECTED]> wrote:
>I'll managed to perform a crawl with 2.0 and HBase: it rocks, indeed.
> Much simpler than 1.x (no segments!).

:0)

> % ./bin/nutch readdb -stats
> WebTable statistics start
> WebTableReader: java.io.EOFException
>        at java.io.DataInputStream.readFully(DataInputStream.java:197)
>        at java.io.DataInputStream.readFully(DataInputStream.java:169)
>        at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1508)
>        at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1486)
>        at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1475)
>        at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1470)
>        at
> org.apache.hadoop.mapred.SequenceFileOutputFormat.getReaders(SequenceFileOutputFormat.java:89)
>        at org.apache.nutch.crawl.WebTableReader.run(WebTableReader.java:537)
>        at org.apache.nutch.crawl.WebTableReader.processStatJob(WebTableReader.java:218)
>        at org.apache.nutch.crawl.WebTableReader.run(WebTableReader.java:479)
>        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>        at org.apache.nutch.crawl.WebTableReader.main(WebTableReader.java:412)
> --> readdb -dump works.

Confirmed and ticket opened as NUTCH-1391

> % ./bin/nutch fetch 1339621550-203073321 -threads 1 -parse
> Exception in thread "main" java.lang.IllegalArgumentException: arg -parse not recognized

The parse argument was removed in Nutch 2.0 and now throws an
illegalargumentexception. This is now normal. To enable parsing during
fetching please set config in nutch-site.xml. The reason that the
incorrect -parse argument is till in the Usage message, is because I
was not diligent enough when patching the fetcher CLI aesthetics. I'll
address this within the issue below as well.

>
>
> % ./bin/nutch parse -all -force -resume
> ParserJob: starting
> ParserJob: resuming:    false           <<< -resume and
> ParserJob: forced reparse:      false   <<< -force obviously ignored ?
> ParserJob: parsing all

Yes confirmed and ticket opened as NUTCH-1392
> % ./bin/nutch generate
> --> generates batchid, but should show help as in 1.x ?
> --> is there an option -topN ?

Yes this is opened in NUTCH-1393. Users may not necessarily wish to
generate at all, instead wishing to merely find out the GeneratorJob
CLI options... I will open this just now and fix for 2.1.

> The 2.0 Solr schema and mappings still contain the field "site"
> which has been removed in 1.x (NUTCH-1232).
> Should be done also in 2.0: it's easier to maintain only one Solr installation
> for all Nutch versions.

Logged in NUTCH-1394

Thanks Seb for your contributions here... this is exactly what we are after.

Does anyone have issues with running another RC and addressing these
issues in 2.1?

--
Lewis

Maybe just 1392? I went ahead and made a patch that should fix this. Feel
free to commit or ignore prior to RC2.

On Thu, Jun 14, 2012 at 1:44 AM, Lewis John Mcgibbney <
[EMAIL PROTECTED]> wrote:

> Hi Sebastian,
>
> On Wed, Jun 13, 2012 at 11:30 PM, Sebastian Nagel
> <[EMAIL PROTECTED]> wrote:
> >I'll managed to perform a crawl with 2.0 and HBase: it rocks, indeed.
> > Much simpler than 1.x (no segments!).
>
> :0)
>
> > % ./bin/nutch readdb -stats
> > WebTable statistics start
> > WebTableReader: java.io.EOFException
> >        at java.io.DataInputStream.readFully(DataInputStream.java:197)
> >        at java.io.DataInputStream.readFully(DataInputStream.java:169)
> >        at
> org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1508)
> >        at
> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1486)
> >        at
> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1475)
> >        at
> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1470)
> >        at
> >
> org.apache.hadoop.mapred.SequenceFileOutputFormat.getReaders(SequenceFileOutputFormat.java:89)
> >        at
> org.apache.nutch.crawl.WebTableReader.run(WebTableReader.java:537)
> >        at
> org.apache.nutch.crawl.WebTableReader.processStatJob(WebTableReader.java:218)
> >        at
> org.apache.nutch.crawl.WebTableReader.run(WebTableReader.java:479)
> >        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >        at
> org.apache.nutch.crawl.WebTableReader.main(WebTableReader.java:412)
> > --> readdb -dump works.
>
> Confirmed and ticket opened as NUTCH-1391
>
> > % ./bin/nutch fetch 1339621550-203073321 -threads 1 -parse
> > Exception in thread "main" java.lang.IllegalArgumentException: arg
> -parse not recognized
>
> The parse argument was removed in Nutch 2.0 and now throws an
> illegalargumentexception. This is now normal. To enable parsing during
> fetching please set config in nutch-site.xml. The reason that the
> incorrect -parse argument is till in the Usage message, is because I
> was not diligent enough when patching the fetcher CLI aesthetics. I'll
> address this within the issue below as well.
>
> >
> >
> > % ./bin/nutch parse -all -force -resume
> > ParserJob: starting
> > ParserJob: resuming:    false           <<< -resume and
> > ParserJob: forced reparse:      false   <<< -force obviously ignored ?
> > ParserJob: parsing all
>
> Yes confirmed and ticket opened as NUTCH-1392
>
>
> > % ./bin/nutch generate
> > --> generates batchid, but should show help as in 1.x ?
> > --> is there an option -topN ?
>
> Yes this is opened in NUTCH-1393. Users may not necessarily wish to
> generate at all, instead wishing to merely find out the GeneratorJob
> CLI options... I will open this just now and fix for 2.1.
>
> > The 2.0 Solr schema and mappings still contain the field "site"
> > which has been removed in 1.x (NUTCH-1232).
> > Should be done also in 2.0: it's easier to maintain only one Solr
> installation
> > for all Nutch versions.
>
> Logged in NUTCH-1394
>
> Thanks Seb for your contributions here... this is exactly what we are
> after.
>
> Does anyone have issues with running another RC and addressing these
> issues in 2.1?
>
> --
> Lewis
>

> We only supply src distributions...
> Does this principle apply to Nutch 2 as well?
Maybe, yes.
The situation with the current binary package is uncomfortable:
I had to copy/link gora-hbase and hbase jars into lib/ to get nutch running.

2012/6/13 Lewis John Mcgibbney <[EMAIL PROTECTED]>

> Hi Guys,
>
> Whilst updating the Nutch2Tutorial I got thinking that within Gora we
> don't supply binary distributions of the code, this is because when using
> Gora a user may wish/require to recompile the code to accomodate config
> changes etc. We only supply src distributions...
>
> Does this principle apply to Nutch 2 as well? I mean, what if your using
> the gora-sql dependency, then you wish to switch to HBase and recompile, is
> this possible within the binary distribution?
>
> Best
>
> Lewis
>
>
> On Wed, Jun 13, 2012 at 3:38 PM, Julien Nioche <
> [EMAIL PROTECTED]> wrote:
>
>> Ferdy
>>
>>>
>>> The Nutch job jar is not present in the binary archive. This means
>>> distributed running of jobs is not supported. I'm not sure if this is a
>>> problem (since users can always build one themselves), merely pointing it
>>> out. The recently released 1.5 also lacks this job jar, so at least no
>>> difference there.
>>>
>>
>> The binary distrib corresponds to runtime/local and as such should NOT
>> have the job file there. This is now the norm since 1.5
>>
>> Will try and do some testing of the RC
>>
>> Thanks
>>
>> Julien
>>
>>
>>
>> --
>> *
>> *Open Source Solutions for Text Engineering
>>
>> http://digitalpebble.blogspot.com/
>> http://www.digitalpebble.com
>> http://twitter.com/digitalpebble
>>
>>
>
>
> --
> *Lewis*
>
>

Aye this is no good at all. Depending on which backend you wish to use with
Gora, you will need to go and manually fetch the correct .jar's from maven
central.

Does anyone else have either solution or a workaround before I push RC2
with just src dists?

Thanks

Lewis

On Thu, Jun 14, 2012 at 4:52 PM, Sebastian Nagel <[EMAIL PROTECTED]
> wrote:

> > We only supply src distributions...
> > Does this principle apply to Nutch 2 as well?
> Maybe, yes.
> The situation with the current binary package is uncomfortable:
> I had to copy/link gora-hbase and hbase jars into lib/ to get nutch
> running.
>
> 2012/6/13 Lewis John Mcgibbney <[EMAIL PROTECTED]>
>
>> Hi Guys,
>>
>> Whilst updating the Nutch2Tutorial I got thinking that within Gora we
>> don't supply binary distributions of the code, this is because when using
>> Gora a user may wish/require to recompile the code to accomodate config
>> changes etc. We only supply src distributions...
>>
>> Does this principle apply to Nutch 2 as well? I mean, what if your using
>> the gora-sql dependency, then you wish to switch to HBase and recompile, is
>> this possible within the binary distribution?
>>
>> Best
>>
>> Lewis
>>
>>
>> On Wed, Jun 13, 2012 at 3:38 PM, Julien Nioche <
>> [EMAIL PROTECTED]> wrote:
>>
>>> Ferdy
>>>
>>>>
>>>> The Nutch job jar is not present in the binary archive. This means
>>>> distributed running of jobs is not supported. I'm not sure if this is a
>>>> problem (since users can always build one themselves), merely pointing it
>>>> out. The recently released 1.5 also lacks this job jar, so at least no
>>>> difference there.
>>>>
>>>
>>> The binary distrib corresponds to runtime/local and as such should NOT
>>> have the job file there. This is now the norm since 1.5
>>>
>>> Will try and do some testing of the RC
>>>
>>> Thanks
>>>
>>> Julien
>>>
>>>
>>>
>>> --
>>> *
>>> *Open Source Solutions for Text Engineering
>>>
>>> http://digitalpebble.blogspot.com/
>>> http://www.digitalpebble.com
>>> http://twitter.com/digitalpebble
>>>
>>>
>>
>>
>> --
>> *Lewis*
>>
>>
>
--
*Lewis*

Hey Guys,

I think the annoyance is probably something folks can live with as they have been
waiting for an "official" release of 2.x for years :)

My +1 to roll RC #2 with or without a solution to this and mark it as a TODO. "release
eary", "release often" :)

Cheers,
Chris

On Jun 14, 2012, at 10:04 AM, Lewis John Mcgibbney wrote:

> Aye this is no good at all. Depending on which backend you wish to use with Gora, you will need to go and manually fetch the correct .jar's from maven central.
>
> Does anyone else have either solution or a workaround before I push RC2 with just src dists?
>
> Thanks
>
> Lewis
>
> On Thu, Jun 14, 2012 at 4:52 PM, Sebastian Nagel <[EMAIL PROTECTED]> wrote:
> > We only supply src distributions...
> > Does this principle apply to Nutch 2 as well?
> Maybe, yes.
> The situation with the current binary package is uncomfortable:
> I had to copy/link gora-hbase and hbase jars into lib/ to get nutch running.
>
> 2012/6/13 Lewis John Mcgibbney <[EMAIL PROTECTED]>
> Hi Guys,
>
> Whilst updating the Nutch2Tutorial I got thinking that within Gora we don't supply binary distributions of the code, this is because when using Gora a user may wish/require to recompile the code to accomodate config changes etc. We only supply src distributions...
>
> Does this principle apply to Nutch 2 as well? I mean, what if your using the gora-sql dependency, then you wish to switch to HBase and recompile, is this possible within the binary distribution?
>
> Best
>
> Lewis
>
>
> On Wed, Jun 13, 2012 at 3:38 PM, Julien Nioche <[EMAIL PROTECTED]> wrote:
> Ferdy
>
> The Nutch job jar is not present in the binary archive. This means distributed running of jobs is not supported. I'm not sure if this is a problem (since users can always build one themselves), merely pointing it out. The recently released 1.5 also lacks this job jar, so at least no difference there.
>
> The binary distrib corresponds to runtime/local and as such should NOT have the job file there. This is now the norm since 1.5
>
> Will try and do some testing of the RC
>
> Thanks
>
> Julien
>
>
>
> --
>
> Open Source Solutions for Text Engineering
>
> http://digitalpebble.blogspot.com/
> http://www.digitalpebble.com
> http://twitter.com/digitalpebble
>
>
>
>
> --
> Lewis
>
>
>
>
>
> --
> Lewis
>
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: [EMAIL PROTECTED]
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

I disagree. You'd expect a binary release to work out of the box - which is
not the case. Plus we'd have to spend more time explaining the workaround,
answering the same questions over and over on the ML etc... Fixing this
should not be a big deal (i.e. add the gore-x modules for the backends to
the ivy deps file).

Julien

On 14 June 2012 20:27, Mattmann, Chris A (388J) <
[EMAIL PROTECTED]> wrote:

> Hey Guys,
>
> I think the annoyance is probably something folks can live with as they
> have been
> waiting for an "official" release of 2.x for years :)
>
> My +1 to roll RC #2 with or without a solution to this and mark it as a
> TODO. "release
> eary", "release often" :)
>
> Cheers,
> Chris
>
> On Jun 14, 2012, at 10:04 AM, Lewis John Mcgibbney wrote:
>
> > Aye this is no good at all. Depending on which backend you wish to use
> with Gora, you will need to go and manually fetch the correct .jar's from
> maven central.
> >
> > Does anyone else have either solution or a workaround before I push RC2
> with just src dists?
> >
> > Thanks
> >
> > Lewis
> >
> > On Thu, Jun 14, 2012 at 4:52 PM, Sebastian Nagel <
> [EMAIL PROTECTED]> wrote:
> > > We only supply src distributions...
> > > Does this principle apply to Nutch 2 as well?
> > Maybe, yes.
> > The situation with the current binary package is uncomfortable:
> > I had to copy/link gora-hbase and hbase jars into lib/ to get nutch
> running.
> >
> > 2012/6/13 Lewis John Mcgibbney <[EMAIL PROTECTED]>
> > Hi Guys,
> >
> > Whilst updating the Nutch2Tutorial I got thinking that within Gora we
> don't supply binary distributions of the code, this is because when using
> Gora a user may wish/require to recompile the code to accomodate config
> changes etc. We only supply src distributions...
> >
> > Does this principle apply to Nutch 2 as well? I mean, what if your using
> the gora-sql dependency, then you wish to switch to HBase and recompile, is
> this possible within the binary distribution?
> >
> > Best
> >
> > Lewis
> >
> >
> > On Wed, Jun 13, 2012 at 3:38 PM, Julien Nioche <
> [EMAIL PROTECTED]> wrote:
> > Ferdy
> >
> > The Nutch job jar is not present in the binary archive. This means
> distributed running of jobs is not supported. I'm not sure if this is a
> problem (since users can always build one themselves), merely pointing it
> out. The recently released 1.5 also lacks this job jar, so at least no
> difference there.
> >
> > The binary distrib corresponds to runtime/local and as such should NOT
> have the job file there. This is now the norm since 1.5
> >
> > Will try and do some testing of the RC
> >
> > Thanks
> >
> > Julien
> >
> >
> >
> > --
> >
> > Open Source Solutions for Text Engineering
> >
> > http://digitalpebble.blogspot.com/
> > http://www.digitalpebble.com
> > http://twitter.com/digitalpebble
> >
> >
> >
> >
> > --
> > Lewis
> >
> >
> >
> >
> >
> > --
> > Lewis
> >
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: [EMAIL PROTECTED]
> WWW:   http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
--
*
*Open Source Solutions for Text Engineering

http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
http://twitter.com/digitalpebble

Hi Julien,

Do you suggest with the binary release that we simply open up all gora-*
deps and ship it with every jar available?

Lewis

On Thu, Jun 14, 2012 at 9:39 PM, Julien Nioche <
[EMAIL PROTECTED]> wrote:

> I disagree. You'd expect a binary release to work out of the box - which
> is not the case. Plus we'd have to spend more time explaining the
> workaround, answering the same questions over and over on the ML etc...
> Fixing this should not be a big deal (i.e. add the gore-x modules for the
> backends to the ivy deps file).
>
> Julien
>
>
> On 14 June 2012 20:27, Mattmann, Chris A (388J) <
> [EMAIL PROTECTED]> wrote:
>
>> Hey Guys,
>>
>> I think the annoyance is probably something folks can live with as they
>> have been
>> waiting for an "official" release of 2.x for years :)
>>
>> My +1 to roll RC #2 with or without a solution to this and mark it as a
>> TODO. "release
>> eary", "release often" :)
>>
>> Cheers,
>> Chris
>>
>> On Jun 14, 2012, at 10:04 AM, Lewis John Mcgibbney wrote:
>>
>> > Aye this is no good at all. Depending on which backend you wish to use
>> with Gora, you will need to go and manually fetch the correct .jar's from
>> maven central.
>> >
>> > Does anyone else have either solution or a workaround before I push RC2
>> with just src dists?
>> >
>> > Thanks
>> >
>> > Lewis
>> >
>> > On Thu, Jun 14, 2012 at 4:52 PM, Sebastian Nagel <
>> [EMAIL PROTECTED]> wrote:
>> > > We only supply src distributions...
>> > > Does this principle apply to Nutch 2 as well?
>> > Maybe, yes.
>> > The situation with the current binary package is uncomfortable:
>> > I had to copy/link gora-hbase and hbase jars into lib/ to get nutch
>> running.
>> >
>> > 2012/6/13 Lewis John Mcgibbney <[EMAIL PROTECTED]>
>> > Hi Guys,
>> >
>> > Whilst updating the Nutch2Tutorial I got thinking that within Gora we
>> don't supply binary distributions of the code, this is because when using
>> Gora a user may wish/require to recompile the code to accomodate config
>> changes etc. We only supply src distributions...
>> >
>> > Does this principle apply to Nutch 2 as well? I mean, what if your
>> using the gora-sql dependency, then you wish to switch to HBase and
>> recompile, is this possible within the binary distribution?
>> >
>> > Best
>> >
>> > Lewis
>> >
>> >
>> > On Wed, Jun 13, 2012 at 3:38 PM, Julien Nioche <
>> [EMAIL PROTECTED]> wrote:
>> > Ferdy
>> >
>> > The Nutch job jar is not present in the binary archive. This means
>> distributed running of jobs is not supported. I'm not sure if this is a
>> problem (since users can always build one themselves), merely pointing it
>> out. The recently released 1.5 also lacks this job jar, so at least no
>> difference there.
>> >
>> > The binary distrib corresponds to runtime/local and as such should NOT
>> have the job file there. This is now the norm since 1.5
>> >
>> > Will try and do some testing of the RC
>> >
>> > Thanks
>> >
>> > Julien
>> >
>> >
>> >
>> > --
>> >
>> > Open Source Solutions for Text Engineering
>> >
>> > http://digitalpebble.blogspot.com/
>> > http://www.digitalpebble.com
>> > http://twitter.com/digitalpebble
>> >
>> >
>> >
>> >
>> > --
>> > Lewis
>> >
>> >
>> >
>> >
>> >
>> > --
>> > Lewis
>> >
>>
>>
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: [EMAIL PROTECTED]
>> WWW:   http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Assistant Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
>>
>
>
> --
> *
> *
> Open Source Solutions for Text Engineering
>
> http://digitalpebble.blogspot.com/
> http://www.digitalpebble.com
> http://twitter.com/digitalpebble
*Lewis*

yep, remember that you can't build from the bin package so inevitably
someone will wonder why only such or such backend is available etc...

another option is to NOT have a binary release at all, in which case it is
acceptable I think not to include the deps in ivy. Maybe we should at least
add them but comment them out

Ju

On 14 June 2012 21:51, Lewis John Mcgibbney <[EMAIL PROTECTED]>wrote:

> Hi Julien,
>
> Do you suggest with the binary release that we simply open up all gora-*
> deps and ship it with every jar available?
>
> Lewis
>
>
> On Thu, Jun 14, 2012 at 9:39 PM, Julien Nioche <
> [EMAIL PROTECTED]> wrote:
>
>> I disagree. You'd expect a binary release to work out of the box - which
>> is not the case. Plus we'd have to spend more time explaining the
>> workaround, answering the same questions over and over on the ML etc...
>> Fixing this should not be a big deal (i.e. add the gore-x modules for the
>> backends to the ivy deps file).
>>
>> Julien
>>
>>
>> On 14 June 2012 20:27, Mattmann, Chris A (388J) <
>> [EMAIL PROTECTED]> wrote:
>>
>>> Hey Guys,
>>>
>>> I think the annoyance is probably something folks can live with as they
>>> have been
>>> waiting for an "official" release of 2.x for years :)
>>>
>>> My +1 to roll RC #2 with or without a solution to this and mark it as a
>>> TODO. "release
>>> eary", "release often" :)
>>>
>>> Cheers,
>>> Chris
>>>
>>> On Jun 14, 2012, at 10:04 AM, Lewis John Mcgibbney wrote:
>>>
>>> > Aye this is no good at all. Depending on which backend you wish to use
>>> with Gora, you will need to go and manually fetch the correct .jar's from
>>> maven central.
>>> >
>>> > Does anyone else have either solution or a workaround before I push
>>> RC2 with just src dists?
>>> >
>>> > Thanks
>>> >
>>> > Lewis
>>> >
>>> > On Thu, Jun 14, 2012 at 4:52 PM, Sebastian Nagel <
>>> [EMAIL PROTECTED]> wrote:
>>> > > We only supply src distributions...
>>> > > Does this principle apply to Nutch 2 as well?
>>> > Maybe, yes.
>>> > The situation with the current binary package is uncomfortable:
>>> > I had to copy/link gora-hbase and hbase jars into lib/ to get nutch
>>> running.
>>> >
>>> > 2012/6/13 Lewis John Mcgibbney <[EMAIL PROTECTED]>
>>> > Hi Guys,
>>> >
>>> > Whilst updating the Nutch2Tutorial I got thinking that within Gora we
>>> don't supply binary distributions of the code, this is because when using
>>> Gora a user may wish/require to recompile the code to accomodate config
>>> changes etc. We only supply src distributions...
>>> >
>>> > Does this principle apply to Nutch 2 as well? I mean, what if your
>>> using the gora-sql dependency, then you wish to switch to HBase and
>>> recompile, is this possible within the binary distribution?
>>> >
>>> > Best
>>> >
>>> > Lewis
>>> >
>>> >
>>> > On Wed, Jun 13, 2012 at 3:38 PM, Julien Nioche <
>>> [EMAIL PROTECTED]> wrote:
>>> > Ferdy
>>> >
>>> > The Nutch job jar is not present in the binary archive. This means
>>> distributed running of jobs is not supported. I'm not sure if this is a
>>> problem (since users can always build one themselves), merely pointing it
>>> out. The recently released 1.5 also lacks this job jar, so at least no
>>> difference there.
>>> >
>>> > The binary distrib corresponds to runtime/local and as such should NOT
>>> have the job file there. This is now the norm since 1.5
>>> >
>>> > Will try and do some testing of the RC
>>> >
>>> > Thanks
>>> >
>>> > Julien
>>> >
>>> >
>>> >
>>> > --
>>> >
>>> > Open Source Solutions for Text Engineering
>>> >
>>> > http://digitalpebble.blogspot.com/
>>> > http://www.digitalpebble.com
>>> > http://twitter.com/digitalpebble
>>> >
>>> >
>>> >
>>> >
>>> > --
>>> > Lewis
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > --
>>> > Lewis
>>> >
>>>
>>>
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>> Chris Mattmann, Ph.D.
>>> Senior Computer Scientist
>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>> Office: 171-266B, Mailstop: 171-246
*
*Open Source Solutions for Text Engineering

http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
http://twitter.com/digitalpebble

This is what is currently done and what I was essentially proposing.

I really don't know about the size of the bin artifact if we enable all
gora-* dependencies before packaging it for distribution... thanks to input
from yourselves we recently sorted out some size issues with 1.5, it would
be good to to have 2.0 shadow this.

I am +1 for shipping just src distributions for 2.0, this would keep the
default (gora-sql 0.1.1-incubating) ivy configuration.

If users can't do 'ant runtime' then you kinda got to wonder how they're
using Nutch at all...

On Thu, Jun 14, 2012 at 9:56 PM, Julien Nioche <
[EMAIL PROTECTED]> wrote:

> yep, remember that you can't build from the bin package so inevitably
> someone will wonder why only such or such backend is available etc...
>
> another option is to NOT have a binary release at all, in which case it is
> acceptable I think not to include the deps in ivy. Maybe we should at least
> add them but comment them out
>
> Ju
>
>
> On 14 June 2012 21:51, Lewis John Mcgibbney <[EMAIL PROTECTED]>wrote:
>
>> Hi Julien,
>>
>> Do you suggest with the binary release that we simply open up all gora-*
>> deps and ship it with every jar available?
>>
>> Lewis
>>
>>
>> On Thu, Jun 14, 2012 at 9:39 PM, Julien Nioche <
>> [EMAIL PROTECTED]> wrote:
>>
>>> I disagree. You'd expect a binary release to work out of the box - which
>>> is not the case. Plus we'd have to spend more time explaining the
>>> workaround, answering the same questions over and over on the ML etc...
>>> Fixing this should not be a big deal (i.e. add the gore-x modules for the
>>> backends to the ivy deps file).
>>>
>>> Julien
>>>
>>>
>>> On 14 June 2012 20:27, Mattmann, Chris A (388J) <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> Hey Guys,
>>>>
>>>> I think the annoyance is probably something folks can live with as they
>>>> have been
>>>> waiting for an "official" release of 2.x for years :)
>>>>
>>>> My +1 to roll RC #2 with or without a solution to this and mark it as a
>>>> TODO. "release
>>>> eary", "release often" :)
>>>>
>>>> Cheers,
>>>> Chris
>>>>
>>>> On Jun 14, 2012, at 10:04 AM, Lewis John Mcgibbney wrote:
>>>>
>>>> > Aye this is no good at all. Depending on which backend you wish to
>>>> use with Gora, you will need to go and manually fetch the correct .jar's
>>>> from maven central.
>>>> >
>>>> > Does anyone else have either solution or a workaround before I push
>>>> RC2 with just src dists?
>>>> >
>>>> > Thanks
>>>> >
>>>> > Lewis
>>>> >
>>>> > On Thu, Jun 14, 2012 at 4:52 PM, Sebastian Nagel <
>>>> [EMAIL PROTECTED]> wrote:
>>>> > > We only supply src distributions...
>>>> > > Does this principle apply to Nutch 2 as well?
>>>> > Maybe, yes.
>>>> > The situation with the current binary package is uncomfortable:
>>>> > I had to copy/link gora-hbase and hbase jars into lib/ to get nutch
>>>> running.
>>>> >
>>>> > 2012/6/13 Lewis John Mcgibbney <[EMAIL PROTECTED]>
>>>> > Hi Guys,
>>>> >
>>>> > Whilst updating the Nutch2Tutorial I got thinking that within Gora we
>>>> don't supply binary distributions of the code, this is because when using
>>>> Gora a user may wish/require to recompile the code to accomodate config
>>>> changes etc. We only supply src distributions...
>>>> >
>>>> > Does this principle apply to Nutch 2 as well? I mean, what if your
>>>> using the gora-sql dependency, then you wish to switch to HBase and
>>>> recompile, is this possible within the binary distribution?
>>>> >
>>>> > Best
>>>> >
>>>> > Lewis
>>>> >
>>>> >
>>>> > On Wed, Jun 13, 2012 at 3:38 PM, Julien Nioche <
>>>> [EMAIL PROTECTED]> wrote:
>>>> > Ferdy
>>>> >
>>>> > The Nutch job jar is not present in the binary archive. This means
>>>> distributed running of jobs is not supported. I'm not sure if this is a
>>>> problem (since users can always build one themselves), merely pointing it
>>>> out. The recently released 1.5 also lacks this job jar, so at least no
>>>> difference there.
*Lewis*

Or just not ship a bin release at all. Src is the only thing we really VOTE on legally though bin is provided for convenience purposes. Will type more on this later...

Sent from my iPhone

On Jun 14, 2012, at 2:18 PM, "Lewis John Mcgibbney" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:

Hi Julien,

Do you suggest with the binary release that we simply open up all gora-* deps and ship it with every jar available?

Lewis

On Thu, Jun 14, 2012 at 9:39 PM, Julien Nioche <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
I disagree. You'd expect a binary release to work out of the box - which is not the case. Plus we'd have to spend more time explaining the workaround, answering the same questions over and over on the ML etc... Fixing this should not be a big deal (i.e. add the gore-x modules for the backends to the ivy deps file).

Julien
On 14 June 2012 20:27, Mattmann, Chris A (388J) <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Hey Guys,

I think the annoyance is probably something folks can live with as they have been
waiting for an "official" release of 2.x for years :)

My +1 to roll RC #2 with or without a solution to this and mark it as a TODO. "release
eary", "release often" :)

Cheers,
Chris

On Jun 14, 2012, at 10:04 AM, Lewis John Mcgibbney wrote:

> Aye this is no good at all. Depending on which backend you wish to use with Gora, you will need to go and manually fetch the correct .jar's from maven central.
>
> Does anyone else have either solution or a workaround before I push RC2 with just src dists?
>
> Thanks
>
> Lewis
>
> On Thu, Jun 14, 2012 at 4:52 PM, Sebastian Nagel <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
> > We only supply src distributions...
> > Does this principle apply to Nutch 2 as well?
> Maybe, yes.
> The situation with the current binary package is uncomfortable:
> I had to copy/link gora-hbase and hbase jars into lib/ to get nutch running.
>
> 2012/6/13 Lewis John Mcgibbney <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
> Hi Guys,
>
> Whilst updating the Nutch2Tutorial I got thinking that within Gora we don't supply binary distributions of the code, this is because when using Gora a user may wish/require to recompile the code to accomodate config changes etc. We only supply src distributions...
>
> Does this principle apply to Nutch 2 as well? I mean, what if your using the gora-sql dependency, then you wish to switch to HBase and recompile, is this possible within the binary distribution?
>
> Best
>
> Lewis
>
>
> On Wed, Jun 13, 2012 at 3:38 PM, Julien Nioche <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
> Ferdy
>
> The Nutch job jar is not present in the binary archive. This means distributed running of jobs is not supported. I'm not sure if this is a problem (since users can always build one themselves), merely pointing it out. The recently released 1.5 also lacks this job jar, so at least no difference there.
>
> The binary distrib corresponds to runtime/local and as such should NOT have the job file there. This is now the norm since 1.5
>
> Will try and do some testing of the RC
>
> Thanks
>
> Julien
>
>
>
> --
>
> Open Source Solutions for Text Engineering
>
> http://digitalpebble.blogspot.com/
> http://www.digitalpebble.com
> http://twitter.com/digitalpebble
>
>
>
>
> --
> Lewis
>
>
>
>
>
> --
> Lewis
>
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
WWW:   http://sunset.usc.edu/~mattmann/<http://sunset.usc.edu/%7Emattmann/>
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
[http://digitalpebble.com/img/logo.gif]
Open Source Solutions for Text Engineering

http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
http://twitter.com/digitalpebble
Lewis

Agree with only releasing src.

On Thu, Jun 14, 2012 at 11:32 PM, Mattmann, Chris A (388J) <
[EMAIL PROTECTED]> wrote:

>  Or just not ship a bin release at all. Src is the only thing we really
> VOTE on legally though bin is provided for convenience purposes. Will type
> more on this later...
>
> Sent from my iPhone
>
> On Jun 14, 2012, at 2:18 PM, "Lewis John Mcgibbney" <
> [EMAIL PROTECTED]> wrote:
>
>   Hi Julien,
>
> Do you suggest with the binary release that we simply open up all gora-*
> deps and ship it with every jar available?
>
> Lewis
>
> On Thu, Jun 14, 2012 at 9:39 PM, Julien Nioche <
> [EMAIL PROTECTED]> wrote:
>
>> I disagree. You'd expect a binary release to work out of the box - which
>> is not the case. Plus we'd have to spend more time explaining the
>> workaround, answering the same questions over and over on the ML etc...
>> Fixing this should not be a big deal (i.e. add the gore-x modules for the
>> backends to the ivy deps file).
>>
>> Julien
>>
>>
>> On 14 June 2012 20:27, Mattmann, Chris A (388J) <
>> [EMAIL PROTECTED]> wrote:
>>
>>> Hey Guys,
>>>
>>> I think the annoyance is probably something folks can live with as they
>>> have been
>>> waiting for an "official" release of 2.x for years :)
>>>
>>> My +1 to roll RC #2 with or without a solution to this and mark it as a
>>> TODO. "release
>>> eary", "release often" :)
>>>
>>> Cheers,
>>> Chris
>>>
>>> On Jun 14, 2012, at 10:04 AM, Lewis John Mcgibbney wrote:
>>>
>>> > Aye this is no good at all. Depending on which backend you wish to use
>>> with Gora, you will need to go and manually fetch the correct .jar's from
>>> maven central.
>>> >
>>> > Does anyone else have either solution or a workaround before I push
>>> RC2 with just src dists?
>>> >
>>> > Thanks
>>> >
>>> > Lewis
>>> >
>>> > On Thu, Jun 14, 2012 at 4:52 PM, Sebastian Nagel <
>>> [EMAIL PROTECTED]> wrote:
>>> > > We only supply src distributions...
>>> > > Does this principle apply to Nutch 2 as well?
>>> > Maybe, yes.
>>> > The situation with the current binary package is uncomfortable:
>>> > I had to copy/link gora-hbase and hbase jars into lib/ to get nutch
>>> running.
>>> >
>>> > 2012/6/13 Lewis John Mcgibbney <[EMAIL PROTECTED]>
>>> > Hi Guys,
>>> >
>>> > Whilst updating the Nutch2Tutorial I got thinking that within Gora we
>>> don't supply binary distributions of the code, this is because when using
>>> Gora a user may wish/require to recompile the code to accomodate config
>>> changes etc. We only supply src distributions...
>>> >
>>> > Does this principle apply to Nutch 2 as well? I mean, what if your
>>> using the gora-sql dependency, then you wish to switch to HBase and
>>> recompile, is this possible within the binary distribution?
>>> >
>>> > Best
>>> >
>>> > Lewis
>>> >
>>> >
>>> > On Wed, Jun 13, 2012 at 3:38 PM, Julien Nioche <
>>> [EMAIL PROTECTED]> wrote:
>>> > Ferdy
>>> >
>>> > The Nutch job jar is not present in the binary archive. This means
>>> distributed running of jobs is not supported. I'm not sure if this is a
>>> problem (since users can always build one themselves), merely pointing it
>>> out. The recently released 1.5 also lacks this job jar, so at least no
>>> difference there.
>>> >
>>> > The binary distrib corresponds to runtime/local and as such should NOT
>>> have the job file there. This is now the norm since 1.5
>>> >
>>> > Will try and do some testing of the RC
>>> >
>>> > Thanks
>>> >
>>> > Julien
>>> >
>>> >
>>> >
>>> > --
>>> >
>>>  > Open Source Solutions for Text Engineering
>>> >
>>> > http://digitalpebble.blogspot.com/
>>> > http://www.digitalpebble.com
>>> > http://twitter.com/digitalpebble
>>> >
>>> >
>>> >
>>> >
>>> > --
>>> > Lewis
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > --
>>> > Lewis
>>> >
>>>
>>>
>>>  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>> Chris Mattmann, Ph.D.
>>> Senior Computer Scientist
>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA

+1

On 15 June 2012 09:00, Ferdy Galema <[EMAIL PROTECTED]> wrote:

> Agree with only releasing src.
>
>
> On Thu, Jun 14, 2012 at 11:32 PM, Mattmann, Chris A (388J) <
> [EMAIL PROTECTED]> wrote:
>
>>  Or just not ship a bin release at all. Src is the only thing we really
>> VOTE on legally though bin is provided for convenience purposes. Will type
>> more on this later...
>>
>> Sent from my iPhone
>>
>> On Jun 14, 2012, at 2:18 PM, "Lewis John Mcgibbney" <
>> [EMAIL PROTECTED]> wrote:
>>
>>   Hi Julien,
>>
>> Do you suggest with the binary release that we simply open up all gora-*
>> deps and ship it with every jar available?
>>
>> Lewis
>>
>> On Thu, Jun 14, 2012 at 9:39 PM, Julien Nioche <
>> [EMAIL PROTECTED]> wrote:
>>
>>> I disagree. You'd expect a binary release to work out of the box - which
>>> is not the case. Plus we'd have to spend more time explaining the
>>> workaround, answering the same questions over and over on the ML etc...
>>> Fixing this should not be a big deal (i.e. add the gore-x modules for the
>>> backends to the ivy deps file).
>>>
>>> Julien
>>>
>>>
>>> On 14 June 2012 20:27, Mattmann, Chris A (388J) <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> Hey Guys,
>>>>
>>>> I think the annoyance is probably something folks can live with as they
>>>> have been
>>>> waiting for an "official" release of 2.x for years :)
>>>>
>>>> My +1 to roll RC #2 with or without a solution to this and mark it as a
>>>> TODO. "release
>>>> eary", "release often" :)
>>>>
>>>> Cheers,
>>>> Chris
>>>>
>>>> On Jun 14, 2012, at 10:04 AM, Lewis John Mcgibbney wrote:
>>>>
>>>> > Aye this is no good at all. Depending on which backend you wish to
>>>> use with Gora, you will need to go and manually fetch the correct .jar's
>>>> from maven central.
>>>> >
>>>> > Does anyone else have either solution or a workaround before I push
>>>> RC2 with just src dists?
>>>> >
>>>> > Thanks
>>>> >
>>>> > Lewis
>>>> >
>>>> > On Thu, Jun 14, 2012 at 4:52 PM, Sebastian Nagel <
>>>> [EMAIL PROTECTED]> wrote:
>>>> > > We only supply src distributions...
>>>> > > Does this principle apply to Nutch 2 as well?
>>>> > Maybe, yes.
>>>> > The situation with the current binary package is uncomfortable:
>>>> > I had to copy/link gora-hbase and hbase jars into lib/ to get nutch
>>>> running.
>>>> >
>>>> > 2012/6/13 Lewis John Mcgibbney <[EMAIL PROTECTED]>
>>>> > Hi Guys,
>>>> >
>>>> > Whilst updating the Nutch2Tutorial I got thinking that within Gora we
>>>> don't supply binary distributions of the code, this is because when using
>>>> Gora a user may wish/require to recompile the code to accomodate config
>>>> changes etc. We only supply src distributions...
>>>> >
>>>> > Does this principle apply to Nutch 2 as well? I mean, what if your
>>>> using the gora-sql dependency, then you wish to switch to HBase and
>>>> recompile, is this possible within the binary distribution?
>>>> >
>>>> > Best
>>>> >
>>>> > Lewis
>>>> >
>>>> >
>>>> > On Wed, Jun 13, 2012 at 3:38 PM, Julien Nioche <
>>>> [EMAIL PROTECTED]> wrote:
>>>> > Ferdy
>>>> >
>>>> > The Nutch job jar is not present in the binary archive. This means
>>>> distributed running of jobs is not supported. I'm not sure if this is a
>>>> problem (since users can always build one themselves), merely pointing it
>>>> out. The recently released 1.5 also lacks this job jar, so at least no
>>>> difference there.
>>>> >
>>>> > The binary distrib corresponds to runtime/local and as such should
>>>> NOT have the job file there. This is now the norm since 1.5
>>>> >
>>>> > Will try and do some testing of the RC
>>>> >
>>>> > Thanks
>>>> >
>>>> > Julien
>>>> >
>>>> >
>>>> >
>>>> > --
>>>> >
>>>>  > Open Source Solutions for Text Engineering
>>>> >
>>>> > http://digitalpebble.blogspot.com/
>>>> > http://www.digitalpebble.com
>>>> > http://twitter.com/digitalpebble
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > --
>>>> > Lewis
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>

*
*Open Source Solutions for Text Engineering

http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
http://twitter.com/digitalpebble

I'll push this in an hour or so guys.

Thanks for the input.

Lewis

On Fri, Jun 15, 2012 at 9:39 AM, Julien Nioche <
[EMAIL PROTECTED]> wrote:

> +1
>
>
> On 15 June 2012 09:00, Ferdy Galema <[EMAIL PROTECTED]> wrote:
>
>> Agree with only releasing src.
>>
>>
>> On Thu, Jun 14, 2012 at 11:32 PM, Mattmann, Chris A (388J) <
>> [EMAIL PROTECTED]> wrote:
>>
>>>  Or just not ship a bin release at all. Src is the only thing we really
>>> VOTE on legally though bin is provided for convenience purposes. Will type
>>> more on this later...
>>>
>>> Sent from my iPhone
>>>
>>> On Jun 14, 2012, at 2:18 PM, "Lewis John Mcgibbney" <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>   Hi Julien,
>>>
>>> Do you suggest with the binary release that we simply open up all gora-*
>>> deps and ship it with every jar available?
>>>
>>> Lewis
>>>
>>> On Thu, Jun 14, 2012 at 9:39 PM, Julien Nioche <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> I disagree. You'd expect a binary release to work out of the box -
>>>> which is not the case. Plus we'd have to spend more time explaining the
>>>> workaround, answering the same questions over and over on the ML etc...
>>>> Fixing this should not be a big deal (i.e. add the gore-x modules for the
>>>> backends to the ivy deps file).
>>>>
>>>> Julien
>>>>
>>>>
>>>> On 14 June 2012 20:27, Mattmann, Chris A (388J) <
>>>> [EMAIL PROTECTED]> wrote:
>>>>
>>>>> Hey Guys,
>>>>>
>>>>> I think the annoyance is probably something folks can live with as
>>>>> they have been
>>>>> waiting for an "official" release of 2.x for years :)
>>>>>
>>>>> My +1 to roll RC #2 with or without a solution to this and mark it as
>>>>> a TODO. "release
>>>>> eary", "release often" :)
>>>>>
>>>>> Cheers,
>>>>> Chris
>>>>>
>>>>> On Jun 14, 2012, at 10:04 AM, Lewis John Mcgibbney wrote:
>>>>>
>>>>> > Aye this is no good at all. Depending on which backend you wish to
>>>>> use with Gora, you will need to go and manually fetch the correct .jar's
>>>>> from maven central.
>>>>> >
>>>>> > Does anyone else have either solution or a workaround before I push
>>>>> RC2 with just src dists?
>>>>> >
>>>>> > Thanks
>>>>> >
>>>>> > Lewis
>>>>> >
>>>>> > On Thu, Jun 14, 2012 at 4:52 PM, Sebastian Nagel <
>>>>> [EMAIL PROTECTED]> wrote:
>>>>> > > We only supply src distributions...
>>>>> > > Does this principle apply to Nutch 2 as well?
>>>>> > Maybe, yes.
>>>>> > The situation with the current binary package is uncomfortable:
>>>>> > I had to copy/link gora-hbase and hbase jars into lib/ to get nutch
>>>>> running.
>>>>> >
>>>>> > 2012/6/13 Lewis John Mcgibbney <[EMAIL PROTECTED]>
>>>>> > Hi Guys,
>>>>> >
>>>>> > Whilst updating the Nutch2Tutorial I got thinking that within Gora
>>>>> we don't supply binary distributions of the code, this is because when
>>>>> using Gora a user may wish/require to recompile the code to accomodate
>>>>> config changes etc. We only supply src distributions...
>>>>> >
>>>>> > Does this principle apply to Nutch 2 as well? I mean, what if your
>>>>> using the gora-sql dependency, then you wish to switch to HBase and
>>>>> recompile, is this possible within the binary distribution?
>>>>> >
>>>>> > Best
>>>>> >
>>>>> > Lewis
>>>>> >
>>>>> >
>>>>> > On Wed, Jun 13, 2012 at 3:38 PM, Julien Nioche <
>>>>> [EMAIL PROTECTED]> wrote:
>>>>> > Ferdy
>>>>> >
>>>>> > The Nutch job jar is not present in the binary archive. This means
>>>>> distributed running of jobs is not supported. I'm not sure if this is a
>>>>> problem (since users can always build one themselves), merely pointing it
>>>>> out. The recently released 1.5 also lacks this job jar, so at least no
>>>>> difference there.
>>>>> >
>>>>> > The binary distrib corresponds to runtime/local and as such should
>>>>> NOT have the job file there. This is now the norm since 1.5
>>>>> >
>>>>> > Will try and do some testing of the RC
>>>>> >
>>>>> > Thanks
>>>>> >
>>>>> > Julien
>>>>> >
>>>>> >
>>>>> >
>>>>> > --
*Lewis*

Before you do, could you check that NutchGora passes ant test successfully.
I just tried and got an error related to the parse-tika tests. Am about to
open a JIRA to update to the latest version of Tika for NutchGora which
should fix the problem and put it at the same level as trunk

J

On 15 June 2012 10:01, Lewis John Mcgibbney <[EMAIL PROTECTED]>wrote:ly

> I'll push this in an hour or so guys.
>
> Thanks for the input.
>
> Lewis
>
>
> On Fri, Jun 15, 2012 at 9:39 AM, Julien Nioche <
> [EMAIL PROTECTED]> wrote:
>
>> +1
>>
>>
>> On 15 June 2012 09:00, Ferdy Galema <[EMAIL PROTECTED]> wrote:
>>
>>> Agree with only releasing src.
>>>
>>>
>>> On Thu, Jun 14, 2012 at 11:32 PM, Mattmann, Chris A (388J) <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>>  Or just not ship a bin release at all. Src is the only thing we
>>>> really VOTE on legally though bin is provided for convenience purposes.
>>>> Will type more on this later...
>>>>
>>>> Sent from my iPhone
>>>>
>>>> On Jun 14, 2012, at 2:18 PM, "Lewis John Mcgibbney" <
>>>> [EMAIL PROTECTED]> wrote:
>>>>
>>>>   Hi Julien,
>>>>
>>>> Do you suggest with the binary release that we simply open up all
>>>> gora-* deps and ship it with every jar available?
>>>>
>>>> Lewis
>>>>
>>>> On Thu, Jun 14, 2012 at 9:39 PM, Julien Nioche <
>>>> [EMAIL PROTECTED]> wrote:
>>>>
>>>>> I disagree. You'd expect a binary release to work out of the box -
>>>>> which is not the case. Plus we'd have to spend more time explaining the
>>>>> workaround, answering the same questions over and over on the ML etc...
>>>>> Fixing this should not be a big deal (i.e. add the gore-x modules for the
>>>>> backends to the ivy deps file).
>>>>>
>>>>> Julien
>>>>>
>>>>>
>>>>> On 14 June 2012 20:27, Mattmann, Chris A (388J) <
>>>>> [EMAIL PROTECTED]> wrote:
>>>>>
>>>>>> Hey Guys,
>>>>>>
>>>>>> I think the annoyance is probably something folks can live with as
>>>>>> they have been
>>>>>> waiting for an "official" release of 2.x for years :)
>>>>>>
>>>>>> My +1 to roll RC #2 with or without a solution to this and mark it as
>>>>>> a TODO. "release
>>>>>> eary", "release often" :)
>>>>>>
>>>>>> Cheers,
>>>>>> Chris
>>>>>>
>>>>>> On Jun 14, 2012, at 10:04 AM, Lewis John Mcgibbney wrote:
>>>>>>
>>>>>> > Aye this is no good at all. Depending on which backend you wish to
>>>>>> use with Gora, you will need to go and manually fetch the correct .jar's
>>>>>> from maven central.
>>>>>> >
>>>>>> > Does anyone else have either solution or a workaround before I push
>>>>>> RC2 with just src dists?
>>>>>> >
>>>>>> > Thanks
>>>>>> >
>>>>>> > Lewis
>>>>>> >
>>>>>> > On Thu, Jun 14, 2012 at 4:52 PM, Sebastian Nagel <
>>>>>> [EMAIL PROTECTED]> wrote:
>>>>>> > > We only supply src distributions...
>>>>>> > > Does this principle apply to Nutch 2 as well?
>>>>>> > Maybe, yes.
>>>>>> > The situation with the current binary package is uncomfortable:
>>>>>> > I had to copy/link gora-hbase and hbase jars into lib/ to get nutch
>>>>>> running.
>>>>>> >
>>>>>> > 2012/6/13 Lewis John Mcgibbney <[EMAIL PROTECTED]>
>>>>>> > Hi Guys,
>>>>>> >
>>>>>> > Whilst updating the Nutch2Tutorial I got thinking that within Gora
>>>>>> we don't supply binary distributions of the code, this is because when
>>>>>> using Gora a user may wish/require to recompile the code to accomodate
>>>>>> config changes etc. We only supply src distributions...
>>>>>> >
>>>>>> > Does this principle apply to Nutch 2 as well? I mean, what if your
>>>>>> using the gora-sql dependency, then you wish to switch to HBase and
>>>>>> recompile, is this possible within the binary distribution?
>>>>>> >
>>>>>> > Best
>>>>>> >
>>>>>> > Lewis
>>>>>> >
>>>>>> >
>>>>>> > On Wed, Jun 13, 2012 at 3:38 PM, Julien Nioche <
>>>>>> [EMAIL PROTECTED]> wrote:
>>>>>> > Ferdy
>>>>>> >
>>>>>> > The Nutch job jar is not present in the binary archive. This means
>>>>>> distributed running of jobs is not supported. I'm not sure if this is a
*
*Open Source Solutions for Text Engineering

http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
http://twitter.com/digitalpebble

see https://issues.apache.org/jira/browse/NUTCH-1396

On 15 June 2012 10:43, Julien Nioche <[EMAIL PROTECTED]> wrote:

> Before you do, could you check that NutchGora passes ant test
> successfully. I just tried and got an error related to the parse-tika
> tests. Am about to open a JIRA to update to the latest version of Tika for
> NutchGora which should fix the problem and put it at the same level as trunk
>
> J
>
> On 15 June 2012 10:01, Lewis John Mcgibbney <[EMAIL PROTECTED]>wrote:ly
>
> I'll push this in an hour or so guys.
>>
>> Thanks for the input.
>>
>> Lewis
>>
>>
>> On Fri, Jun 15, 2012 at 9:39 AM, Julien Nioche <
>> [EMAIL PROTECTED]> wrote:
>>
>>> +1
>>>
>>>
>>> On 15 June 2012 09:00, Ferdy Galema <[EMAIL PROTECTED]> wrote:
>>>
>>>> Agree with only releasing src.
>>>>
>>>>
>>>> On Thu, Jun 14, 2012 at 11:32 PM, Mattmann, Chris A (388J) <
>>>> [EMAIL PROTECTED]> wrote:
>>>>
>>>>>  Or just not ship a bin release at all. Src is the only thing we
>>>>> really VOTE on legally though bin is provided for convenience purposes.
>>>>> Will type more on this later...
>>>>>
>>>>> Sent from my iPhone
>>>>>
>>>>> On Jun 14, 2012, at 2:18 PM, "Lewis John Mcgibbney" <
>>>>> [EMAIL PROTECTED]> wrote:
>>>>>
>>>>>   Hi Julien,
>>>>>
>>>>> Do you suggest with the binary release that we simply open up all
>>>>> gora-* deps and ship it with every jar available?
>>>>>
>>>>> Lewis
>>>>>
>>>>> On Thu, Jun 14, 2012 at 9:39 PM, Julien Nioche <
>>>>> [EMAIL PROTECTED]> wrote:
>>>>>
>>>>>> I disagree. You'd expect a binary release to work out of the box -
>>>>>> which is not the case. Plus we'd have to spend more time explaining the
>>>>>> workaround, answering the same questions over and over on the ML etc...
>>>>>> Fixing this should not be a big deal (i.e. add the gore-x modules for the
>>>>>> backends to the ivy deps file).
>>>>>>
>>>>>> Julien
>>>>>>
>>>>>>
>>>>>> On 14 June 2012 20:27, Mattmann, Chris A (388J) <
>>>>>> [EMAIL PROTECTED]> wrote:
>>>>>>
>>>>>>> Hey Guys,
>>>>>>>
>>>>>>> I think the annoyance is probably something folks can live with as
>>>>>>> they have been
>>>>>>> waiting for an "official" release of 2.x for years :)
>>>>>>>
>>>>>>> My +1 to roll RC #2 with or without a solution to this and mark it
>>>>>>> as a TODO. "release
>>>>>>> eary", "release often" :)
>>>>>>>
>>>>>>> Cheers,
>>>>>>> Chris
>>>>>>>
>>>>>>> On Jun 14, 2012, at 10:04 AM, Lewis John Mcgibbney wrote:
>>>>>>>
>>>>>>> > Aye this is no good at all. Depending on which backend you wish to
>>>>>>> use with Gora, you will need to go and manually fetch the correct .jar's
>>>>>>> from maven central.
>>>>>>> >
>>>>>>> > Does anyone else have either solution or a workaround before I
>>>>>>> push RC2 with just src dists?
>>>>>>> >
>>>>>>> > Thanks
>>>>>>> >
>>>>>>> > Lewis
>>>>>>> >
>>>>>>> > On Thu, Jun 14, 2012 at 4:52 PM, Sebastian Nagel <
>>>>>>> [EMAIL PROTECTED]> wrote:
>>>>>>> > > We only supply src distributions...
>>>>>>> > > Does this principle apply to Nutch 2 as well?
>>>>>>> > Maybe, yes.
>>>>>>> > The situation with the current binary package is uncomfortable:
>>>>>>> > I had to copy/link gora-hbase and hbase jars into lib/ to get
>>>>>>> nutch running.
>>>>>>> >
>>>>>>> > 2012/6/13 Lewis John Mcgibbney <[EMAIL PROTECTED]>
>>>>>>> > Hi Guys,
>>>>>>> >
>>>>>>> > Whilst updating the Nutch2Tutorial I got thinking that within Gora
>>>>>>> we don't supply binary distributions of the code, this is because when
>>>>>>> using Gora a user may wish/require to recompile the code to accomodate
>>>>>>> config changes etc. We only supply src distributions...
>>>>>>> >
>>>>>>> > Does this principle apply to Nutch 2 as well? I mean, what if your
>>>>>>> using the gora-sql dependency, then you wish to switch to HBase and
>>>>>>> recompile, is this possible within the binary distribution?
>>>>>>> >
>>>>>>> > Best
>>>>>>> >
>>>>>>> > Lewis
>>>>>>> >
>>>>>>> >
>>>>>>> > On Wed, Jun 13, 2012 at 3:38 PM, Julien Nioche <
*
*Open Source Solutions for Text Engineering

http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
http://twitter.com/digitalpebble

OK you are just making us all look bad now Juls ;)

Super fast!

Cheers,
Chris
On Jun 15, 2012, at 2:54 AM, Julien Nioche wrote:

> see https://issues.apache.org/jira/browse/NUTCH-1396
>
> On 15 June 2012 10:43, Julien Nioche <[EMAIL PROTECTED]> wrote:
> Before you do, could you check that NutchGora passes ant test successfully. I just tried and got an error related to the parse-tika tests. Am about to open a JIRA to update to the latest version of Tika for NutchGora which should fix the problem and put it at the same level as trunk
>
> J
>
> On 15 June 2012 10:01, Lewis John Mcgibbney <[EMAIL PROTECTED]> wrote:ly
>
> I'll push this in an hour or so guys.
>
> Thanks for the input.
>
> Lewis
>
>
> On Fri, Jun 15, 2012 at 9:39 AM, Julien Nioche <[EMAIL PROTECTED]> wrote:
> +1
>
>
> On 15 June 2012 09:00, Ferdy Galema <[EMAIL PROTECTED]> wrote:
> Agree with only releasing src.
>
>
> On Thu, Jun 14, 2012 at 11:32 PM, Mattmann, Chris A (388J) <[EMAIL PROTECTED]> wrote:
> Or just not ship a bin release at all. Src is the only thing we really VOTE on legally though bin is provided for convenience purposes. Will type more on this later...
>
> Sent from my iPhone
>
> On Jun 14, 2012, at 2:18 PM, "Lewis John Mcgibbney" <[EMAIL PROTECTED]> wrote:
>
>> Hi Julien,
>>
>> Do you suggest with the binary release that we simply open up all gora-* deps and ship it with every jar available?
>>
>> Lewis
>>
>> On Thu, Jun 14, 2012 at 9:39 PM, Julien Nioche <[EMAIL PROTECTED]> wrote:
>> I disagree. You'd expect a binary release to work out of the box - which is not the case. Plus we'd have to spend more time explaining the workaround, answering the same questions over and over on the ML etc... Fixing this should not be a big deal (i.e. add the gore-x modules for the backends to the ivy deps file).
>>
>> Julien
>>
>>
>> On 14 June 2012 20:27, Mattmann, Chris A (388J) <[EMAIL PROTECTED]> wrote:
>> Hey Guys,
>>
>> I think the annoyance is probably something folks can live with as they have been
>> waiting for an "official" release of 2.x for years :)
>>
>> My +1 to roll RC #2 with or without a solution to this and mark it as a TODO. "release
>> eary", "release often" :)
>>
>> Cheers,
>> Chris
>>
>> On Jun 14, 2012, at 10:04 AM, Lewis John Mcgibbney wrote:
>>
>> > Aye this is no good at all. Depending on which backend you wish to use with Gora, you will need to go and manually fetch the correct .jar's from maven central.
>> >
>> > Does anyone else have either solution or a workaround before I push RC2 with just src dists?
>> >
>> > Thanks
>> >
>> > Lewis
>> >
>> > On Thu, Jun 14, 2012 at 4:52 PM, Sebastian Nagel <[EMAIL PROTECTED]> wrote:
>> > > We only supply src distributions...
>> > > Does this principle apply to Nutch 2 as well?
>> > Maybe, yes.
>> > The situation with the current binary package is uncomfortable:
>> > I had to copy/link gora-hbase and hbase jars into lib/ to get nutch running.
>> >
>> > 2012/6/13 Lewis John Mcgibbney <[EMAIL PROTECTED]>
>> > Hi Guys,
>> >
>> > Whilst updating the Nutch2Tutorial I got thinking that within Gora we don't supply binary distributions of the code, this is because when using Gora a user may wish/require to recompile the code to accomodate config changes etc. We only supply src distributions...
>> >
>> > Does this principle apply to Nutch 2 as well? I mean, what if your using the gora-sql dependency, then you wish to switch to HBase and recompile, is this possible within the binary distribution?
>> >
>> > Best
>> >
>> > Lewis
>> >
>> >
>> > On Wed, Jun 13, 2012 at 3:38 PM, Julien Nioche <[EMAIL PROTECTED]> wrote:
>> > Ferdy
>> >
>> > The Nutch job jar is not present in the binary archive. This means distributed running of jobs is not supported. I'm not sure if this is a problem (since users can always build one themselves), merely pointing it out. The recently released 1.5 also lacks this job jar, so at least no difference there.
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: [EMAIL PROTECTED]
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

That was not intented. Just that am on holidays, it's raining and the
children were either asleep or playing nicely :-)

On 15 June 2012 18:19, Mattmann, Chris A (388J) <
[EMAIL PROTECTED]> wrote:

> OK you are just making us all look bad now Juls ;)
>
> Super fast!
>
> Cheers,
> Chris
>
>
> On Jun 15, 2012, at 2:54 AM, Julien Nioche wrote:
>
> > see https://issues.apache.org/jira/browse/NUTCH-1396
> >
> > On 15 June 2012 10:43, Julien Nioche <[EMAIL PROTECTED]>
> wrote:
> > Before you do, could you check that NutchGora passes ant test
> successfully. I just tried and got an error related to the parse-tika
> tests. Am about to open a JIRA to update to the latest version of Tika for
> NutchGora which should fix the problem and put it at the same level as trunk
> >
> > J
> >
> > On 15 June 2012 10:01, Lewis John Mcgibbney <[EMAIL PROTECTED]>
> wrote:ly
> >
> > I'll push this in an hour or so guys.
> >
> > Thanks for the input.
> >
> > Lewis
> >
> >
> > On Fri, Jun 15, 2012 at 9:39 AM, Julien Nioche <
> [EMAIL PROTECTED]> wrote:
> > +1
> >
> >
> > On 15 June 2012 09:00, Ferdy Galema <[EMAIL PROTECTED]> wrote:
> > Agree with only releasing src.
> >
> >
> > On Thu, Jun 14, 2012 at 11:32 PM, Mattmann, Chris A (388J) <
> [EMAIL PROTECTED]> wrote:
> > Or just not ship a bin release at all. Src is the only thing we really
> VOTE on legally though bin is provided for convenience purposes. Will type
> more on this later...
> >
> > Sent from my iPhone
> >
> > On Jun 14, 2012, at 2:18 PM, "Lewis John Mcgibbney" <
> [EMAIL PROTECTED]> wrote:
> >
> >> Hi Julien,
> >>
> >> Do you suggest with the binary release that we simply open up all
> gora-* deps and ship it with every jar available?
> >>
> >> Lewis
> >>
> >> On Thu, Jun 14, 2012 at 9:39 PM, Julien Nioche <
> [EMAIL PROTECTED]> wrote:
> >> I disagree. You'd expect a binary release to work out of the box -
> which is not the case. Plus we'd have to spend more time explaining the
> workaround, answering the same questions over and over on the ML etc...
> Fixing this should not be a big deal (i.e. add the gore-x modules for the
> backends to the ivy deps file).
> >>
> >> Julien
> >>
> >>
> >> On 14 June 2012 20:27, Mattmann, Chris A (388J) <
> [EMAIL PROTECTED]> wrote:
> >> Hey Guys,
> >>
> >> I think the annoyance is probably something folks can live with as they
> have been
> >> waiting for an "official" release of 2.x for years :)
> >>
> >> My +1 to roll RC #2 with or without a solution to this and mark it as a
> TODO. "release
> >> eary", "release often" :)
> >>
> >> Cheers,
> >> Chris
> >>
> >> On Jun 14, 2012, at 10:04 AM, Lewis John Mcgibbney wrote:
> >>
> >> > Aye this is no good at all. Depending on which backend you wish to
> use with Gora, you will need to go and manually fetch the correct .jar's
> from maven central.
> >> >
> >> > Does anyone else have either solution or a workaround before I push
> RC2 with just src dists?
> >> >
> >> > Thanks
> >> >
> >> > Lewis
> >> >
> >> > On Thu, Jun 14, 2012 at 4:52 PM, Sebastian Nagel <
> [EMAIL PROTECTED]> wrote:
> >> > > We only supply src distributions...
> >> > > Does this principle apply to Nutch 2 as well?
> >> > Maybe, yes.
> >> > The situation with the current binary package is uncomfortable:
> >> > I had to copy/link gora-hbase and hbase jars into lib/ to get nutch
> running.
> >> >
> >> > 2012/6/13 Lewis John Mcgibbney <[EMAIL PROTECTED]>
> >> > Hi Guys,
> >> >
> >> > Whilst updating the Nutch2Tutorial I got thinking that within Gora we
> don't supply binary distributions of the code, this is because when using
> Gora a user may wish/require to recompile the code to accomodate config
> changes etc. We only supply src distributions...
> >> >
> >> > Does this principle apply to Nutch 2 as well? I mean, what if your
> using the gora-sql dependency, then you wish to switch to HBase and
> recompile, is this possible within the binary distribution?
*
*Open Source Solutions for Text Engineering

http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
http://twitter.com/digitalpebble