Hello,

It seems to me that all options to updatedb command that nutch 1.4 has, have been removed in nutch-2.0. I would like to know if this was done purposefully or they will be added later? Also, how can I create multiple doc using parse command? It seem there is no sufficient arguments to parse command too.

Thanks in advance.
Alex.

Hi Alex,

On Mon, Jun 18, 2012 at 8:11 PM,  <[EMAIL PROTECTED]> wrote:
> Hello,
>
> It seems to me that all options to updatedb command that nutch 1.4 has, have been removed in nutch-2.0. I would like to know if this was done purposefully or they will be added later?

As you have noticed there are a number of differences between 1.X and 2.X.

W.r.t the ones you highlight e.g. CLI, yes these are intended

> Also, how can I create multiple doc using parse command?

Can you please elaborate slightly?

> It seem there is no >sufficient arguments to parse command too.

What would you like to see added? If you feel like adding
functionality then please open a ticket and if possible submit a patch
if you have time. I've been working with the parsing code and it works
fine for me but I don't fully understand your comment so if you again
could elaborate if would be excellent.

Thanks

Lewis

>
> Thanks in advance.
> Alex.

--
Lewis

Hi Lewis,

In 1.X version there are -noAdditions options to updatedb  and  -adddays option to generate commands. How something similar to them can be done in 2.X version?

Here, http://wiki.apache.org/nutch/Nutch2Roadmap it is stated
"Modify code so that parser can generate multiple documents which is what 1.x does but not 2.0"
It is my understanding that 1.X's parser does not create multiple documents, though. Then what is the meaning of the above statement?

Thanks.
Alex.

 

 

 

-----Original Message-----
From: Lewis John Mcgibbney <[EMAIL PROTECTED]>
To: user <[EMAIL PROTECTED]>
Sent: Tue, Jun 19, 2012 6:09 am
Subject: Re: nutch-2.0 updatedb and parse commands
Hi Alex,

On Mon, Jun 18, 2012 at 8:11 PM,  <[EMAIL PROTECTED]> wrote:
> Hello,
>
> It seems to me that all options to updatedb command that nutch 1.4 has, have
been removed in nutch-2.0. I would like to know if this was done purposefully or
they will be added later?

As you have noticed there are a number of differences between 1.X and 2.X.

W.r.t the ones you highlight e.g. CLI, yes these are intended

> Also, how can I create multiple doc using parse command?

Can you please elaborate slightly?

> It seem there is no >sufficient arguments to parse command too.

What would you like to see added? If you feel like adding
functionality then please open a ticket and if possible submit a patch
if you have time. I've been working with the parsing code and it works
fine for me but I don't fully understand your comment so if you again
could elaborate if would be excellent.

Thanks

Lewis

>
> Thanks in advance.
> Alex.

--
Lewis

 

Hi Alex,

On Tue, Jun 19, 2012 at 6:49 PM,  <[EMAIL PROTECTED]> wrote:
>
> In 1.X version there are -noAdditions options to updatedb  and  -adddays option to generate commands. How something similar to them can be done in 2.X version?

Yeah I suppose that this functionality could be added to Nutch 2.0, if
you are after it please feel free to open a ticket and we can begin
looking into it...

>
> Here, http://wiki.apache.org/nutch/Nutch2Roadmap it is stated

I am sorry to admit this but reading/scanning/quoting content from
within this page should be taken with a pinch of salt. I am not
entirely sure that it portrays a wholly accurate and true reflection
of where Nutch 2.X is going... the development team and the codebase
has had to adapt to dynamically changing conditions over the last
while.

> "Modify code so that parser can generate multiple documents which is what 1.x does but not 2.0"
> It is my understanding that 1.X's parser does not create multiple documents, though. Then what is the meaning of the above statement?

I really don't know... I'm hoping someone else could drop in on this
one and provide a bit of insight. I am also not familiar with the
concept of parsring implementations creating multiple documents out of
the box.

>
> Thanks.
> Alex.
>
>
>
>
>
>
>
> -----Original Message-----
> From: Lewis John Mcgibbney <[EMAIL PROTECTED]>
> To: user <[EMAIL PROTECTED]>
> Sent: Tue, Jun 19, 2012 6:09 am
> Subject: Re: nutch-2.0 updatedb and parse commands
>
>
> Hi Alex,
>
> On Mon, Jun 18, 2012 at 8:11 PM,  <[EMAIL PROTECTED]> wrote:
>> Hello,
>>
>> It seems to me that all options to updatedb command that nutch 1.4 has, have
> been removed in nutch-2.0. I would like to know if this was done purposefully or
> they will be added later?
>
> As you have noticed there are a number of differences between 1.X and 2.X.
>
> W.r.t the ones you highlight e.g. CLI, yes these are intended
>
>> Also, how can I create multiple doc using parse command?
>
> Can you please elaborate slightly?
>
>> It seem there is no >sufficient arguments to parse command too.
>
> What would you like to see added? If you feel like adding
> functionality then please open a ticket and if possible submit a patch
> if you have time. I've been working with the parsing code and it works
> fine for me but I don't fully understand your comment so if you again
> could elaborate if would be excellent.
>
> Thanks
>
> Lewis
>
>>
>> Thanks in advance.
>> Alex.
>
>
>
> --
> Lewis
>
>

--
Lewis