You could very well use Solr. It has support to index the PDF and XML
files. If you want to index websites and search using page rank then choose
Nutch.

Regards
Aditya
www.findbestopensource.com
On Wed, May 16, 2012 at 1:13 PM, Tolga <[EMAIL PROTECTED]> wrote:

> Hi,
>
> I have been trying for a week. I really want to get a start, so what
> should I use? curl or nutch? I want to be able to index pdf, xml etc. and
> search within them as well.
>
> Regards,
>

Can nutch crawl/index files as well?

On 5/16/12 12:29 PM, findbestopensource wrote:
> You could very well use Solr. It has support to index the PDF and XML
> files. If you want to index websites and search using page rank then choose
> Nutch.
>
> Regards
> Aditya
> www.findbestopensource.com
>
>
> On Wed, May 16, 2012 at 1:13 PM, Tolga<[EMAIL PROTECTED]>  wrote:
>
>> Hi,
>>
>> I have been trying for a week. I really want to get a start, so what
>> should I use? curl or nutch? I want to be able to index pdf, xml etc. and
>> search within them as well.
>>
>> Regards,
>>

It can, as can ManifoldCF.  But you should ask on nutch-user list (this may also be documented on the Wiki)

Otis 
----
Performance Monitoring for Solr / ElasticSearch / HBase - http://sematext.com/spm 

>________________________________
> From: Tolga <[EMAIL PROTECTED]>
>To: [EMAIL PROTECTED]
>Sent: Wednesday, May 16, 2012 8:11 AM
>Subject: Re: curl or nutch
>
>Can nutch crawl/index files as well?
>
>On 5/16/12 12:29 PM, findbestopensource wrote:
>> You could very well use Solr. It has support to index the PDF and XML
>> files. If you want to index websites and search using page rank then choose
>> Nutch.
>>
>> Regards
>> Aditya
>> www.findbestopensource.com
>>
>>
>> On Wed, May 16, 2012 at 1:13 PM, Tolga<[EMAIL PROTECTED]>  wrote:
>>
>>> Hi,
>>>
>>> I have been trying for a week. I really want to get a start, so what
>>> should I use? curl or nutch? I want to be able to index pdf, xml etc. and
>>> search within them as well.
>>>
>>> Regards,
>>>
>
>
>