Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Lucene and all its subprojects:

Switch to Threaded View
Nutch >> mail # user >> Failure authenticating with NTLM


Copy link to this message
-
Re: Failure authenticating with NTLM
Hi Gouri,

Did you see any HTTP error code in the stdout?

I'm not sure if this will work but you can try this:
http://hc.apache.org/httpcomponents-client-ga/ntlm.html

Remi

On Fri, Feb 17, 2012 at 1:27 PM, Gouri Deshpande <[EMAIL PROTECTED]>wrote:

> Hi,
>
> I am getting the error: Failure authenticating with NTLM  in the
> hadoop.logs.
>
> 1) Nutch version is 1.4
>
> 2) conf/httpclient-auth.xml contains the following:
>
> <auth-configuration>
>  <credentials username="xyz" password="abc">
>  <default/>
> </credentials>
> </auth-configuration>
>
> 3) hadoop.log shows the following:
>
> 2012-02-17 16:40:25,678 INFO  httpclient.Http - http.proxy.host = null
> 2012-02-17 16:40:25,678 INFO  httpclient.Http - http.proxy.port = 8080
> 2012-02-17 16:40:25,678 INFO  httpclient.Http - http.timeout = 10000
> 2012-02-17 16:40:25,678 INFO  httpclient.Http - http.content.limit > 2097152
> 2012-02-17 16:40:25,678 INFO  httpclient.Http - http.agent > Spider/Nutch-1.4
> 2012-02-17 16:40:25,678 INFO  httpclient.Http - http.accept.language > en-us,en-gb,en;q=0.7,*;q=0.3
> 2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Supported
> authentication schemes in the order of preference: [ntlm, digest, basic]
> 2012-02-17 16:40:26,552 INFO  auth.AuthChallengeProcessor - ntlm
> authentication scheme selected
> 2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Using
> authentication scheme: ntlm
> 2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Authorization
> challenge processed
> 2012-02-17 16:40:27,098 DEBUG auth.AuthChallengeProcessor - Using
> authentication scheme: ntlm
> 2012-02-17 16:40:27,098 DEBUG auth.AuthChallengeProcessor - Authorization
> challenge processed
> 2012-02-17 16:40:27,692 DEBUG auth.AuthChallengeProcessor - Using
> authentication scheme: ntlm
> 2012-02-17 16:40:27,692 DEBUG auth.AuthChallengeProcessor - Authorization
> challenge processed
> 2012-02-17 16:40:27,692 INFO  httpclient.HttpMethodDirector - Failure
> authenticating with NTLM <any realm>@xyz.com:80 <http://xyz.com/>
> 2012-02-17 16:40:27,832 INFO  parse.ParserChecker - parsing:
> http://xyz.com/Default.aspx
> 2012-02-17 16:40:27,832 INFO  parse.ParserChecker - contentType: text/html
>
> I have reffered the
> http://wiki.apache.org/nutch/HttpAuthenticationSchemes section
> NeedHelp and
> seems like I do not have answers for question number 4, 5, 6
>
> Please help me fix this problem.
>
> Thanks
> Gouri
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB