Home | About | Sematext search-lucene.com search-hadoop.com
 Search Lucene and all its subprojects:

Switch to Threaded View
Nutch >> mail # user >> Failure authenticating with NTLM


Copy link to this message
-
Re: Failure authenticating with NTLM
Hi Gouri,

Did you see any HTTP error code in the stdout?

I'm not sure if this will work but you can try this:
http://hc.apache.org/httpcomponents-client-ga/ntlm.html

Remi

On Fri, Feb 17, 2012 at 1:27 PM, Gouri Deshpande <[EMAIL PROTECTED]>wrote:

> Hi,
>
> I am getting the error: Failure authenticating with NTLM  in the
> hadoop.logs.
>
> 1) Nutch version is 1.4
>
> 2) conf/httpclient-auth.xml contains the following:
>
> <auth-configuration>
>  <credentials username="xyz" password="abc">
>  <default/>
> </credentials>
> </auth-configuration>
>
> 3) hadoop.log shows the following:
>
> 2012-02-17 16:40:25,678 INFO  httpclient.Http - http.proxy.host = null
> 2012-02-17 16:40:25,678 INFO  httpclient.Http - http.proxy.port = 8080
> 2012-02-17 16:40:25,678 INFO  httpclient.Http - http.timeout = 10000
> 2012-02-17 16:40:25,678 INFO  httpclient.Http - http.content.limit > 2097152
> 2012-02-17 16:40:25,678 INFO  httpclient.Http - http.agent > Spider/Nutch-1.4
> 2012-02-17 16:40:25,678 INFO  httpclient.Http - http.accept.language > en-us,en-gb,en;q=0.7,*;q=0.3
> 2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Supported
> authentication schemes in the order of preference: [ntlm, digest, basic]
> 2012-02-17 16:40:26,552 INFO  auth.AuthChallengeProcessor - ntlm
> authentication scheme selected
> 2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Using
> authentication scheme: ntlm
> 2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Authorization
> challenge processed
> 2012-02-17 16:40:27,098 DEBUG auth.AuthChallengeProcessor - Using
> authentication scheme: ntlm
> 2012-02-17 16:40:27,098 DEBUG auth.AuthChallengeProcessor - Authorization
> challenge processed
> 2012-02-17 16:40:27,692 DEBUG auth.AuthChallengeProcessor - Using
> authentication scheme: ntlm
> 2012-02-17 16:40:27,692 DEBUG auth.AuthChallengeProcessor - Authorization
> challenge processed
> 2012-02-17 16:40:27,692 INFO  httpclient.HttpMethodDirector - Failure
> authenticating with NTLM <any realm>@xyz.com:80 <http://xyz.com/>
> 2012-02-17 16:40:27,832 INFO  parse.ParserChecker - parsing:
> http://xyz.com/Default.aspx
> 2012-02-17 16:40:27,832 INFO  parse.ParserChecker - contentType: text/html
>
> I have reffered the
> http://wiki.apache.org/nutch/HttpAuthenticationSchemes section
> NeedHelp and
> seems like I do not have answers for question number 4, 5, 6
>
> Please help me fix this problem.
>
> Thanks
> Gouri
>