I took my existing, functional configurations from my 1.4 installation and
brought everything over to run on 1.5.1.  Now when I attempt to run a
crawl, I'm getting these errors.

2012-08-02 20:03:21,271 ERROR crawl.Injector - Injector:
java.lang.RuntimeException: java.io.IOException: failure to login
        at
org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:546)
        at
org.apache.hadoop.mapred.FileInputFormat.addInputPath(FileInputFormat.java:336)
        at org.apache.nutch.crawl.Injector.inject(Injector.java:209)
        at org.apache.nutch.crawl.Injector.run(Injector.java:248)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.nutch.crawl.Injector.main(Injector.java:238)
Caused by: java.io.IOException: failure to login
        at
org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:490)
        at
org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:452)
        at
org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1494)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1395)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:123)
        at
org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:542)
        ... 5 more
Caused by: javax.security.auth.login.LoginException: unable to find
LoginModule class: com.ibm.security.auth.module.LinuxLoginModule
        at
javax.security.auth.login.LoginContext.invoke(LoginContext.java:834)
        at
javax.security.auth.login.LoginContext.access$000(LoginContext.java:209)
        at
javax.security.auth.login.LoginContext$5.run(LoginContext.java:732)
        at
java.security.AccessController.doPrivileged(AccessController.java:284)
        at
javax.security.auth.login.LoginContext.invokeCreatorPriv(LoginContext.java:729)
        at
javax.security.auth.login.LoginContext.login(LoginContext.java:599)
        at
org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:471)
        ... 11 more
It looks like there is some Hadoop security thing that is failing based on
a missing module, or the wrong module.
This is on AIX 6.1 with 64-bit IBM JRE 1.6.0 SR9 FP2  (aka Java6)

Is there a higher Java level requirement that I missed?  Missing
configuration change that needs to be in place for 1.5.1 that wasn't in
1.4?
Any help is appreciated.

James

Hi,

do you run Nutch locally, pseudo distrib...?

Lewis

On Fri, Aug 3, 2012 at 4:37 PM, James F Walton <[EMAIL PROTECTED]> wrote:
> I took my existing, functional configurations from my 1.4 installation and
> brought everything over to run on 1.5.1.  Now when I attempt to run a
> crawl, I'm getting these errors.
>
> 2012-08-02 20:03:21,271 ERROR crawl.Injector - Injector:
> java.lang.RuntimeException: java.io.IOException: failure to login
>         at
> org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:546)
>         at
> org.apache.hadoop.mapred.FileInputFormat.addInputPath(FileInputFormat.java:336)
>         at org.apache.nutch.crawl.Injector.inject(Injector.java:209)
>         at org.apache.nutch.crawl.Injector.run(Injector.java:248)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>         at org.apache.nutch.crawl.Injector.main(Injector.java:238)
> Caused by: java.io.IOException: failure to login
>         at
> org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:490)
>         at
> org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:452)
>         at
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1494)
>         at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1395)
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:123)
>         at
> org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:542)
>         ... 5 more
> Caused by: javax.security.auth.login.LoginException: unable to find
> LoginModule class: com.ibm.security.auth.module.LinuxLoginModule
>         at
> javax.security.auth.login.LoginContext.invoke(LoginContext.java:834)
>         at
> javax.security.auth.login.LoginContext.access$000(LoginContext.java:209)
>         at
> javax.security.auth.login.LoginContext$5.run(LoginContext.java:732)
>         at
> java.security.AccessController.doPrivileged(AccessController.java:284)
>         at
> javax.security.auth.login.LoginContext.invokeCreatorPriv(LoginContext.java:729)
>         at
> javax.security.auth.login.LoginContext.login(LoginContext.java:599)
>         at
> org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:471)
>         ... 11 more
>
>
> It looks like there is some Hadoop security thing that is failing based on
> a missing module, or the wrong module.
> This is on AIX 6.1 with 64-bit IBM JRE 1.6.0 SR9 FP2  (aka Java6)
>
> Is there a higher Java level requirement that I missed?  Missing
> configuration change that needs to be in place for 1.5.1 that wasn't in
> 1.4?
> Any help is appreciated.
>
> James

--
Lewis

I'm running the Nutch crawler remotely, a server that is physically
disparate from the Solr servers and from the website that is being
crawled.

It appears that Nutch 1.5.1 prefers to run on Linux.  We're attempting to
run it on AIX.  I don't recall having this issue with 1.4, unless I need
to find a different package.

From:   Lewis John Mcgibbney <[EMAIL PROTECTED]>
To:     [EMAIL PROTECTED]
Date:   08/04/2012 10:00 AM
Subject:        Re: Upgrade nutch 1.4 to 1.5.1 getting 'failed to login'

Hi,

do you run Nutch locally, pseudo distrib...?

Lewis

On Fri, Aug 3, 2012 at 4:37 PM, James F Walton <[EMAIL PROTECTED]>
wrote:
> I took my existing, functional configurations from my 1.4 installation
and
> brought everything over to run on 1.5.1.  Now when I attempt to run a
> crawl, I'm getting these errors.
>
> 2012-08-02 20:03:21,271 ERROR crawl.Injector - Injector:
> java.lang.RuntimeException: java.io.IOException: failure to login
>         at
> org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:546)
>         at
>
org.apache.hadoop.mapred.FileInputFormat.addInputPath(FileInputFormat.java:336)
>         at org.apache.nutch.crawl.Injector.inject(Injector.java:209)
>         at org.apache.nutch.crawl.Injector.run(Injector.java:248)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>         at org.apache.nutch.crawl.Injector.main(Injector.java:238)
> Caused by: java.io.IOException: failure to login
>         at
>
org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:490)
>         at
>
org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:452)
>         at
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1494)
>         at
org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1395)
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:123)
>         at
> org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:542)
>         ... 5 more
> Caused by: javax.security.auth.login.LoginException: unable to find
> LoginModule class: com.ibm.security.auth.module.LinuxLoginModule
>         at
> javax.security.auth.login.LoginContext.invoke(LoginContext.java:834)
>         at
> javax.security.auth.login.LoginContext.access$000(LoginContext.java:209)
>         at
> javax.security.auth.login.LoginContext$5.run(LoginContext.java:732)
>         at
> java.security.AccessController.doPrivileged(AccessController.java:284)
>         at
>
javax.security.auth.login.LoginContext.invokeCreatorPriv(LoginContext.java:729)
>         at
> javax.security.auth.login.LoginContext.login(LoginContext.java:599)
>         at
>
org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:471)
>         ... 11 more
>
>
> It looks like there is some Hadoop security thing that is failing based
on
> a missing module, or the wrong module.
> This is on AIX 6.1 with 64-bit IBM JRE 1.6.0 SR9 FP2  (aka Java6)
>
> Is there a higher Java level requirement that I missed?  Missing
> configuration change that needs to be in place for 1.5.1 that wasn't in
> 1.4?
> Any help is appreciated.
>
> James

--
Lewis