Solr not have specials log. (file join)

 

 

I tail –f Solr and Manifold loggings but no error, no warning, they have just info but not really importants.

The configuration is the same. Same properties.xml, same logging.xml, same start-options.env.unix, same start script, same database. But in 2.9.0 it work, in ‘2.9.1’ not have commit.

I don’t understand why.

 

Without Tika transformation, not working too.

 

So, if youhave just change the Tika connector, I don’t understand why this version have this bug.

 

Would you release a bin version with this hotfix?

 

Thanks

 

 

De : Karl Wright [mailto:[EMAIL PROTECTED]]
Envoyé : vendredi 12 janvier 2018 16:13
À : [EMAIL PROTECTED]
Objet : Re: Document connector excluding mime type and size - Tika Parser error

 

What does the solr log look like?  There should be [INFO] statements you can inspect to see what's being sent, and its size.

 

The change to go to Tika 1.17 will not have affected the Solr connector in any way.  So one way to decide if this change might be the problem is to run a job that doesn't use Tika -- like a simple file directory crawl that has only text documents in it, and see if that makes it to Solr.  If not, then you must have a configuration difference somewhere.

 

Karl

 

 

On Fri, Jan 12, 2018 at 9:44 AM, msaunier <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]> > wrote:

I finished the tests.

 

I do not have any more mistakes with Tika.

However, you can not commit the data in Solr. I have no error log. The configuration is the same. I tried with 2 different databases and the same configuration; and I tried with the same database, but no data arrives in Solr. It's normal ?

On 2.9.0, the commit works well.

 

Regards,

 

 

De : msaunier [mailto:[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]> ]
Envoyé : vendredi 12 janvier 2018 11:52
À : [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
Objet : RE: Document connector excluding mime type and size - Tika Parser error

 

Hello Karl,

 

I have to do a last test, I do it between noon and two o'clock and I inform you of the good functioning of this patch if it works

 

 

 

De : Karl Wright [mailto:[EMAIL PROTECTED]]
Envoyé : jeudi 11 janvier 2018 18:09
À : [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
Objet : Re: Document connector excluding mime type and size - Tika Parser error

 

No Tika error is good, but have a look at Simple History to be sure documents were actually processed.  If you can confirm that, I'll kick off the patch process.

 

Karl

 

 

On Thu, Jan 11, 2018 at 11:26 AM, msaunier <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]> > wrote:

Ok. So.

 

With the same configuration but Tika 1.17 :

 

·        No Tika error

·        But, no documents send to Solr. I don’t understand why. I research.

 

 

 

 

De : msaunier [mailto:[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]> ]
Envoyé : jeudi 11 janvier 2018 15:32
À : [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
Objet : RE: Document connector excluding mime type and size - Tika Parser error

 

I crawl for the moment. I think, I would have finished in 30 minutes.

 

 

 

De : Karl Wright [mailto:[EMAIL PROTECTED]]
Envoyé : jeudi 11 janvier 2018 15:05
À : [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
Objet : Re: Document connector excluding mime type and size - Tika Parser error

 

Did this work for you?

Karl

 

On Thu, Jan 11, 2018 at 6:36 AM, Karl Wright <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]> > wrote:

If you need the jcifs connector, run "ant make-deps" too.  Then run "ant build" again.

 

Karl

 

On Thu, Jan 11, 2018 at 4:30 AM, msaunier <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]> > wrote:

Hello Karl,

 

I have build and configured but WindowsShare connector do not appear in the list of repository connectors.

 

·        I have add jcifs.jar into the connectors/jcifs/lib-proprietary directory

·        I have ant make-core-deps

·        Ant build

·        Uncomment windows share into the connectors-proprietary.xml file in the dist folder

·        I have add jcifs.jar in connector-lib-proprietary

 

But not have the proposition on the manifold interface.

 

Any idea ?

Thanks.

 

 

De : msaunier [mailto:[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]> ]
Envoyé : mercredi 10 janvier 2018 18:15
À : [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
Objet : RE: Document connector excluding mime type and size - Tika Parser error

 

Good !

 

I configure and test that.

I give you a return as soon as the reading is finished.

400k documents.

 

If it works, I test on few million of documents.

 

Thank.

 

 

De : Karl Wright [mailto:[EMAIL PROTECTED]]
Envoyé : mercredi 10 janvier 2018 17:45
À : [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
Objet : Re: Document connector excluding mime type and size - Tika Parser error

 

The build you should be using is the ant build.  Do not use the maven build for this purpose.

 

- Check out trunk:

 

svn co https://svn.apache.org/repos/asf/manifoldcf/trunk

 

- Download dependencies:

 

ant make-core-deps

 

- Build:

 

ant build

 

- Your deliverable is in the "dist" directory

 

Karl

 

 

On Wed, Jan 10, 2018 at 11:37 AM, msaunier <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]> > wrote:

I have an error with the maven build, so I have test with an external 1.17 Tika Server but, POI not included. If you success a mvn package with 1.17 Tika, I am interested.

 

Today, I have not had much time to deal with it.

 

I found some bugs that I would declare tomorrow if they are not already. They concern log4j2, local_fr and a bug with the web interface and the keyboard input key.

 

I continu my investigation.

 

De : Karl Wright [mailto:[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]> ]
Envoyé : mercredi 10 janvier 2018 17:15
À : [EMAIL PROTECTED] <mailto:user@manifoldc
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB