| clear query|facets|time |
Search criteria: .
Results from 1 to 9 from
9 (0.842s).
|
|
|
Loading phrases to help you
refine your search...
|
|
[DROIDS-105] missing caching for robots.txt - Droids - [issue]
|
|
...the current implementation of the HttpClient will not cache any requests to the robots.txt file. While using the CrawlingWorker this will result in 2 requests to the robots.txt (HEAD + GET) ...
|
|
|
http://issues.apache.org/jira/browse/DROIDS-105
Author: Paul Rogalinski,
2012-06-15, 03:46
|
|
|
[DROIDS-115] LinkExtractor getURI(String target) does not resolve correctly when baseUri is provided - Droids - [issue]
|
|
...the getURI() Method won't resolve the URL correctly if a baseUri is provided without the trailing slash and the relative url to be resolved does not start with "/". Under that circumstances ...
|
|
|
http://issues.apache.org/jira/browse/DROIDS-115
Author: Paul Rogalinski,
2011-12-03, 01:39
|
|
|
[DROIDS-118] update nekohtml dependency to 1.9.14 - Droids - [issue]
|
|
...a more recent version of nekohtml parser is available via maven: <dependency> <groupId>net.sourceforge.nekohtml</groupId> <artifactId>nekohtml</artifactId&g...
|
|
|
http://issues.apache.org/jira/browse/DROIDS-118
Author: Paul Rogalinski,
2011-02-21, 18:03
|
|
|
[DROIDS-104] DroidsHttpClient unable to use a proxy - Droids - [issue]
|
|
...createHttpRoutePlanner() method in DroidsHttpClient does not provide any ProxySelector: @Override protected HttpRoutePlanner createHttpRoutePlanner(){ return new P...
|
|
|
http://issues.apache.org/jira/browse/DROIDS-104
Author: Paul Rogalinski,
2010-12-26, 15:39
|
|
|
[DROIDS-103] incorrect robots.txt path - Droids - [issue]
|
|
...droids currently attempts to locate the robots.txt file relative to the current access url. According to http://www.robotstxt.org/robotstxt.html robots.txt should always be accessed the root...
|
|
|
http://issues.apache.org/jira/browse/DROIDS-103
Author: Paul Rogalinski,
2010-12-26, 15:38
|
|
|
Re: Who take the lead ? - Droids - [mail # dev]
|
|
...I do, although there not really much to re-use as it is. Regards, Paul. Fuad Efendi wrote: ...
|
|
|
Author: Paul Rogalinski,
2010-11-24, 13:41
|
|
|
Re: Who take the lead ? - Droids - [mail # dev]
|
|
...100% Agree, I see no point in commiting any patches as long nobody feels responsible for reviewing & incorporating those into the svn-trunk. That would come very close to a...
|
|
|
Author: Paul Rogalinski,
2010-11-22, 13:14
|
|
|
contributing to droids-core? (Re: Dormant projects to mothball? (was missing reports ...)) - Droids - [mail # dev]
|
|
...HelloWorld, I'm currently building a crawler based on the droid-core implementation, trying not to change anything in the core API / interfaces yet. Due to the lack of docu...
|
|
|
Author: Paul Rogalinski,
2010-11-18, 21:36
|
|
|
Re: Dormant projects to mothball? (was missing reports ...) - Droids - [mail # dev]
|
|
...Hello, this would make two of us. We do also use Droids for an Internet (not Intranet) crawler project and would agree to contribute reference impelmentation and improvemen...
|
|
|
Author: Paul Rogalinski,
2010-11-18, 14:48
|
|
|
|
