Bug 7963 Parallel HTTP requests when checking URLs
authorFrédéric Demians <f.demians@tamil.fr>
Sat, 14 Apr 2012 13:04:41 +0000 (15:04 +0200)
committerPaul Poulain <paul.poulain@biblibre.com>
Fri, 5 Oct 2012 09:44:52 +0000 (11:44 +0200)
commit1e1422e8babd7d47f23b9e12c521adb9a9aefbbc
tree2e4e48d591d08c51fc8b953581189bbfd8cbe785
parentf7055bb901602117e79351fa15f72148ff1f2716
Bug 7963 Parallel HTTP requests when checking URLs

Current script check-url.pl checks URL found in 856$u by sending HTTP
requests, one by one. The next request can't be sent before the previous
one get a result, which can be very slow for dead URL. I propose a new
script which send multiple requests simultaneously which improve
drastically URL checking execution time.

This script is based on AnyEvent and AnyEvent::HTTP CPAN modules.
Add new dependencies AnyEvent & AnyEvent::HTTP.

See doc: perldoc check-url-quick.pl

Signed-off-by: Jonathan Druart <jonathan.druart@biblibre.com>
C4/Installer/PerlDependencies.pm
misc/cronjobs/check-url-quick.pl [new file with mode: 0755]
misc/cronjobs/check-url.pl