Can someone offer some help with this script? It uses DBI to pull URLs from the "url" column of a mysql table. LWP then checks the validity of the URLs. The outcome of the link check is then reflected by an update to the "valid" column. This script worked great for me when I had a few hundred rows in my table. There are now over 7000. After about 900 rows the script just stops executing without any errors.

What causes the script to suddenly stop before checking every row?

Thanks!
Ryan McKillen

<BLOCKQUOTE><font size="1" face="Verdana,Arial,Helvetica">code:</font><HR><pre>
#!/usr/bin/perl

use LWP::UserAgent;
use DBI;

$db_database = "filedb";
$db_uid = "root";
$db_pwd = "pass";
($ua = LWP::UserAgent->new)->timeout(20); #actually set timeout


$dbh = DBI->connect ("DBI:mysql:$db_database".$mysqlsock, $db_uid, $db_pwd) or die("could not connect to dbn");
$sth = $dbh->prepare("SELECT url FROM files");
$sth -> execute();
$numrows = $sth->rows;

print "nn";
while (my $url = $sth->fetchrow_array) {
if(($ua->request(HTTP::Request->new('HEAD', $url)))->is_success()) {
$validity = "link works";
$valid_update = $dbh->do("UPDATE files SET valid = 1 WHERE url = '$url'");
}
else {
$validity = "link sucks";
$valid_update = $dbh->do("UPDATE files SET valid = valid + 1 WHERE url = '$url'");
}
print "$validityn$urlnn";
}
$sth->finish;
[/code]

[This message has been edited by scream (edited October 10, 2000).]