Untested, but if you want to try and index part of the big PDFs...
In robot_functions.php find:
Code:
while (!feof($fp)) {
$file_content[] = fread($fp,8192);
}
And replace with:
Code:
$oh_stop_me = 0;
while (!feof($fp) && $oh_stop_me < 125) {
$file_content[] = fread($fp,8192);
$oh_stop_me++;
}
The 125 is meant to allow for 1,024,000 bytes from bigger PDF files.