Hi. First, download the ZIP file in
this thread and replace robot_functions.php with the one in the ZIP file.
Next, in the new robot_functions.php file, search for "<frame" (without the quotes) and on this line add in a [[:blank:]]* so that:
PHP Code:
while (blah blah *content=['\"][0-9]+;url blah blah) {
becomes the following:
PHP Code:
while (blah blah *content=['\"][0-9]+;[[:blank:]]*url blah blah) {
Last, the server for that site does not return a content-type for certain pages. You would need to force the content-type for these pages so, in the new robot_functions.php file, search for:
PHP Code:
if (!eregi('[a-z0-9]+',$answer)) {
and right before that line add:
PHP Code:
// THIS CODE IS ONLY FOR WHEN CONTENT-TYPE IS NOT RETURNED
// IT IS NOT FOR GENERAL INCLUSION IN THE CORE PHPDIG CODE
elseif (!eregi("Content-Type: *([a-z]+)/([a-z.-]+)",$answer,$regs)) {
$status = 'HTML'; // no content-type so set to html
}
Remember to remove any "word" wrapping in the above code.