PDA

View Full Version : Mod to follow header redirects


Charter
02-25-2004, 10:33 AM
Hi. This is a mod for PhpDig 1.8.0 so that if you crawl http://www.domain.com, and there is a header location redirect to say http://www.domain.com/file.php?query=string, the spider should now follow the redirect. To apply this mod to PhpDig 1.8.0 just use the attached file in place of the robot_functions.php file.

EDIT: This mod is included in 1.8.1+ so do not overwrite 1.8.1+ with this mod.