![]() |
Mod to follow header redirects
1 Attachment(s)
Hi. This is a mod for PhpDig 1.8.0 so that if you crawl http://www.domain.com, and there is a header location redirect to say http://www.domain.com/file.php?query=string, the spider should now follow the redirect. To apply this mod to PhpDig 1.8.0 just use the attached file in place of the robot_functions.php file.
EDIT: This mod is included in 1.8.1+ so do not overwrite 1.8.1+ with this mod. |
All times are GMT -8. The time now is 05:49 PM. |
Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.