Spider with Windows Scheduler?
 

We have successfully installed PhpDig on a Windows 2003 server running Apache 2.048 and PHP 4.3.2. You can view it at http://www.stlib.state.nm.us/phpdig/search.php.

This is still a bit of a work in progress, but the big issue is that I need to crawl one of the sites between 10 p.m. and 6:30 p.m. I know this can be done easily in Unix with a chron job, but can the same or similar goal be done using Windows Scheduler?

Thanks,

John Chadwick
jchadwick@stlib.state.nm.us

Hi. Perhaps something in this thread might help.

Thanks, I am trying this, but I am having some problems similar to what is described in another thread. I do the command lie which is:

C:\php> php.exe -f "Program Files\Apache Group\Apache2\htdocs\phpdig\admin\spider.php" http://www.state.nm.us

What I get are the following error messages. I have tried modifying the spider as per the instructions in another thread and no luck. If I can get the command line to work then I can create a .bat file to run and under Windows Scheduler.

Thanks,

John

<b>Warning</b>: main(): Failed opening './includes/config.php' for inclusion (i
nclude_path='.;c:\php4\pear') in <b>C:\Program Files\Apache Group\Apache2\htdocs
\phpdig\admin\spider2.php</b> on line <b>92</b><br />
<br />
<b>Warning</b>: main(./admin/robot_functions.php): failed to open stream: No su
ch file or directory in <b>C:\Program Files\Apache Group\Apache2\htdocs\phpdig\a
dmin\spider2.php</b> on line <b>93</b><br />
<br />
<b>Warning</b>: main(): Failed opening './admin/robot_functions.php' for inclus
ion (include_path='.;c:\php4\pear') in <b>C:\Program Files\Apache Group\Apache2\
htdocs\phpdig\admin\spider2.php</b> on line <b>93</b><br />
<br />
<b>Warning</b>: main(./admin/debug_functions.php): failed to open stream: No su
ch file or directory in <b>C:\Program Files\Apache Group\Apache2\htdocs\phpdig\a
dmin\spider2.php</b> on line <b>94</b><br />
<br />
<b>Warning</b>: main(): Failed opening './admin/debug_functions.php' for inclus
ion (include_path='.;c:\php4\pear') in <b>C:\Program Files\Apache Group\Apache2\
htdocs\phpdig\admin\spider2.php</b> on line <b>94</b><br />
<br />
<b>Fatal error</b>: Call to undefined function: phpdigprnmsg() in <b>C:\Progra
m Files\Apache Group\Apache2\htdocs\phpdig\admin\spider2.php</b> on line <b>109<
/b><br />

Hi. It looks like a path issue. Try one of the following instead:

Code:

---

C:\php> php.exe -f "C:\Program Files\Apache Group\Apache2\htdocs\phpdig\admin\spider.php" http://www.state.nm.us

C:\php> php.exe -f "C:\progra~1\apache~1\Apache2\htdocs\phpdig\admin\spider.php" http://www.state.nm.us

C:\Program Files\Apache Group\Apache2\htdocs\phpdig\admin> C:\php\php.exe -f spider.php http://www.state.nm.us

---

Bingo! That was the problem. Thanks!!!

John

Hi. Which one did you use?

I used the third one option:

C:\Program Files\Apache Group\Apache2\htdocs\phpdig\admin> C:\php\php.exe -f spider.php http://www.state.nm.us

John

Okay, thanks. :)

I also found that with the solution, by leaving off the URL I am able to force phpdig to spider all the sites in my list.

Hi. Yes, that is the default. ;)

Visit here for more options and here for some extra explanation.