Spider with Windows Scheduler?

drjohnchadwick · 01-13-2004, 01:24 PM

We have successfully installed PhpDig on a Windows 2003 server running Apache 2.048 and PHP 4.3.2. You can view it at http://www.stlib.state.nm.us/phpdig/search.php.

This is still a bit of a work in progress, but the big issue is that I need to crawl one of the sites between 10 p.m. and 6:30 p.m. I know this can be done easily in Unix with a chron job, but can the same or similar goal be done using Windows Scheduler?

Thanks,

John Chadwick
jchadwick@stlib.state.nm.us

Charter · 01-13-2004, 05:35 PM

Hi. Perhaps something in this thread might help.

drjohnchadwick · 01-14-2004, 07:28 AM

Thanks, I am trying this, but I am having some problems similar to what is described in another thread. I do the command lie which is:

C:\php> php.exe -f "Program Files\Apache Group\Apache2\htdocs\phpdig\admin\spider.php" http://www.state.nm.us

What I get are the following error messages. I have tried modifying the spider as per the instructions in another thread and no luck. If I can get the command line to work then I can create a .bat file to run and under Windows Scheduler.

Thanks,

John

Warning: main(): Failed opening './includes/config.php' for inclusion (i
nclude_path='.;c:\php4\pear') in C:\Program Files\Apache Group\Apache2\htdocs
\phpdig\admin\spider2.php on line 92 
 
Warning: main(./admin/robot_functions.php): failed to open stream: No su
ch file or directory in C:\Program Files\Apache Group\Apache2\htdocs\phpdig\a
dmin\spider2.php on line 93 
 
Warning: main(): Failed opening './admin/robot_functions.php' for inclus
ion (include_path='.;c:\php4\pear') in C:\Program Files\Apache Group\Apache2\
htdocs\phpdig\admin\spider2.php on line 93 
 
Warning: main(./admin/debug_functions.php): failed to open stream: No su
ch file or directory in C:\Program Files\Apache Group\Apache2\htdocs\phpdig\a
dmin\spider2.php on line 94 
 
Warning: main(): Failed opening './admin/debug_functions.php' for inclus
ion (include_path='.;c:\php4\pear') in C:\Program Files\Apache Group\Apache2\
htdocs\phpdig\admin\spider2.php on line 94 
 
Fatal error: Call to undefined function: phpdigprnmsg() in C:\Progra
m Files\Apache Group\Apache2\htdocs\phpdig\admin\spider2.php on line 109

Charter · 01-14-2004, 08:45 AM

Hi. It looks like a path issue. Try one of the following instead:

Code:

C:\php> php.exe -f "C:\Program Files\Apache Group\Apache2\htdocs\phpdig\admin\spider.php" http://www.state.nm.us

C:\php> php.exe -f "C:\progra~1\apache~1\Apache2\htdocs\phpdig\admin\spider.php" http://www.state.nm.us

C:\Program Files\Apache Group\Apache2\htdocs\phpdig\admin> C:\php\php.exe -f spider.php http://www.state.nm.us

drjohnchadwick · 01-14-2004, 09:04 AM

Bingo! That was the problem. Thanks!!!

John

Charter · 01-14-2004, 09:15 AM

Hi. Which one did you use?

drjohnchadwick · 01-14-2004, 09:28 AM

I used the third one option:

C:\Program Files\Apache Group\Apache2\htdocs\phpdig\admin> C:\php\php.exe -f spider.php http://www.state.nm.us

John

Charter · 01-14-2004, 09:37 AM

Okay, thanks.

drjohnchadwick · 01-14-2004, 10:28 AM

I also found that with the solution, by leaving off the URL I am able to force phpdig to spider all the sites in my list.

Charter · 01-14-2004, 10:53 AM

Hi. Yes, that is the default.

Visit here for more options and here for some extra explanation.

01-13-2004, 01:24 PM	#1
drjohnchadwick Green Mole Join Date: Jan 2004 Posts: 8	Spider with Windows Scheduler? We have successfully installed PhpDig on a Windows 2003 server running Apache 2.048 and PHP 4.3.2. You can view it at http://www.stlib.state.nm.us/phpdig/search.php. This is still a bit of a work in progress, but the big issue is that I need to crawl one of the sites between 10 p.m. and 6:30 p.m. I know this can be done easily in Unix with a chron job, but can the same or similar goal be done using Windows Scheduler? Thanks, John Chadwick jchadwick@stlib.state.nm.us

01-13-2004, 05:35 PM	#2
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. Perhaps something in this thread might help. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

01-14-2004, 07:28 AM	#3
drjohnchadwick Green Mole Join Date: Jan 2004 Posts: 8	Thanks, I am trying this, but I am having some problems similar to what is described in another thread. I do the command lie which is: C:\php> php.exe -f "Program Files\Apache Group\Apache2\htdocs\phpdig\admin\spider.php" http://www.state.nm.us What I get are the following error messages. I have tried modifying the spider as per the instructions in another thread and no luck. If I can get the command line to work then I can create a .bat file to run and under Windows Scheduler. Thanks, John <b>Warning</b>: main(): Failed opening './includes/config.php' for inclusion (i nclude_path='.;c:\php4\pear') in <b>C:\Program Files\Apache Group\Apache2\htdocs \phpdig\admin\spider2.php</b> on line <b>92</b><br /> <br /> <b>Warning</b>: main(./admin/robot_functions.php): failed to open stream: No su ch file or directory in <b>C:\Program Files\Apache Group\Apache2\htdocs\phpdig\a dmin\spider2.php</b> on line <b>93</b><br /> <br /> <b>Warning</b>: main(): Failed opening './admin/robot_functions.php' for inclus ion (include_path='.;c:\php4\pear') in <b>C:\Program Files\Apache Group\Apache2\ htdocs\phpdig\admin\spider2.php</b> on line <b>93</b><br /> <br /> <b>Warning</b>: main(./admin/debug_functions.php): failed to open stream: No su ch file or directory in <b>C:\Program Files\Apache Group\Apache2\htdocs\phpdig\a dmin\spider2.php</b> on line <b>94</b><br /> <br /> <b>Warning</b>: main(): Failed opening './admin/debug_functions.php' for inclus ion (include_path='.;c:\php4\pear') in <b>C:\Program Files\Apache Group\Apache2\ htdocs\phpdig\admin\spider2.php</b> on line <b>94</b><br /> <br /> <b>Fatal error</b>: Call to undefined function: phpdigprnmsg() in <b>C:\Progra m Files\Apache Group\Apache2\htdocs\phpdig\admin\spider2.php</b> on line <b>109< /b><br />

01-14-2004, 08:45 AM	#4
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. It looks like a path issue. Try one of the following instead: Code: C:\php> php.exe -f "C:\Program Files\Apache Group\Apache2\htdocs\phpdig\admin\spider.php" http://www.state.nm.us C:\php> php.exe -f "C:\progra~1\apache~1\Apache2\htdocs\phpdig\admin\spider.php" http://www.state.nm.us C:\Program Files\Apache Group\Apache2\htdocs\phpdig\admin> C:\php\php.exe -f spider.php http://www.state.nm.us __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

01-14-2004, 09:15 AM	#6
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. Which one did you use? __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

01-14-2004, 09:04 AM	#5
drjohnchadwick Green Mole Join Date: Jan 2004 Posts: 8	Bingo! That was the problem. Thanks!!! John

01-14-2004, 09:28 AM	#7
drjohnchadwick Green Mole Join Date: Jan 2004 Posts: 8	I used the third one option: C:\Program Files\Apache Group\Apache2\htdocs\phpdig\admin> C:\php\php.exe -f spider.php http://www.state.nm.us John

01-14-2004, 09:37 AM	#8
Charter Head Mole Join Date: May 2003 Posts: 2,539	Okay, thanks. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

01-14-2004, 10:28 AM	#9
drjohnchadwick Green Mole Join Date: Jan 2004 Posts: 8	I also found that with the solution, by leaving off the URL I am able to force phpdig to spider all the sites in my list.

01-14-2004, 10:53 AM	#10
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. Yes, that is the default. Visit here for more options and here for some extra explanation. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Spider CLI call under Windows fails [Workaround included]	shockfreezer	Bug Tracker	0	06-22-2006 06:58 AM
Windows-1250	vilda	How-to Forum	1	07-23-2005 12:05 PM
Help!!! Windows....Linux problems?	NewDigger	Troubleshooting	3	11-20-2004 08:32 AM
Hello, I use a Windows Server	ClausBrell	The Mole Hole	2	09-30-2004 04:35 AM
catdoc with windows	fred	External Binaries	1	07-29-2004 10:06 AM