|
I found the problem. For Some reason my php will not pass the global variables.
I have temporarily solved the problem by creating a second spider to process my text file from a batch program until i get my php problem fixed.
I am currently archiving a web site that is extremely large. I will let you all know how it turns out performance wise.
Also, if you all don't mind, which i'm sure you don't I'm going to start working on the search engine for this program and see if i can get some more functionality out of it. I'll let you know how that goes. And keep you all posted on both items.
Have a good one.
|