View Full Version : Problems spidering dynamic site

01-12-2004, 12:50 PM
Ignore me. I figured it out, it was a URL error

Hey all,
I've got two sites: www.staticmethod.net and www.atomicobject.com that I'm trying to spider. Both sites are hosted elsewhere (I have permission), ie not on the computer I'm using.

Staticmethod works perfectly fine.
Atomicobject does not, it gets the

Spidering in progress...

SITE : http://www.atomicobject.com/
Exclude paths :
- @NONE@
No link in temporary table

links found : 0

...Was recently indexed
Optimizing tables...
Indexing complete !

error that others have reported. I don't believe I'm running PHP in CGI mode (just compiled PHP 5 with Apache2 plugins), and like I said it's working for my staticmethod.net site perfectly.

Only difference is that AtomicObject.com is generated using Cocoon (apache project). Pages like www.atomicobject.com/home.html still show up fine in my browser. Any idea why this would be happening?


01-13-2004, 03:39 PM
>> Ignore me. I figured it out, it was a URL error

Hi. Glad it's now working. :)