Just as the title says.
I know I can specify the debth options when I dig a page from the admin section, but how do I specify the debth options when adding a domain from the command line.
Basically I ran spider from the command line php-f spider.php
http://www.jrbtech.com/ and it did a pretty darn good job of indexing. I need to get to a page that I know is linked everywhere on my site, but it wasn't indexed. ( from what I could tell ).
Is there a way to index the whole shabang? I'm I doing something wrong ?
Oh, and this has to be done from the command line as my site has 1000's of pages.
http://www.jrbtech.com/search/
Thanks in advance, and good job with php Dig