Hey Charter thanks so much 4 replying.
Well, I don't know if there's content in the tempspidertable, how do I clear it? I tried clicking on "Delete Site" without selecting anything, then tried to re-index a subfolder but no luck:
So what I've done is (after unlocking the site), I've gone to the admin interface and found the folders that it didn't finish indexing the first time, clicked on its green tick and it just comes back after 10-20 seconds with listing my robots.txt file then:
File date unchanged
1:[url]http://www.myurlhere.com/folder
(time : 00:00:20)
No link in temporary table
---------------------------------
links found : 0
...Was recently indexed
Optimizing tables...
Indexing complete !:
If I can get this to work it will be invaluable to the site, so I'm keen to be patient and work at it! My site has about 500 html pages and my dodgy broadband hasn't yet stayed connected long enough for the indexing to complete from scratch, though I don't mind re-indexing a few folders manually (which is guess is what I'm trying to do here)
Perhaps something isn't working correctly because it hasn't got the right permissions? Just a thought... I know I can change those permissions in cPanel... maybe I haven't set the links depth correctly.... I wanted it to find the pages and follow every link on that page, and keep going, so I set it to 20-20, is that correct?
Don't know what else to do! What do you reckon, any suggestions?
Thanks so much for your help again