View Full Version : Website invisible
christophe
01-03-2005, 03:18 AM
Hi,
I have indexing many website but i must be stupid, i don't Know use PhpDig.
when I index a site, i stop my spider for *unlocked" this WebSite.
But one day after, this WebSite aren't no on my host.
It's Normal ?
However, if I clean the index it does not have there problems....
Some sites which were first disappeared
How to make to repair that or that that does not arrive any more?
Thanks
PS : This script is very GOOD but very difficult
Charter
01-03-2005, 06:08 AM
Why are you unlocking the site? A site that is being spidered is locked during the spidering process. If the spidering process ends successfully, then the site will automatically unlock. Maybe you just need to wait for the spidering process to finish.
christophe
01-03-2005, 06:57 AM
Because, My Spider go on the WebSite
For Example
-http://www.emule-conseil.com
After, they are this page
Exploration des liens en cours... [Stop spider]
SITE : http://www.emule-conseil.com/
Chemins exclus :
- @NONE@
1:http://www.emule-conseil.com/
(temps : 00:00:06)
+ + + + + + + +
niveau 1...
2:http://www.emule-conseil.com/forum/upload/
(temps : 00:00:27)
And they have not other possiblity, no ?
The alone link is : [Stop spider]
What must to make after the indexing ?
Charter
01-03-2005, 07:49 AM
Exploration des liens en cours... [Stop spider]
SITE : http://www.emule-conseil.com/
Chemins exclus :
- @NONE@
1:http://www.emule-conseil.com/
(temps : 00:00:06)
+ + + + + + + +
niveau 1...
2:http://www.emule-conseil.com/forum/upload/
(temps : 00:00:27)
et ainsi de suite... il indiquera...
Indexation terminée
vous devez avoir la patience :cool:
christophe
01-03-2005, 09:06 AM
The problem is that I am block since more 2H
The table tempspider indicates 9
One does not need 2H to index 9 pages, not ?
It seems that the navigator either blocks on this page, it does not occur more anything and I do not have an other alternative only of cut the spider
Charter
01-03-2005, 02:55 PM
Maybe it's a server issue, maybe not. Perhaps try cron or skip the site.
vBulletin® v3.7.3, Copyright ©2000-2025, Jelsoft Enterprises Ltd.