PhpDig.net

PhpDig.net (http://www.phpdig.net/forum/index.php)
-   How-to Forum (http://www.phpdig.net/forum/forumdisplay.php?f=33)
-   -   Website invisible (http://www.phpdig.net/forum/showthread.php?t=1694)

christophe 01-03-2005 03:18 AM

Website invisible
 
Hi,
I have indexing many website but i must be stupid, i don't Know use PhpDig.
when I index a site, i stop my spider for *unlocked" this WebSite.
But one day after, this WebSite aren't no on my host.
It's Normal ?
However, if I clean the index it does not have there problems....
Some sites which were first disappeared

How to make to repair that or that that does not arrive any more?

Thanks

PS : This script is very GOOD but very difficult

Charter 01-03-2005 06:08 AM

Why are you unlocking the site? A site that is being spidered is locked during the spidering process. If the spidering process ends successfully, then the site will automatically unlock. Maybe you just need to wait for the spidering process to finish.

christophe 01-03-2005 06:57 AM

Because, My Spider go on the WebSite
For Example
-http://www.emule-conseil.com
After, they are this page
HTML Code:

Exploration des liens en cours... [Stop spider]
SITE : http://www.emule-conseil.com/
Chemins exclus :
- @NONE@
1:http://www.emule-conseil.com/
(temps : 00:00:06)
+ + + + + + + +
niveau 1...
2:http://www.emule-conseil.com/forum/upload/
(temps : 00:00:27)

And they have not other possiblity, no ?
The alone link is : [Stop spider]

What must to make after the indexing ?

Charter 01-03-2005 07:49 AM

Code:

Exploration des liens en cours... [Stop spider]
SITE : http://www.emule-conseil.com/
Chemins exclus :
- @NONE@
1:http://www.emule-conseil.com/
(temps : 00:00:06)
+ + + + + + + +
niveau 1...
2:http://www.emule-conseil.com/forum/upload/
(temps : 00:00:27)

et ainsi de suite... il indiquera...

Indexation terminée

vous devez avoir la patience :cool:

christophe 01-03-2005 09:06 AM

The problem is that I am block since more 2H
The table tempspider indicates 9
One does not need 2H to index 9 pages, not ?

It seems that the navigator either blocks on this page, it does not occur more anything and I do not have an other alternative only of cut the spider

Charter 01-03-2005 02:55 PM

Maybe it's a server issue, maybe not. Perhaps try cron or skip the site.


All times are GMT -8. The time now is 05:50 PM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.