Website invisible

christophe · 01-03-2005, 03:18 AM

Hi,
I have indexing many website but i must be stupid, i don't Know use PhpDig.
when I index a site, i stop my spider for *unlocked" this WebSite.
But one day after, this WebSite aren't no on my host.
It's Normal ?
However, if I clean the index it does not have there problems....
Some sites which were first disappeared

How to make to repair that or that that does not arrive any more?

Thanks

PS : This script is very GOOD but very difficult

Charter · 01-03-2005, 06:08 AM

Why are you unlocking the site? A site that is being spidered is locked during the spidering process. If the spidering process ends successfully, then the site will automatically unlock. Maybe you just need to wait for the spidering process to finish.

christophe · 01-03-2005, 06:57 AM

Because, My Spider go on the WebSite
For Example
-http://www.emule-conseil.com
After, they are this page

HTML Code:

Exploration des liens en cours... [Stop spider]
SITE : http://www.emule-conseil.com/
Chemins exclus :
- @NONE@
1:http://www.emule-conseil.com/
(temps : 00:00:06)
+ + + + + + + +
niveau 1...
2:http://www.emule-conseil.com/forum/upload/
(temps : 00:00:27)

And they have not other possiblity, no ?
The alone link is : [Stop spider]

What must to make after the indexing ?

Charter · 01-03-2005, 07:49 AM

Code:

Exploration des liens en cours... [Stop spider]
SITE : http://www.emule-conseil.com/
Chemins exclus :
- @NONE@
1:http://www.emule-conseil.com/
(temps : 00:00:06)
+ + + + + + + +
niveau 1...
2:http://www.emule-conseil.com/forum/upload/
(temps : 00:00:27)

et ainsi de suite... il indiquera...

Indexation terminée

vous devez avoir la patience

christophe · 01-03-2005, 09:06 AM

The problem is that I am block since more 2H
The table tempspider indicates 9
One does not need 2H to index 9 pages, not ?

It seems that the navigator either blocks on this page, it does not occur more anything and I do not have an other alternative only of cut the spider

Charter · 01-03-2005, 02:55 PM

Maybe it's a server issue, maybe not. Perhaps try cron or skip the site.

01-03-2005, 03:18 AM	#1
christophe Green Mole Join Date: Dec 2004 Posts: 25	Website invisible Hi, I have indexing many website but i must be stupid, i don't Know use PhpDig. when I index a site, i stop my spider for *unlocked" this WebSite. But one day after, this WebSite aren't no on my host. It's Normal ? However, if I clean the index it does not have there problems.... Some sites which were first disappeared How to make to repair that or that that does not arrive any more? Thanks PS : This script is very GOOD but very difficult

01-03-2005, 06:08 AM	#2
Charter Head Mole Join Date: May 2003 Posts: 2,539	Why are you unlocking the site? A site that is being spidered is locked during the spidering process. If the spidering process ends successfully, then the site will automatically unlock. Maybe you just need to wait for the spidering process to finish. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

01-03-2005, 06:57 AM	#3
christophe Green Mole Join Date: Dec 2004 Posts: 25	Because, My Spider go on the WebSite For Example -http://www.emule-conseil.com After, they are this page HTML Code: Exploration des liens en cours... [Stop spider] SITE : http://www.emule-conseil.com/ Chemins exclus : - @NONE@ 1:http://www.emule-conseil.com/ (temps : 00:00:06) + + + + + + + + niveau 1... 2:http://www.emule-conseil.com/forum/upload/ (temps : 00:00:27) And they have not other possiblity, no ? The alone link is : [Stop spider] What must to make after the indexing ?

01-03-2005, 07:49 AM	#4
Charter Head Mole Join Date: May 2003 Posts: 2,539	Code: Exploration des liens en cours... [Stop spider] SITE : http://www.emule-conseil.com/ Chemins exclus : - @NONE@ 1:http://www.emule-conseil.com/ (temps : 00:00:06) + + + + + + + + niveau 1... 2:http://www.emule-conseil.com/forum/upload/ (temps : 00:00:27) et ainsi de suite... il indiquera... Indexation terminée vous devez avoir la patience __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

01-03-2005, 02:55 PM	#6
Charter Head Mole Join Date: May 2003 Posts: 2,539	Maybe it's a server issue, maybe not. Perhaps try cron or skip the site. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

01-03-2005, 09:06 AM	#5
christophe Green Mole Join Date: Dec 2004 Posts: 25	The problem is that I am block since more 2H The table tempspider indicates 9 One does not need 2H to index 9 pages, not ? It seems that the navigator either blocks on this page, it does not occur more anything and I do not have an other alternative only of cut the spider

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Searching different sub-sections of the website	Annan	How-to Forum	0	06-25-2007 09:17 PM
CRAWL - SPDIER A WHOLE WEBSITE	mahesr	The Mole Hole	0	11-01-2006 09:43 PM
Cannot spider my website...	nodoyuna	Troubleshooting	12	11-11-2005 07:32 PM
I cannot update my website	humanitaire.ws	How-to Forum	7	01-19-2005 09:00 AM
crawl my website only	hula	Troubleshooting	0	08-29-2004 03:37 AM