![]() |
|
![]() |
#1 |
Orange Mole
Join Date: Aug 2005
Posts: 44
|
Don't want to spid some site
Hello,
Why PHPDIG don't spid this sites, he gives an error message , and google can spid these sites, there are in his index in totality ? HTTP/1.1 403 Forbidden - http://www.asacorsica.com/robots.txt See http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html for explanation. HTTP/1.1 403 Forbidden - http://www.centralhotel.fr/robots.txt See http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html for explanation. HTTP/1.1 403 Forbidden - http://www.corsicamoto.com/robots.txt See http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html for explanation. HTTP/1.1 403 Forbidden - http://www.corsica-taxi.com/robots.txt See http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html for explanation. Have I to change a parameter to make it possible ? Thank you Noël |
![]() |
![]() |
![]() |
#2 |
Head Mole
Join Date: May 2003
Posts: 2,539
|
There is nothing to change in PhpDig to make it possible. The 403 Forbidden message is a response from the server telling PhpDig that it cannot access the page.
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension. |
![]() |
![]() |
![]() |
|
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
site.com and site.net | oehk | Troubleshooting | 1 | 12-11-2006 11:16 AM |
successful indexing of every site but site where phpdig is served | phillystyle123 | Troubleshooting | 1 | 02-21-2005 09:06 PM |