PhpDig.net

PhpDig.net (http://www.phpdig.net/forum/index.php)
-   Mod Requests (http://www.phpdig.net/forum/forumdisplay.php?f=23)
-   -   Indexing subdirectory (http://www.phpdig.net/forum/showthread.php?t=309)

alivin70 12-18-2003 08:49 AM

Indexing subdirectory
 
I tried to index a subdirectory of a website, for example

ww.mysite.com/mydir/

but the spider goes to other dirs if it find the link. For example it can find the link to

ww.mysite.com

and starts to index the whole site.

Do you think it's possible to avoid that?


All times are GMT -8. The time now is 12:19 PM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.