|
09-26-2004, 01:46 AM | #1 |
Green Mole
Join Date: Sep 2004
Posts: 25
|
index subdomains
what is the proper way to have all of my subdomains indexed (http://subdomain1.mysite.com, http://subdomain2.mysite.com, etc.), so that search results include all subdomains, and then i can use "limit to" to limit results per subdomain? i would like to use shell to index the pages, and set up a cron to update every 7 days.
|
09-26-2004, 10:39 AM | #2 |
Purple Mole
Join Date: Jan 2004
Posts: 694
|
This thread should answer all your questions.
Note: A subdomain is really just a subdirectory with its URL displayed in a different way. In other words, and using one of your examples, you can reach a subdomain like this: http://subdomain1.mysite.com/ or you can reach it this way: http://www.mysite.com/subdomain1/ So you can setup your robots.txt just like it's done in that thread I gave you the link to. Hope this helps. |
09-26-2004, 01:40 PM | #3 |
Green Mole
Join Date: Sep 2004
Posts: 25
|
My site is allknightaccess.com.
http://teen.allknightaccess.com/ or http://mail.allknightaccess.com/ is not the same as http://www.allknightaccess.com/teen/ or http://www.allknightaccess.com/mail/ try it and see. |
09-26-2004, 02:01 PM | #4 |
Purple Mole
Join Date: Jan 2004
Posts: 694
|
Hmmm. Your server must be setup differently than mine. Still, I think you should try what that other thread recommends and see if you get what you want.
Let us know how it goes. I'll be curious to see what kind of results you get. |
Thread Tools | |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
digging subdomains | b2l_grefix | How-to Forum | 6 | 05-10-2004 03:34 PM |
Problems with Subdomains | herberth | Troubleshooting | 8 | 04-02-2004 07:42 AM |
Bug when spidering subdomains | cybercox | Bug Tracker | 1 | 04-01-2004 12:48 AM |