PhpDig.net

Go Back   PhpDig.net > PhpDig Forums > Troubleshooting

Reply
 
Thread Tools
Old 01-16-2007, 06:30 AM   #1
griemer
Green Mole
 
Join Date: Jan 2007
Posts: 1
Index some, but spider all pages

Hi all,
Have a Question:

The index page of the domain i want to spider, contains links to say level1.php?id=xx and level1.php?id=yy

level1.php?id=xx contains links to level2.php?id=aa and level2.php?id=bb

level1.php?id=yy contains links to level2.php?id=cc and level2.php?id=dd

The pages i want to index are the level2.php pages. But i only can reach them trough index -> level1.php -> level2.php.

So the spider needs to follow all the links from the root.

What would be the best way to index some, but spider all pages?
__________________
Regards,
Griemer
Onderdelenzoeker.nl
griemer is offline   Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Spider stops before all pages are indexed halide Troubleshooting 3 07-19-2005 01:26 AM
Using a dictionnary to spider pages Edomondo How-to Forum 0 11-23-2004 08:36 AM
converted from html pages to php pages now no pages will index!!! help!! bigals Troubleshooting 24 04-01-2004 10:34 AM
Remove Index pages bigals How-to Forum 11 03-12-2004 01:16 AM
do not index all pages robilix Troubleshooting 2 11-25-2003 02:50 PM


All times are GMT -8. The time now is 07:22 PM.


Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.