Go Back > PhpDig Forums > Troubleshooting

Thread Tools
Old 01-16-2007, 05:30 AM   #1
Green Mole
Join Date: Jan 2007
Posts: 1
Index some, but spider all pages

Hi all,
Have a Question:

The index page of the domain i want to spider, contains links to say level1.php?id=xx and level1.php?id=yy

level1.php?id=xx contains links to level2.php?id=aa and level2.php?id=bb

level1.php?id=yy contains links to level2.php?id=cc and level2.php?id=dd

The pages i want to index are the level2.php pages. But i only can reach them trough index -> level1.php -> level2.php.

So the spider needs to follow all the links from the root.

What would be the best way to index some, but spider all pages?
griemer is offline   Reply With Quote

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Spider stops before all pages are indexed halide Troubleshooting 3 07-19-2005 12:26 AM
Using a dictionnary to spider pages Edomondo How-to Forum 0 11-23-2004 07:36 AM
converted from html pages to php pages now no pages will index!!! help!! bigals Troubleshooting 24 04-01-2004 09:34 AM
Remove Index pages bigals How-to Forum 11 03-12-2004 12:16 AM
do not index all pages robilix Troubleshooting 2 11-25-2003 01:50 PM

All times are GMT -8. The time now is 05:37 PM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2018, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.