![]() |
|
![]() |
#1 |
Green Mole
Join Date: Apr 2004
Posts: 1
|
Restrict Spidering to new pages only
My site has utilities for adding new content and once added the content remains static.
I would like to modfiy the publish scripts to spider the page that has just been uploaded. Something along the lines of $article_id = $sql_post_newarticle[aid]; $url_to_spider = "./view_article.php?aid=$article_id"; $spider_depth = 1; $spiderresult = spider($url_to_spider, $spider_depth); Is this possible with PHPDig? |
![]() |
![]() |
![]() |
#2 |
Head Mole
Join Date: May 2003
Posts: 2,539
|
Hi. Perhaps try this thread and then index only the new pages.
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension. |
![]() |
![]() |
![]() |
|
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
Not spidering mod rewritten pages | wineo | Troubleshooting | 1 | 02-22-2006 07:53 PM |
Spidering Stops, Site is Locked after 7 Pages | nevsie | Troubleshooting | 3 | 03-02-2005 03:52 PM |
Shell Spidering Quits After Indexing A Few Pages | vinyl-junkie | Troubleshooting | 11 | 10-09-2004 06:08 PM |
not spidering all pages (too many links on page?) | mirdin | Troubleshooting | 2 | 09-01-2004 06:08 AM |
Spidering stops after 6 level 1 pages | Steve | Troubleshooting | 3 | 05-20-2004 04:56 PM |