PhpDig.net

Go Back   PhpDig.net > PhpDig Forums > Troubleshooting

Reply
 
Thread Tools
Old 05-09-2004, 11:19 PM   #1
zaartix
Orange Mole
 
Join Date: May 2004
Location: russia, samara
Posts: 56
how to dig only 1 page

i have already digged site, but now i need to dig only one page of my site, if i paste link into uri, phpdig making index from the beginning
for example i have domain.com
and need to dig domain.com/somepage/index.php?action=news

how to do this?
zaartix is offline   Reply With Quote
Old 05-09-2004, 11:27 PM   #2
zaartix
Orange Mole
 
Join Date: May 2004
Location: russia, samara
Posts: 56
in manual i find this:
Code:
 Indexing by command line interface
Le script [PHPDIG_DIR]/admin/spider.php could be lauched by the 

shell in order to not overload the webserver. 

Launching the script : 

#php -f [PHPDIG_DIR]/admin/spider.php [option]

List of options :
- all (default) : Update all hosts ;
- forceall : Force update all hosts ;
- http://mondomaine.tld : Add or update the url ;
- path/file : Add or update all urls listed in the given file. 

Examples : 

#php -f [PHPDIG_DIR]/admin/spider.php http://host.mydomain.com
#php -f [PHPDIG_DIR]/admin/spider.php [File containing an urls list]
but in is for shell, how to do this from url request?
spider.php?url=http://www.domain.com/somepage/index.php?action=news
not working

Last edited by zaartix; 05-09-2004 at 11:36 PM.
zaartix is offline   Reply With Quote
Old 05-10-2004, 12:48 AM   #3
bloodjelly
Purple Mole
 
Join Date: Dec 2003
Posts: 106
Hi zaartix -

First, (1) go to the administration panel and highlight the site you want to update. Click "update form" and you'll be taken to a listing of pages already spidered on this URL. (2) Click the right-pointing purple arrow on the left according to the directory your file is in. (3) Then, on the right, your file should show up on a list. Click the green arrow over there to update it. Sorry if that's confusing, but I think once you see it you'll understand. Good luck.
bloodjelly is offline   Reply With Quote
Old 05-10-2004, 01:16 AM   #4
zaartix
Orange Mole
 
Join Date: May 2004
Location: russia, samara
Posts: 56
this way i know, but needed page don't have external link, phpdig didn't find link on that page. i nned add only one page into phpdig base
zaartix is offline   Reply With Quote
Old 05-10-2004, 01:42 AM   #5
bloodjelly
Purple Mole
 
Join Date: Dec 2003
Posts: 106
Maybe you could create a robots.txt file to exclude all but the file you want indexed. This thread might help get you started.
bloodjelly is offline   Reply With Quote
Old 05-10-2004, 01:48 AM   #6
zaartix
Orange Mole
 
Join Date: May 2004
Location: russia, samara
Posts: 56
you are mean that the phpdig can understand robots.txt?
zaartix is offline   Reply With Quote
Old 05-10-2004, 06:05 AM   #7
vinyl-junkie
Purple Mole
 
Join Date: Jan 2004
Posts: 694
Quote:
Originally posted by bloodjelly
First, (1) go to the administration panel and highlight the site you want to update. Click "update form" <snip>
Believe it or not, I never knew how to do this. I do have a question though. I noticed a misspelling on one of the pages on my site yesterday, so I went in and corrected it. (It was a name spelling, from Weir to Wier). When I followed your directions for re-indexing a single URL, I got "duplicate of an existing document! Any idea why that would happen? It's only a single word change, but it still seems like the page should get re-indexed.
vinyl-junkie is offline   Reply With Quote
Old 05-11-2004, 01:06 AM   #8
ibrown
Green Mole
 
ibrown's Avatar
 
Join Date: Mar 2004
Location: London
Posts: 10
Quote:
Originally posted by bloodjelly
First, (1) go to the administration panel and highlight the site you want to update. Click "update form" and you'll be taken to a listing of pages already spidered on this URL. ... <snip>
I too am having trouble updating the index for just four pages of a 9000-page Website ... and I have discovered the listing page as described by Bloodjelly.

However, and interestingly, my missing four pages don't show up in this list! There is nothing fanciful about the filenames (msg00118.htm, msg05327.htm, msg05452.htm ...).

Does PHPDig only list those pages which it has indexed, rather than all files in the directory?
ibrown is offline   Reply With Quote
Old 05-11-2004, 01:23 AM   #9
ibrown
Green Mole
 
ibrown's Avatar
 
Join Date: Mar 2004
Location: London
Posts: 10
Quote:
I wrote:
... my missing four pages don't show up in this list! There is nothing fanciful about the filenames (msg00118.htm, msg05327.htm, msg05452.htm ...).

Does PHPDig only list those pages which it has indexed, rather than all files in the directory?
I have just taken the brute force approach for my site: made a temporary Web page containing links to my missing four pages and uploaded it to my site, giving it the filename of an existing page.

I then went to the list in the update interface and clicked the green arrow to update. Bingo, all missing pages now indexed. Deleted the temporary Web page and reinstituted the original existing page.

I am now a happy camper.
ibrown is offline   Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Modifying PHP DIG? kasper48 How-to Forum 1 03-15-2005 09:18 AM
dig for certain words nmott How-to Forum 1 02-26-2005 08:02 PM
Search Engines and Dig new2dev How-to Forum 1 02-21-2005 01:19 PM
is 'dig 1.8.3 slower than 'dig 1.8.0 JÿGius³ Troubleshooting 1 08-02-2004 07:32 PM
Why Can't I dig this site???? lighthouse Troubleshooting 4 03-12-2004 12:09 AM


All times are GMT -8. The time now is 07:21 AM.


Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.