PhpDig.net

Go Back   PhpDig.net > PhpDig Forums > How-to Forum

Reply
 
Thread Tools
Old 02-03-2004, 11:28 AM   #1
Jeff
Green Mole
 
Join Date: Feb 2004
Posts: 3
Crawl mutiple urls

I would like to crawl more then one url at a time.

Can Dig do this?

Jeff
Jeff is offline   Reply With Quote
Old 02-03-2004, 02:13 PM   #2
bloodjelly
Purple Mole
 
Join Date: Dec 2003
Posts: 106
You can run two instances of the script from the shell (see http://www.phpdig.net/navigation.php?action=doc#toc8) or you could open two browser windows and crawl a different site in each.
bloodjelly is offline   Reply With Quote
Old 02-03-2004, 02:47 PM   #3
Jeff
Green Mole
 
Join Date: Feb 2004
Posts: 3
Wink

Well i could write a macro too, but i was woundering if it could do a lot more then the one or two, more on the order of 2 - 3 hundred.
Jeff is offline   Reply With Quote
Old 02-03-2004, 05:47 PM   #4
David J Harmon
Orange Mole
 
David J Harmon's Avatar
 
Join Date: Sep 2003
Location: Corbin KY
Posts: 45
I've uses the 2-4 browser way, but I would like to see if you could make a macro and do more...
__________________
David J Harmon
Cyberkopia.NETwork Geeks Style
http://cyberkoipia.net
David J Harmon is offline   Reply With Quote
Old 02-03-2004, 06:59 PM   #5
Jeff
Green Mole
 
Join Date: Feb 2004
Posts: 3
creat a file called url.txt on your desktop, have the urls line spaced

http//www.msn.com
http://dogpile.com
so on
so on


let me know how it works out

it will tie up the pc your on, that's why i don;'t want this way

jeff
Attached Files
File Type: zip phpdigmacro.zip (6.2 KB, 22 views)
Jeff is offline   Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
never ending crawl oehk Troubleshooting 0 12-12-2006 05:34 AM
CRAWL - SPDIER A WHOLE WEBSITE mahesr The Mole Hole 0 11-01-2006 09:43 PM
No results after the crawl GunMuse Script Installation 8 04-12-2005 05:57 PM
crawl my website only hula Troubleshooting 0 08-29-2004 03:37 AM


All times are GMT -8. The time now is 05:42 AM.


Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.