PhpDig.net - View Single Post

attriel · 01-14-2005, 11:23 AM

So, I tossed phpdig onto my dev server, figure I'll see how it goes before worrying about how to hack it onto the deployment servers and their frankensteinien convolutions.

But I immediately run into a problem. I tell it to start indexing at:

http://site.name.here/

And it starts, and it finds the links on that page, (there are 28, I believe) all of the form:
http://site.name.here/view.php?id=13672

Unfortunately, it appears that I'm tossing the # out, and just going to
http://site.name.here/view.php?id=

Since there are roughly 15000 various IDs involved in different sections, indexing 3 pages is suboptimal :/ (index, and 2 variations on the url)

I thought it might be the PHPSESSID, but I flipped that off in the config and it continues stripping, so ... What variable do I want to tune to make it retain those #'s. B/c they're mildly important

All links are relative, but I don't imagine that should matter

Thanks

--attriel

(I can't give the link , since it's still a development server and not publicly available anywhere)

01-14-2005, 11:23 AM	#1
attriel Green Mole Join Date: Jan 2005 Posts: 3	indexing dynamic pages So, I tossed phpdig onto my dev server, figure I'll see how it goes before worrying about how to hack it onto the deployment servers and their frankensteinien convolutions. But I immediately run into a problem. I tell it to start indexing at: http://site.name.here/ And it starts, and it finds the links on that page, (there are 28, I believe) all of the form: http://site.name.here/view.php?id=13672 Unfortunately, it appears that I'm tossing the # out, and just going to http://site.name.here/view.php?id= Since there are roughly 15000 various IDs involved in different sections, indexing 3 pages is suboptimal :/ (index, and 2 variations on the url) I thought it might be the PHPSESSID, but I flipped that off in the config and it continues stripping, so ... What variable do I want to tune to make it retain those #'s. B/c they're mildly important All links are relative, but I don't imagine that should matter Thanks --attriel (I can't give the link , since it's still a development server and not publicly available anywhere)