PhpDig.net - View Single Post - Indexing problem: PhpDig will not spider all of the site

mih · 03-24-2004, 09:43 PM

Thank you kindly for your reply.

Some stats:
I have 161 files which are over 1 meg the biggest is 36 megs.

Again these are pdf files with nothing but graphics and no text.

In one directory which has 41 htm files the largest is 697kb. In this directory it froze (locked up) after completing 16 files only.

I do not know if it gets stuck on large files or large files over time. I looked over the link you provided, do you recommend that I make those changes?

I am not sure if I have shell access to the server but I do have ftp access.

Thank you again.

03-24-2004, 09:43 PM	#3
mih Green Mole Join Date: Mar 2004 Location: New York Posts: 3	Thank you kindly for your reply. Some stats: I have 161 files which are over 1 meg the biggest is 36 megs. Again these are pdf files with nothing but graphics and no text. In one directory which has 41 htm files the largest is 697kb. In this directory it froze (locked up) after completing 16 files only. I do not know if it gets stuck on large files or large files over time. I looked over the link you provided, do you recommend that I make those changes? I am not sure if I have shell access to the server but I do have ftp access. Thank you again.