Spaces (%20) in URLs
 

I found a minor problem with phpDig but I haven't found where yet to fix it. If the HTML file has a space in the name such as "http://my product.html", the spider only sees "http://my" and consequently, doesn't index "http://my product.html" and the pages that are linked from it.

If I replace the %20 with a _, everything works great, but my designer being a Windows user (although there's nothing wrong with that :-) has put spaces in alot of URLs.

Is there a way to tell phpDig to honor the spaces in the filenames/URLs?

Look for $allowed_link_chars in the config file and add a space to the character class.

Turns out that adding a space to the existing class didn't work (I assume it was because I had place the space at the end of the class) but uncommenting out the line above it worked great! Thanks!

Now, back to figuring out why the dashes don't get indexed...