Searching a blog

[adilwaris]

I am not sure if this has been answered before or not...

I have a blog which stores individual post files in several folders...a dir for each year, sub-dir for month, and then the post files in addition to archives indexes for each month in the root dir.

I installed phpdig and it works, but it indexes only the last few posts...

How can I get it to index the entire site?

Thanks a lot,
Adil

[vinyl-junkie]

Welcome to the forum, adilwaris. :D

If the links can be reached from the top level domain that you specified when spidering, they should get indexed.

What is the URL for the site you're trying to spider?

[adilwaris]

All the posts cannot be accessed from the top-level, because the homepage only links to past 6/7 posts and the archive pages.

Then each individual post page links back to previous posts with archive pages listing all the posts for each individual month.

The URI is http://www.chechnyawar.com/

[vinyl-junkie]

Phpdig must be able to reach all the links to index them. What you might do is spider from shell. Check out this thread (http://www.phpdig.net/showthread.php?s=&threadid=323&highlight=shell), as it offers some guidance on how to set that up.

Hope this helps. :)

[Charter]

Hi, check this (http://www.phpdig.net/showthread.php?threadid=1139) thread for ophan pages.