|
I allredy did all the things you written before.
I have APPEND_TITLE_META true, and DESCRIPTION on true, snipets on false.
Still, on result paegs, there is no Meta description, instead it always displays text from body - the same as the snippets does.
As for updating... I have very dinamic page (new movies) and I add upt to 10 pages every day. Now, in the version 1.6.x all I have to do was to update index.shtml, where all the links to newly added movies are. Spider found all the new html pages and stop.
In the version 1.8.5 spider doesn't find new pages, even if links are on index.shtml. No matter in what way I try. I tried from text box (puting link to index.shtml in), I have LIMIT_TO_DIRECTORY to false, I have tried depth from 2 to 20, link depth to 0... It doesn't work. Spider always tries to spider some other htmls, which are not even linked to index.shtml in any way (and they were allready indexed some time ago).
Now, if I put all the new htmls in text box manually, then it works.
|