PhpDig.net - View Single Post - Split the search engine and the web crawler

nobrin · 08-14-2005, 04:26 PM

I would like the make the web crawling locally (altering /etc/hosts), and upload only the search engine on the web site (with the up-to-date phpdig tables, of course). This would ensure more security (maybe) and easiness (to me).

Is this already possible?

08-14-2005, 04:26 PM	#1
nobrin Green Mole Join Date: Aug 2005 Posts: 2	Split the search engine and the web crawler I would like the make the web crawling locally (altering /etc/hosts), and upload only the search engine on the web site (with the up-to-date phpdig tables, of course). This would ensure more security (maybe) and easiness (to me). Is this already possible?