PhpDig.net

PhpDig.net (http://www.phpdig.net/forum/index.php)
-   How-to Forum (http://www.phpdig.net/forum/forumdisplay.php?f=33)
-   -   Crawl for illegal content (http://www.phpdig.net/forum/showthread.php?t=1671)

losttoy 12-24-2004 07:03 AM

Crawl for illegal content
 
Hi,

I need to crawl the sites of customers hosted with us and try to assess if any of them have illegal/pornographic material hosted on their servers.

I am currently trying to use Metis but it is horribly error prone and slooowww.

I want a site to be crawled for certain keywords, if content of any URL matches the keywords then I want a report of all such URLs for a customer to be emailed to my support-desk for verification/action.

Has anyone done this with PHPDig? Is this possible or is PHPDig going to give me reports only when I query it? More like I run a query on the indexed information everyday and mail myself a report.

Thanks,

Siddhartha


All times are GMT -8. The time now is 03:30 PM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.