|
If I understand you correctly, to make phpBB searchable (and only phpBB) by phpDig, you would do what you exactly what you have done with the robots.txt but leave out the directory that phpBB is located in. If you haven't told the spider to avoid that directory, it will scan it, as long as the spider can find it. So you must at least let the spider scan your main page or a page with links to phpBB on it.
|