Description
Instruct Alkaline to index only a particular set of urls. When specified, all urls not
matching
the UrlIndex criteria, will be retrieved, parsed, but not indexed. This means their content and meta tags will not be used and
matching pages will not appear in search results, but the links will still be followed. Unlike the
UrlInclude
directive, this option is processed after a page is retrieved.
With the global RegExp
option enabled or a RegExp prefix, the parameter
must be a list of regular expressions. This option has the RegExp UrlIndex
extension since version 1.6.
This option was added in version 1.3 (09-Jul-2000).