Welcome to Vestris Inc.
Internet Interactive Solutions Company



Software Documentation

UrlIndex

Name

UrlIndex — follow links and index

Synopsis

UrlIndex = url1 [,url2 ] [,url3 ... ]

Description

Instruct Alkaline to index only a particular set of urls. When specified, all urls not matching the UrlIndex criteria, will be retrieved, parsed, but not indexed. This means their content and meta tags will not be used and matching pages will not appear in search results, but the links will still be followed. Unlike the UrlInclude directive, this option is processed after a page is retrieved.

With the global RegExp option enabled or a RegExp prefix, the parameter must be a list of regular expressions. This option has the RegExp UrlIndex extension since version 1.6.

This option was added in version 1.3 (09-Jul-2000).

Example

To index only http://www.foo.com/bar/ files, but follow all links:
UrlList=http://www.foo.com/
UrlIndex=http://www.foo.com/bar/