UrlExclude

Description

Any url found by the spider starting with one of the urls defined by this directive will not be scheduled for indexing. Alkaline will do a case-sensitive match.

With the global RegExp option enabled or a RegExp prefix, the parameter must be a list of regular expressions. This option has the RegExp UrlExclude extension since version 1.6.

Note that this directive has no effect on already indexed urls. It will be used only when a new url is found by the spider.

Example

UrlExclude=http://www.foo.com/private/,http://foo.bar.com/stats.html