Description
Defines the maximum depth of urls to follow. Alkaline will first index pages of Depth 1, 2, etc.
A negative value of -1 instructs the spider to ignore this setting.
|
With Remote=Y
and Depth=-1
,
Alkaline will attempt to index all encountered links (the entire web).
|
To index a large set of individual urls, you can use the UrlListFile directive along with a Depth setting of 0.
This will have the same effect as the SkipLinks=Y
directive.