Remote

Name

Remote — index or exclude urls from a remote site

Synopsis

Remote = Y / N

Description

When N, the spider will not schedule urls, that do not have the exact same server name as the root url defined by UrlList, for indexing.

Both server names www.foo.com and foo.bar.com are considered remote from www.bar.com.

Default

Remote=N