|
|
Exts
NameExts — valid extensions for files to spider
Synopsis
Exts =
ext1
[,ext2
] [,ext3 ...
]
Description
Defines a list of valid extensions for files to retrieve and index.
Extensions must not have the leading dot.
Urls without an extensions, such as http://www.foo.com/bar/ will be retrieved anyway.
|
|