... | @@ -759,9 +759,7 @@ When a regular expression is passed to the `--include` option, **only** URLs mat |
... | @@ -759,9 +759,7 @@ When a regular expression is passed to the `--include` option, **only** URLs mat |
|
|
|
|
|
|
|
|
|
The redundant option expects a regular expression and a counter, like so:
|
|
The redundant option expects a regular expression and a counter, like so:
|
|
|
|
`--redundant='calendar.php':3`
|
|
```--redundant='calendar.php':3```
|
|
|
|
|
|
|
|
|
|
|
|
This will cause URLs that contain "calendar.php" to be crawled only 3 times.
|
|
This will cause URLs that contain "calendar.php" to be crawled only 3 times.
|
|
|
|
|
... | | ... | |