Added
- Support CSV and JSON Lines formats for exporting results
- Emit
requeststarted
,requestskipped
,requestfinished
,requestfailed
,maxdepthreached
,maxrequestreached
anddisconnected
events. - Improve debug logs by tracing public APIs and events.
Changed
- Allow
onSuccess
andevaluatePage
options asnull
. - Change
crawler.isPaused
,crawler.queueSize
,crawler.pendingQueueSize
andcrawler.requestedCount
from read-only properties to methods.
Fixed
- Fix a bug of ignoring maxDepth option.