crawler
Retrieve crawler stats
Retrieves information about the number of crawled, skipped, and failed URLs.
get/1/crawlers/{id}/stats/urls
Path parameters
idstring required
Universally unique identifier (UUID) of the crawler.
Example:e0f6db8a-24f5-4092-83a4-1b2c6cb6d809
Crawler ID.
Response
OK
Example response
{
"data": [
{
"status": "SKIPPED",
"reason": "forbidden_by_robotstxt",
"category": "fetch",
"count": 3,
"readable": "Forbidden by robots.txt"
}
]
}