v1

latestOpenAPI 3.0.02026-07-224452146.0 KB

Crawling

Get the errors of a crawl job

get/crawl/{id}/errors

Successful response

robotsBlockedstring[]

List of URLs that were attempted in scraping but were blocked by robots.txt