v2

latestOpenAPI 3.1.02026-07-26937792.5 KB

Crawl Website

Legacy endpoint. Scrapes a single URL and saves to the knowledge base.

Preserved for backward compatibility -- new integrations should use POST /scrape/website instead. Now delegates to Firecrawl v2 SDK and honours the maxAge caching parameter.

post/scrape/crawl-website

Headers

authorizationstring required

Request body

urlstring required
excludePathsstring[] nullable
includePathsstring[] nullable
maxDepthinteger nullable
limitinteger nullable
maxAgeinteger nullable
agentIdstring required
lastUpdatedBystring required

Response

Successful Response

{"stackTrail":"paths:/scrape/crawl-website:post:responses:200:content:application/json:schema","oasType":"schema","type":"unknown"}