v2

latestOpenAPI 3.0.0raw.githubusercontent.com2026-06-109044.3 KB

Scrape URL

Render a URL in a browser and return the page content as HTML or Markdown.

post/v1/scrape

Request body

urlstring uri required

URL to scrape.

output'html' | 'md'

Response format. Defaults to html.

Example request

{
  "url": "https://example.com",
  "output": "html",
  "smartdoor": {
    "nodes": [
      {
        "type": "hosted",
        "country": "US"
      }
    ],
    "timeout": 60000,
    "delay": 2500,
    "retryFresh": true,
    "retryCount": 2,
    "refreshWhile": {
      "expression": "location.href.includes('/risk/challenge')",
      "maxRefreshes": 3,
      "minDelayMs": 700,
      "maxDelayMs": 1300
    },
    "waitForSelector": ".content-loaded",
    "waitForSelectorValue": "Ready",
    "waitForFunction": "window.dataLoaded === true",
    "challengeBudget": 10000
  }
}

Response

Successfully scraped the URL. The response body is the scraped content.