latestOpenAPI 3.1.0raw.githubusercontent.com2026-08-201,3412,1385.0 MB

3fdc16374d70

Contents

Retrieve page contents

Retrieves clean HTML or Markdown content from a list of URLs. Supports up to 20 URLs per request (public API limit). Specify which formats to return: html, markdown, metadata.

post/web_search/contents

Request body

crawl_timeoutinteger

Timeout for crawling each URL, in seconds (1-60).

formatsstring[]

Content formats to return. If omitted, html and metadata are returned by default. Retrieval is best-effort per URL: a format field appears only when that content could be produced, and a freshly crawled page may also include html even when not requested.

max_ageinteger nullable

Maximum age of cached content in seconds. null means no limit.

urlsstring[] required

List of URLs to retrieve content from (max 20 for public API).

Example request

{
  "crawl_timeout": 10,
  "formats": [
    "markdown",
    "metadata"
  ],
  "urls": [
    "https://en.wikipedia.org/wiki/Artificial_intelligence"
  ]
}

Response

Successful content retrieval response.