Sign in

v49

latestOpenAPI 3.0.2raw.githubusercontent.com2026-02-0620117129.6 KB
crawler

Crawl URLs

Crawls the specified URLs, extracts records from them, and adds them to the index. If a crawl is running (the crawler's reindexing property is true), the records are added to a temporary index.

This operation is rate-limited to 500 requests every 24 hours.

post/1/crawlers/{id}/urls/crawl

Path parameters

idstring required

Universally unique identifier (UUID) of the crawler.

Example:e0f6db8a-24f5-4092-83a4-1b2c6cb6d809

Crawler ID.

Request body

urlsstring[] required

URLs to crawl.

saveboolean

Whether the specified URLs should be added to the extraURLs property of the crawler configuration. If unspecified, the URLs are added to the extraUrls field only if they haven't been indexed during the last reindex.

Example request

{
  "urls": [
    "https://www.algolia.com/products/crawler/"
  ]
}

Response

OK

taskIdstring required

Universally unique identifier (UUID) of the task.

Example response

{
  "taskId": "98458796-b7bb-4703-8b1b-785c1080b110"
}