Sign in

v1

latestOpenAPI 3.1.02026-07-136138.4 KB
Batch
Distill

Batch Distill Multiple Pages

Distill multiple web pages simultaneously with asynchronous processing.

Use Cases:

  • Process entire website sections or categories
  • Batch import content into your knowledge base
  • Large-scale content migration
  • Periodic content updates from multiple sources

How It Works:

  1. Submit a batch job with up to 100 URLs
  2. Receive a job ID immediately
  3. Poll the status endpoint or receive webhook notification
  4. Retrieve all results when complete

Features:

  • Asynchronous processing for high throughput
  • Automatic retry on failures
  • Webhook notifications when complete
  • Detailed per-URL status and error reporting
post/batch/distill

Request body

urlsstring[] required

List of URLs to distill, maximum 100

timeoutnumber

Timeout per request in milliseconds, default 30000

Example request

{
  "urls": [
    "https://example.com/page1",
    "https://example.com/page2",
    "https://example.com/page3"
  ],
  "webhook": {
    "url": "https://your-server.com/api/webhook/distill",
    "headers": {
      "Authorization": "Bearer your-webhook-secret"
    }
  }
}

Response

Success response

successboolean

Example response

{
  "success": true,
  "data": {
    "id": "batch_abc123",
    "status": "processing",
    "total": 3
  }
}