v1

latestOpenAPI 3.0.02026-07-222980136.7 KB
Audits

Get a crawlability check

get/v1/audits/geo/crawlability-checks/{checkId}

Path parameters

checkIdstring required

Crawlability check identifier.

Example:01HX7K2YV9D3M8N0G6Q5R4S3T2

Crawlability check identifier.

Response

The crawlability check.

idstring required
workspaceIdstring required
urlstring required
domainstring required
status'pending' | 'completed' | 'failed' required
createdDatestring required
completedDatestring
robotsTxtAnalysisobject
robotsTxtAnalysisResultboolean
serverBotAccessobject

Per-bot probe results. Keys are crawler names as they appear in robots.txt / User-Agent (e.g. GPTBot, PerplexityBot, ClaudeBot, Google-Extended, OAI-SearchBot, ChatGPT-User); values describe whether each bot was able to fetch the resource.

Example response

{
  "id": "01HXCRAW1MZB7VAW4PQ8K2N3J9",
  "workspaceId": "01HX7K2YV9D3M8N0G6Q5R4S3T2",
  "url": "https://www.adidas.com/us/running",
  "domain": "adidas.com",
  "status": "completed",
  "createdDate": "2026-01-26T08:29:44.850Z",
  "completedDate": "2026-01-26T08:30:14.540Z",
  "robotsTxtAnalysis": {
    "GPTBot": true,
    "PerplexityBot": true,
    "ClaudeBot": true,
    "Google-Extended": true,
    "OAI-SearchBot": true,
    "ChatGPT-User": true,
    "CCBot": true
  },
  "robotsTxtAnalysisResult": true,
  "serverBotAccess": {
    "GPTBot": {
      "userAgent": "Mozilla/5.0 (compatible; GPTBot/1.0; +https://openai.com/gptbot)",
      "status": 200,
      "ok": true
    },
    "PerplexityBot": {
      "userAgent": "Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://www.perplexity.ai/bot)",
      "status": 200,
      "ok": true
    },
    "ClaudeBot": {
      "userAgent": "Mozilla/5.0 (compatible; ClaudeBot/1.0; +https://www.anthropic.com)",
      "status": 200,
      "ok": true
    },
    "Google-Extended": {
      "userAgent": "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)",
      "status": 200,
      "ok": true
    }
  }
}