v48

latestOpenAPI 3.0.0raw.githubusercontent.com2025-12-0297180624.8 KB

Model

Generate coordinates for a model

post/model

Request body

model'gbox-handy-1'

Model to use

screenshotstring required

Screenshot image as HTTP(S) URL or base64-encoded data URI. Supports both formats: 1) HTTP(S) URL pointing to an image file; 2) Base64-encoded data URI with format 'data:image/png;base64,[data]' or 'data:image/jpeg;base64,[data]'. Only PNG and JPEG formats are supported for base64.

Example request

{
  "model": "gbox-handy-1",
  "action": {
    "type": "click",
    "target": "the VSCode app icon on the bottom dock"
  }
}

Response

idstring required

Unique ID of this request, can be used for issue reporting and feedback

Example response

{
  "response": {
    "type": "click",
    "coordinates": {
      "x": 520,
      "y": 340
    }
  },
  "id": "123e4567-e89b-12d3-a456-426614174000"
}