Sign in

v1

latestOpenAPI 3.0.12026-07-24110189356.6 KB
ingestion

Send a list of partitions to a stream layer

Upload partitions to the given layer. For better performance batch your partitions (e.g. 1000 per request), rather than uploading them individually.

post/layers/{layerId}/partitions

Path parameters

layerIdstring required

The ID of the layer where you want the data ingested.

Query parameters

billingTagstring

Optional billing tag provided by customer. It will be used in grouping of billing records.

Headers

X-HERE-TraceIdstring

A unique message ID, such as a UUID. This can be included in the request if you want to use an ID that you define. If you do not include an ID, one will be generated during ingestion and included in the response. You can use this ID to track your request and identify the message in the catalog. X-HERE-TraceId is passed as dsTraceId kafka record header.

Request body

Example request

{
  "partitions": [
    {
      "partition": "314010583",
      "checksum": "ff7494d6f17da702862e550c907c0a91",
      "compressedDataSize": 152417,
      "dataSize": 250110,
      "data": "c3RyZWFtIGxheWVyIHBheWxvYWQ=",
      "dataHandle": "1b2ca68f-d4a0-4379-8120-cd025640510c",
      "timestamp": 1648139982000,
      "crc": "c3f276d7"
    }
  ]
}

Response

OK

Example response

{
  "traceId": {
    "parentId": "dafb1f57-23e4-4fbc-9f07-2affe86533b3"
  }
}