v83

latestOpenAPI 3.0.3raw.githubusercontent.com2026-08-075785141.5 MB

Dataset Storage: GCS

Check for records given the file pattern

Checks for existence of records matching the file pattern in the bucket/prefix

post/api/dataset-storages/gcs/check-for-records/

Request body

bucketstring nullable

GCS bucket name

datasetinteger required

A unique integer value identifying this dataset.

descriptionstring nullable

Cloud storage description

glob_patternstring nullable

Glob pattern for syncing from bucket

google_application_credentialsstring nullable

The content of GOOGLE_APPLICATION_CREDENTIALS json file

google_project_idstring nullable

Google project ID

last_syncstring date-time nullable

Last sync finished time

last_sync_countinteger nullable

Count of tasks synced last time

last_sync_jobstring nullable

Last sync job ID

{"stackTrail":"components:schemas:GCSDatasetStorageRequest:properties:meta","oasType":"schema","type":"unknown","description":"Meta and debug information about storage processes","nullable":true}

prefixstring nullable

GCS bucket prefix

presignboolean

presign_ttlinteger

Presigned URLs TTL (in minutes)

recursive_scanboolean nullable

Perform recursive scan over the bucket content

regex_filterstring nullable

Cloud storage regex for filtering objects

initialized - Initialized
queued - Queued
in_progress - In progress
failed - Failed
completed - Completed
completed_with_errors - Completed with errors

syncedboolean

Flag if dataset has been previously synced or not

synchronizableboolean

titlestring nullable

Cloud storage title

tracebackstring nullable

Traceback report for the last failed sync

use_blob_urlsboolean

Interpret objects as BLOBs and generate URLs

Response