---
title: "POST /v1/{+name}:write"
method: POST
path: "/v1/{+name}:write"
tags: ["projects"]
---

# POST /v1/{+name}:write

`POST /v1/{+name}:write`

Write wrapper objects from dataplane to spanner

## Path parameters

- `name` string, required

## Request body

- WriteSessionSparkApplicationContextRequest — Write Spark Application data to internal storage systems
  - `parent` string — Required. Parent (Batch) resource reference.
  - `sparkWrapperObjects` SparkWrapperObject[] — Required. The batch of spark application context objects sent for ingestion.
    - `executorStageSummary` ExecutorStageSummary — Executor resources consumed by a stage.
      - `isExcludedForStage` boolean
      - `inputBytes` string, int64
      - `stageId` string, int64
      - `failedTasks` integer
      - `shuffleWriteRecords` string, int64
      - `shuffleWrite` string, int64
      - `stageAttemptId` integer
      - `executorId` string
      - `outputBytes` string, int64
      - `taskTimeMillis` string, int64
      - `diskBytesSpilled` string, int64
      - `memoryBytesSpilled` string, int64
      - `killedTasks` integer
      - `outputRecords` string, int64
      - `shuffleReadRecords` string, int64
      - `peakMemoryMetrics` ExecutorMetrics
        - `metrics` object
      - `shuffleRead` string, int64
      - `succeededTasks` integer
      - `inputRecords` string, int64
    - `applicationInfo` ApplicationInfo — High level information corresponding to an application.
      - `coresGranted` integer
      - `quantileDataStatus` 'QUANTILE_DATA_STATUS_UNSPECIFIED' | 'QUANTILE_DATA_STATUS_COMPLETED' | 'QUANTILE_DATA_STATUS_FAILED'
      - `attempts` ApplicationAttemptInfo[]
        - `durationMillis` string, int64
        - `lastUpdated` string, google-datetime
        - `attemptId` string
        - `completed` boolean
        - `endTime` string, google-datetime
        - `startTime` string, google-datetime
        - `sparkUser` string
        - `appSparkVersion` string
      - `maxCores` integer
      - `coresPerExecutor` integer
      - `memoryPerExecutorMb` integer
      - `applicationContextIngestionStatus` 'APPLICATION_CONTEXT_INGESTION_STATUS_UNSPECIFIED' | 'APPLICATION_CONTEXT_INGESTION_STATUS_COMPLETED'
      - `name` string
      - `applicationId` string
    - `sparkPlanGraph` SparkPlanGraph — A graph used for storing information of an executionPlan of DataFrame.
      - `executionId` string, int64
      - `nodes` SparkPlanGraphNodeWrapper[]
        - `cluster` SparkPlanGraphCluster — Represents a tree of spark plan.
          - `desc` string
          - `sparkPlanGraphClusterId` string, int64
          - `name` string
          - `metrics` SqlPlanMetric[]
            - `accumulatorId` string, int64
            - `metricType` string
            - `name` string
          - `metadata` object — Optional. Additional metadata for the spark plan graph cluster.
          - `nodes` SparkPlanGraphNodeWrapper[]
        - `node` SparkPlanGraphNode — Represents a node in the spark plan tree.
          - `metrics` SqlPlanMetric[]
            - `accumulatorId` string, int64
            - `metricType` string
            - `name` string
          - `name` string
          - `sparkPlanGraphNodeId` string, int64
          - `desc` string
          - `metadata` object — Optional. Additional metadata for the spark plan graph cluster.
      - `edges` SparkPlanGraphEdge[]
        - `toId` string, int64
        - `fromId` string, int64
    - `nativeSqlExecutionUiData` NativeSqlExecutionUiData — Native SQL Execution Data
      - `fallbackDescription` string — Optional. Description of the fallback.
      - `numNativeNodes` integer — Optional. Number of nodes in Native.
      - `fallbackNodeToReason` FallbackReason[] — Optional. Fallback node to reason.
        - `fallbackNode` string — Optional. Fallback node information.
        - `fallbackReason` string — Optional. Fallback to Spark reason.
      - `executionId` string, int64 — Required. Execution ID of the Native SQL Execution.
      - `description` string — Optional. Description of the execution.
      - `numFallbackNodes` integer — Optional. Number of nodes fallen back to Spark.
    - `poolData` PoolData — Pool Data
      - `name` string
      - `stageIds` string[]
    - `sqlExecutionUiData` SqlExecutionUiData — SQL Execution Data
      - `errorMessage` string
      - `jobs` object
      - `metricValues` object
      - `modifiedConfigs` object
      - `metrics` SqlPlanMetric[]
        - `accumulatorId` string, int64
        - `metricType` string
        - `name` string
      - `details` string
      - `stages` string[]
      - `submissionTime` string, google-datetime
      - `executionId` string, int64
      - `metricValuesIsNull` boolean
      - `rootExecutionId` string, int64
      - `completionTime` string, google-datetime
      - `physicalPlanDescription` string
      - `description` string
    - `sparkConnectExecutionInfo` SparkConnectExecutionInfo — Represents the lifecycle and details of an Execution via Spark Connect
      - `operationId` string — Unique identifier for the operation.
      - `state` 'EXECUTION_STATE_UNKNOWN' | 'EXECUTION_STATE_STARTED' | 'EXECUTION_STATE_COMPILED' | 'EXECUTION_STATE_READY' | 'EXECUTION_STATE_CANCELED' | 'EXECUTION_STATE_FAILED' | 'EXECUTION_STATE_FINISHED' | 'EXECUTION_STATE_CLOSED' — Output only. Current state of the execution.
      - `sessionId` string — Required. Session ID, ties the execution to a specific Spark Connect session.
      - `jobTag` string — Required. Job tag of the execution.
      - `startTimestamp` string, int64 — Timestamp when the execution started.
      - `closeTimestamp` string, int64 — Timestamp when the execution was closed.
      - `statement` string — statement of the execution.
      - `userId` string — User ID of the user who started the execution.
      - `finishTimestamp` string, int64 — Timestamp when the execution finished.
      - `jobIds` string[] — Optional. List of job ids associated with the execution.
      - `sparkSessionTags` string[] — Optional. Tags associated with the Spark session.
      - `detail` string — Detailed information about the execution.
      - `sqlExecIds` string[] — Optional. List of sql execution ids associated with the execution.
    - `applicationId` string — Application Id created by Spark.
    - `appSummary` AppSummary
      - `numCompletedJobs` integer
      - `numCompletedStages` integer
    - `streamBlockData` StreamBlockData — Stream Block Data.
      - `useMemory` boolean
      - `deserialized` boolean
      - `useDisk` boolean
      - `diskSize` string, int64
      - `name` string
      - `storageLevel` string
      - `executorId` string
      - `hostPort` string
      - `memSize` string, int64
    - `resourceProfileInfo` ResourceProfileInfo — Resource profile that contains information about all the resources required by executors and tasks.
      - `executorResources` object
      - `resourceProfileId` integer
      - `taskResources` object
    - `rddStorageInfo` RddStorageInfo — Overall data about RDD storage.
      - `diskUsed` string, int64
      - `numCachedPartitions` integer
      - `name` string
      - `storageLevel` string
      - `partitions` RddPartitionInfo[]
        - `memoryUsed` string, int64
        - `storageLevel` string
        - `executors` string[]
        - `blockName` string
        - `diskUsed` string, int64
      - `rddStorageId` integer
      - `numPartitions` integer
      - `memoryUsed` string, int64
      - `dataDistribution` RddDataDistribution[]
        - `address` string
        - `memoryUsed` string, int64
        - `onHeapMemoryUsed` string, int64
        - `onHeapMemoryRemaining` string, int64
        - `diskUsed` string, int64
        - `offHeapMemoryUsed` string, int64
        - `offHeapMemoryRemaining` string, int64
        - `memoryRemaining` string, int64
    - `rddOperationGraph` RddOperationGraph — Graph representing RDD dependencies. Consists of edges and a root cluster.
      - `outgoingEdges` RddOperationEdge[]
        - `fromId` integer
        - `toId` integer
      - `incomingEdges` RddOperationEdge[]
        - `fromId` integer
        - `toId` integer
      - `rootCluster` RddOperationCluster — A grouping of nodes representing higher level constructs (stage, job etc.).
        - `name` string
        - `childNodes` RddOperationNode[]
          - `callsite` string
          - `barrier` boolean
          - `cached` boolean
          - `nodeId` integer
          - `name` string
          - `outputDeterministicLevel` 'DETERMINISTIC_LEVEL_UNSPECIFIED' | 'DETERMINISTIC_LEVEL_DETERMINATE' | 'DETERMINISTIC_LEVEL_UNORDERED' | 'DETERMINISTIC_LEVEL_INDETERMINATE'
        - `childClusters` RddOperationCluster[]
        - `rddClusterId` string
      - `edges` RddOperationEdge[]
        - `fromId` integer
        - `toId` integer
      - `stageId` string, int64
    - `speculationStageSummary` SpeculationStageSummary — Details of the speculation task when speculative execution is enabled.
      - `numKilledTasks` integer
      - `stageId` string, int64
      - `numFailedTasks` integer
      - `numTasks` integer
      - `stageAttemptId` integer
      - `numCompletedTasks` integer
      - `numActiveTasks` integer
    - `executorSummary` ExecutorSummary — Details about executors used by the application.
      - `memoryMetrics` MemoryMetrics
        - `totalOffHeapStorageMemory` string, int64
        - `usedOffHeapStorageMemory` string, int64
        - `usedOnHeapStorageMemory` string, int64
        - `totalOnHeapStorageMemory` string, int64
      - `maxMemory` string, int64
      - `resources` object
      - `totalShuffleRead` string, int64
      - `addTime` string, google-datetime
      - `executorLogs` object
      - `totalCores` integer
      - `isActive` boolean
      - `hostPort` string
      - `excludedInStages` string[]
      - `activeTasks` integer
      - `completedTasks` integer
      - `resourceProfileId` integer
      - `failedTasks` integer
      - `removeTime` string, google-datetime
      - `isExcluded` boolean
      - `rddBlocks` integer
      - `totalGcTimeMillis` string, int64
      - `totalDurationMillis` string, int64
      - `removeReason` string
      - `memoryUsed` string, int64
      - `peakMemoryMetrics` ExecutorMetrics
        - `metrics` object
      - `totalTasks` integer
      - `diskUsed` string, int64
      - `maxTasks` integer
      - `executorId` string
      - `totalInputBytes` string, int64
      - `totalShuffleWrite` string, int64
      - `attributes` object
    - `taskData` TaskData — Data corresponding to tasks created by spark.
      - `schedulerDelayMillis` string, int64
      - `status` string
      - `gettingResultTimeMillis` string, int64
      - `speculative` boolean
      - `resultFetchStart` string, google-datetime
      - `hasMetrics` boolean
      - `stageId` string, int64
      - `durationMillis` string, int64
      - `accumulatorUpdates` AccumulableInfo[]
        - `update` string
        - `value` string
        - `accumullableInfoId` string, int64
        - `name` string
      - `errorMessage` string
      - `taskId` string, int64
      - `taskLocality` string
      - `partitionId` integer
      - `attempt` integer
      - `host` string
      - `executorLogs` object
      - `stageAttemptId` integer
      - `launchTime` string, google-datetime
      - `executorId` string
      - `index` integer
      - `taskMetrics` TaskMetrics — Executor Task Metrics
        - `resultSerializationTimeMillis` string, int64
        - `executorDeserializeTimeMillis` string, int64
        - `peakExecutionMemoryBytes` string, int64
        - `executorDeserializeCpuTimeNanos` string, int64
        - `outputMetrics` OutputMetrics — Metrics about the data written by the task.
          - `recordsWritten` string, int64
          - `bytesWritten` string, int64
        - `executorRunTimeMillis` string, int64
        - `shuffleWriteMetrics` ShuffleWriteMetrics — Shuffle data written by task.
          - `recordsWritten` string, int64
          - `writeTimeNanos` string, int64
          - `bytesWritten` string, int64
        - `diskBytesSpilled` string, int64
        - `memoryBytesSpilled` string, int64
        - `shuffleReadMetrics` ShuffleReadMetrics — Shuffle data read by the task.
          - `remoteReqsDuration` string, int64
          - `shufflePushReadMetrics` ShufflePushReadMetrics
            - `remoteMergedBlocksFetched` string, int64
            - `remoteMergedChunksFetched` string, int64
            - `mergedFetchFallbackCount` string, int64
            - `remoteMergedReqsDuration` string, int64
            - `localMergedChunksFetched` string, int64
            - `localMergedBlocksFetched` string, int64
            - `remoteMergedBytesRead` string, int64
            - `corruptMergedBlockChunks` string, int64
            - `localMergedBytesRead` string, int64
          - `remoteBytesReadToDisk` string, int64
          - `remoteBlocksFetched` string, int64
          - `fetchWaitTimeMillis` string, int64
          - `remoteBytesRead` string, int64
          - `recordsRead` string, int64
          - `localBlocksFetched` string, int64
          - `localBytesRead` string, int64
        - `executorCpuTimeNanos` string, int64
        - `jvmGcTimeMillis` string, int64
        - `resultSize` string, int64
        - `inputMetrics` InputMetrics — Metrics about the input data read by the task.
          - `recordsRead` string, int64
          - `bytesRead` string, int64
    - `eventTimestamp` string, google-datetime — VM Timestamp associated with the data object.
    - `applicationEnvironmentInfo` ApplicationEnvironmentInfo — Details about the Environment that the application is running in.
      - `classpathEntries` object
      - `resourceProfiles` ResourceProfileInfo[]
        - `executorResources` object
        - `resourceProfileId` integer
        - `taskResources` object
      - `runtime` SparkRuntimeInfo
        - `javaHome` string
        - `scalaVersion` string
        - `javaVersion` string
      - `sparkProperties` object
      - `hadoopProperties` object
      - `systemProperties` object
      - `metricsProperties` object
    - `processSummary` ProcessSummary — Process Summary
      - `hostPort` string
      - `totalCores` integer
      - `processLogs` object
      - `processId` string
      - `isActive` boolean
      - `removeTime` string, google-datetime
      - `addTime` string, google-datetime
    - `stageData` StageData — Data corresponding to a stage.
      - `resourceProfileId` integer
      - `status` 'STAGE_STATUS_UNSPECIFIED' | 'STAGE_STATUS_ACTIVE' | 'STAGE_STATUS_COMPLETE' | 'STAGE_STATUS_FAILED' | 'STAGE_STATUS_PENDING' | 'STAGE_STATUS_SKIPPED'
      - `executorMetricsDistributions` ExecutorMetricsDistributions
        - `outputRecords` number[]
        - `shuffleReadRecords` number[]
        - `peakMemoryMetrics` ExecutorPeakMetricsDistributions
          - `executorMetrics` ExecutorMetrics[]
            - `metrics` object
          - `quantiles` number[]
        - `shuffleRead` number[]
        - `succeededTasks` number[]
        - `inputRecords` number[]
        - `quantiles` number[]
        - `outputBytes` number[]
        - `taskTimeMillis` number[]
        - `diskBytesSpilled` number[]
        - `memoryBytesSpilled` number[]
        - `killedTasks` number[]
        - `failedTasks` number[]
        - `shuffleWriteRecords` number[]
        - `shuffleWrite` number[]
        - `inputBytes` number[]
      - `completionTime` string, google-datetime
      - `numCompletedIndices` integer
      - `numFailedTasks` integer
      - `rddIds` string[]
      - `firstTaskLaunchedTime` string, google-datetime
      - `accumulatorUpdates` AccumulableInfo[]
        - `update` string
        - `value` string
        - `accumullableInfoId` string, int64
        - `name` string
      - `failureReason` string
      - `details` string
      - `speculationSummary` SpeculationStageSummary — Details of the speculation task when speculative execution is enabled.
        - `numKilledTasks` integer
        - `stageId` string, int64
        - `numFailedTasks` integer
        - `numTasks` integer
        - `stageAttemptId` integer
        - `numCompletedTasks` integer
        - `numActiveTasks` integer
      - `numActiveTasks` integer
      - `isShufflePushEnabled` boolean
      - `killedTasksSummary` object
      - `stageAttemptId` integer
      - `locality` object
      - `submissionTime` string, google-datetime
      - `shuffleMergersCount` integer
      - `schedulingPool` string
      - `stageId` string, int64
      - `numKilledTasks` integer
      - `description` string
      - `peakExecutorMetrics` ExecutorMetrics
        - `metrics` object
      - `name` string
      - `tasks` object
      - `jobIds` string[]
      - `stageMetrics` StageMetrics — Stage Level Aggregated Metrics
        - `resultSerializationTimeMillis` string, int64
        - `executorDeserializeTimeMillis` string, int64
        - `peakExecutionMemoryBytes` string, int64
        - `stageOutputMetrics` StageOutputMetrics — Metrics about the output written by the stage.
          - `recordsWritten` string, int64
          - `bytesWritten` string, int64
        - `executorDeserializeCpuTimeNanos` string, int64
        - `executorRunTimeMillis` string, int64
        - `stageShuffleWriteMetrics` StageShuffleWriteMetrics — Shuffle data written for the stage.
          - `recordsWritten` string, int64
          - `bytesWritten` string, int64
          - `writeTimeNanos` string, int64
        - `stageShuffleReadMetrics` StageShuffleReadMetrics — Shuffle data read for the stage.
          - `localBlocksFetched` string, int64
          - `localBytesRead` string, int64
          - `bytesRead` string, int64
          - `remoteBlocksFetched` string, int64
          - `fetchWaitTimeMillis` string, int64
          - `remoteBytesRead` string, int64
          - `recordsRead` string, int64
          - `remoteBytesReadToDisk` string, int64
          - `remoteReqsDuration` string, int64
          - `stageShufflePushReadMetrics` StageShufflePushReadMetrics
            - `mergedFetchFallbackCount` string, int64
            - `remoteMergedReqsDuration` string, int64
            - `localMergedChunksFetched` string, int64
            - `remoteMergedBlocksFetched` string, int64
            - `remoteMergedChunksFetched` string, int64
            - `remoteMergedBytesRead` string, int64
            - `localMergedBlocksFetched` string, int64
            - `corruptMergedBlockChunks` string, int64
            - `localMergedBytesRead` string, int64
        - `diskBytesSpilled` string, int64
        - `memoryBytesSpilled` string, int64
        - `executorCpuTimeNanos` string, int64
        - `jvmGcTimeMillis` string, int64
        - `stageInputMetrics` StageInputMetrics — Metrics about the input read by the stage.
          - `bytesRead` string, int64
          - `recordsRead` string, int64
        - `resultSize` string, int64
      - `numCompleteTasks` integer
      - `taskQuantileMetrics` TaskQuantileMetrics
        - `gettingResultTimeMillis` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
          - `percentile25` string, int64
          - `minimum` string, int64
          - `percentile50` string, int64
          - `percentile75` string, int64
          - `maximum` string, int64
          - `sum` string, int64
          - `count` string, int64
        - `outputMetrics` OutputQuantileMetrics
          - `bytesWritten` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
            - `percentile25` string, int64
            - `minimum` string, int64
            - `percentile50` string, int64
            - `percentile75` string, int64
            - `maximum` string, int64
            - `sum` string, int64
            - `count` string, int64
          - `recordsWritten` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
            - `percentile25` string, int64
            - `minimum` string, int64
            - `percentile50` string, int64
            - `percentile75` string, int64
            - `maximum` string, int64
            - `sum` string, int64
            - `count` string, int64
        - `schedulerDelayMillis` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
          - `percentile25` string, int64
          - `minimum` string, int64
          - `percentile50` string, int64
          - `percentile75` string, int64
          - `maximum` string, int64
          - `sum` string, int64
          - `count` string, int64
        - `executorRunTimeMillis` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
          - `percentile25` string, int64
          - `minimum` string, int64
          - `percentile50` string, int64
          - `percentile75` string, int64
          - `maximum` string, int64
          - `sum` string, int64
          - `count` string, int64
        - `shuffleWriteMetrics` ShuffleWriteQuantileMetrics
          - `writeRecords` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
            - `percentile25` string, int64
            - `minimum` string, int64
            - `percentile50` string, int64
            - `percentile75` string, int64
            - `maximum` string, int64
            - `sum` string, int64
            - `count` string, int64
          - `writeBytes` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
            - `percentile25` string, int64
            - `minimum` string, int64
            - `percentile50` string, int64
            - `percentile75` string, int64
            - `maximum` string, int64
            - `sum` string, int64
            - `count` string, int64
          - `writeTimeNanos` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
            - `percentile25` string, int64
            - `minimum` string, int64
            - `percentile50` string, int64
            - `percentile75` string, int64
            - `maximum` string, int64
            - `sum` string, int64
            - `count` string, int64
        - `resultSerializationTimeMillis` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
          - `percentile25` string, int64
          - `minimum` string, int64
          - `percentile50` string, int64
          - `percentile75` string, int64
          - `maximum` string, int64
          - `sum` string, int64
          - `count` string, int64
        - `executorDeserializeTimeMillis` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
          - `percentile25` string, int64
          - `minimum` string, int64
          - `percentile50` string, int64
          - `percentile75` string, int64
          - `maximum` string, int64
          - `sum` string, int64
          - `count` string, int64
        - `peakExecutionMemoryBytes` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
          - `percentile25` string, int64
          - `minimum` string, int64
          - `percentile50` string, int64
          - `percentile75` string, int64
          - `maximum` string, int64
          - `sum` string, int64
          - `count` string, int64
        - `executorDeserializeCpuTimeNanos` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
          - `percentile25` string, int64
          - `minimum` string, int64
          - `percentile50` string, int64
          - `percentile75` string, int64
          - `maximum` string, int64
          - `sum` string, int64
          - `count` string, int64
        - `jvmGcTimeMillis` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
          - `percentile25` string, int64
          - `minimum` string, int64
          - `percentile50` string, int64
          - `percentile75` string, int64
          - `maximum` string, int64
          - `sum` string, int64
          - `count` string, int64
        - `durationMillis` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
          - `percentile25` string, int64
          - `minimum` string, int64
          - `percentile50` string, int64
          - `percentile75` string, int64
          - `maximum` string, int64
          - `sum` string, int64
          - `count` string, int64
        - `resultSize` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
          - `percentile25` string, int64
          - `minimum` string, int64
          - `percentile50` string, int64
          - `percentile75` string, int64
          - `maximum` string, int64
          - `sum` string, int64
          - `count` string, int64
        - `inputMetrics` InputQuantileMetrics
          - `bytesRead` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
            - `percentile25` string, int64
            - `minimum` string, int64
            - `percentile50` string, int64
            - `percentile75` string, int64
            - `maximum` string, int64
            - `sum` string, int64
            - `count` string, int64
          - `recordsRead` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
            - `percentile25` string, int64
            - `minimum` string, int64
            - `percentile50` string, int64
            - `percentile75` string, int64
            - `maximum` string, int64
            - `sum` string, int64
            - `count` string, int64
        - `diskBytesSpilled` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
          - `percentile25` string, int64
          - `minimum` string, int64
          - `percentile50` string, int64
          - `percentile75` string, int64
          - `maximum` string, int64
          - `sum` string, int64
          - `count` string, int64
        - `memoryBytesSpilled` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
          - `percentile25` string, int64
          - `minimum` string, int64
          - `percentile50` string, int64
          - `percentile75` string, int64
          - `maximum` string, int64
          - `sum` string, int64
          - `count` string, int64
        - `shuffleReadMetrics` ShuffleReadQuantileMetrics
          - `shufflePushReadMetrics` ShufflePushReadQuantileMetrics
            - `remoteMergedBytesRead` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
              - …
            - `localMergedBlocksFetched` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
              - …
            - `localMergedChunksFetched` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
              - …
            - `mergedFetchFallbackCount` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
              - …
            - `remoteMergedReqsDuration` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
              - …
            - `remoteMergedBlocksFetched` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
              - …
            - `remoteMergedChunksFetched` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
              - …
            - `corruptMergedBlockChunks` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
              - …
            - `localMergedBytesRead` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
              - …
          - `remoteReqsDuration` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
            - `percentile25` string, int64
            - `minimum` string, int64
            - `percentile50` string, int64
            - `percentile75` string, int64
            - `maximum` string, int64
            - `sum` string, int64
            - `count` string, int64
          - `readBytes` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
            - `percentile25` string, int64
            - `minimum` string, int64
            - `percentile50` string, int64
            - `percentile75` string, int64
            - `maximum` string, int64
            - `sum` string, int64
            - `count` string, int64
          - `remoteBytesReadToDisk` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
            - `percentile25` string, int64
            - `minimum` string, int64
            - `percentile50` string, int64
            - `percentile75` string, int64
            - `maximum` string, int64
            - `sum` string, int64
            - `count` string, int64
          - `remoteBytesRead` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
            - `percentile25` string, int64
            - `minimum` string, int64
            - `percentile50` string, int64
            - `percentile75` string, int64
            - `maximum` string, int64
            - `sum` string, int64
            - `count` string, int64
          - `readRecords` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
            - `percentile25` string, int64
            - `minimum` string, int64
            - `percentile50` string, int64
            - `percentile75` string, int64
            - `maximum` string, int64
            - `sum` string, int64
            - `count` string, int64
          - `remoteBlocksFetched` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
            - `percentile25` string, int64
            - `minimum` string, int64
            - `percentile50` string, int64
            - `percentile75` string, int64
            - `maximum` string, int64
            - `sum` string, int64
            - `count` string, int64
          - `fetchWaitTimeMillis` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
            - `percentile25` string, int64
            - `minimum` string, int64
            - `percentile50` string, int64
            - `percentile75` string, int64
            - `maximum` string, int64
            - `sum` string, int64
            - `count` string, int64
          - `totalBlocksFetched` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
            - `percentile25` string, int64
            - `minimum` string, int64
            - `percentile50` string, int64
            - `percentile75` string, int64
            - `maximum` string, int64
            - `sum` string, int64
            - `count` string, int64
          - `localBlocksFetched` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
            - `percentile25` string, int64
            - `minimum` string, int64
            - `percentile50` string, int64
            - `percentile75` string, int64
            - `maximum` string, int64
            - `sum` string, int64
            - `count` string, int64
        - `executorCpuTimeNanos` Quantiles — Quantile metrics data related to Tasks. Units can be seconds, bytes, milliseconds, etc depending on the message type.
          - `percentile25` string, int64
          - `minimum` string, int64
          - `percentile50` string, int64
          - `percentile75` string, int64
          - `maximum` string, int64
          - `sum` string, int64
          - `count` string, int64
      - `executorSummary` object
      - `parentStageIds` string[]
      - `numTasks` integer
    - `jobData` JobData — Data corresponding to a spark job.
      - `name` string
      - `numCompletedIndices` integer
      - `numCompletedTasks` integer
      - `numSkippedStages` integer
      - `completionTime` string, google-datetime
      - `numActiveStages` integer
      - `description` string
      - `numKilledTasks` integer
      - `numFailedStages` integer
      - `status` 'JOB_EXECUTION_STATUS_UNSPECIFIED' | 'JOB_EXECUTION_STATUS_RUNNING' | 'JOB_EXECUTION_STATUS_SUCCEEDED' | 'JOB_EXECUTION_STATUS_FAILED' | 'JOB_EXECUTION_STATUS_UNKNOWN'
      - `skippedStages` integer[]
      - `submissionTime` string, google-datetime
      - `numSkippedTasks` integer
      - `numActiveTasks` integer
      - `numTasks` integer
      - `numCompletedStages` integer
      - `sqlExecutionId` string, int64
      - `jobGroup` string
      - `stageIds` string[]
      - `jobId` string, int64
      - `numFailedTasks` integer
      - `killTasksSummary` object
    - `nativeBuildInfoUiData` NativeBuildInfoUiData
      - `buildClass` string — Optional. Build class of Native.
      - `buildInfo` BuildInfo[] — Optional. Build related details.
        - `buildValue` string — Optional. Build value.
        - `buildKey` string — Optional. Build key.
    - `sparkConnectSessionInfo` SparkConnectSessionInfo — Represents session-level information for Spark Connect
      - `startTimestamp` string, int64 — Timestamp when the session started.
      - `sessionId` string — Required. Session ID of the session.
      - `finishTimestamp` string, int64 — Timestamp when the session finished.
      - `totalExecution` string, int64 — Optional. Total number of executions in the session.
      - `userId` string — User ID of the user who started the session.
    - `streamingQueryProgress` StreamingQueryProgress
      - `streamingQueryProgressId` string
      - `batchDuration` string, int64
      - `sink` SinkProgress
        - `description` string
        - `numOutputRows` string, int64
        - `metrics` object
      - `durationMillis` object
      - `sources` SourceProgress[]
        - `latestOffset` string
        - `metrics` object
        - `endOffset` string
        - `processedRowsPerSecond` number, double
        - `startOffset` string
        - `numInputRows` string, int64
        - `description` string
        - `inputRowsPerSecond` number, double
      - `stateOperators` StateOperatorProgress[]
        - `customMetrics` object
        - `numRowsTotal` string, int64
        - `memoryUsedBytes` string, int64
        - `operatorName` string
        - `numRowsDroppedByWatermark` string, int64
        - `numShufflePartitions` string, int64
        - `allUpdatesTimeMs` string, int64
        - `numRowsUpdated` string, int64
        - `numRowsRemoved` string, int64
        - `allRemovalsTimeMs` string, int64
        - `commitTimeMs` string, int64
        - `numStateStoreInstances` string, int64
      - `batchId` string, int64
      - `observedMetrics` object
      - `name` string
      - `timestamp` string
      - `runId` string
      - `eventTime` object
    - `streamingQueryData` StreamingQueryData — Streaming
      - `isActive` boolean
      - `exception` string
      - `startTimestamp` string, int64
      - `endTimestamp` string, int64
      - `name` string
      - `runId` string
      - `streamingQueryId` string

## Response `200`

Successful response

---

[API](https://skmtc.net/google/apis/dataproc.md) · [All operations](https://skmtc.net/google/apis/dataproc/llms.txt) · [OpenAPI document](https://skmtc-service-staging.skmtc.workers.dev/v1/apis/google/dataproc/versions/15847ccbcf7d/schema)