latestSwagger 2.02026-08-2053114259.7 KB

41da8739a690

Dataset Management

Edit a dataset

Updates a dataset to use the specified configuration.

put/api/Dataset

Query parameters

shouldRescanboolean

When true, triggers a rescan of dataset files after the update

Request body

idstring

The dataset to edit

namestring

The new name of the dataset

generatorSetupobject nullable

A dictionary mapping entity type names to their transformation type (e.g. Redaction, Synthesis, Off).

generatorMetadataobject nullable

A dictionary mapping entity type names to their transformation metadata configuration.

labelBlockListsobject nullable

The new excluded entity value list. Legacy strings inputs are accepted for backward compatibility and normalized into regexes.

labelAllowListsobject nullable

The new added entity value list. Legacy strings inputs are accepted for backward compatibility and normalized into regexes.

docXImagePolicy'Redact' | 'Ignore' | 'Remove'
<p>Possible values:</p> <ul> <li><b>Redact</b>: Run images through OCR and redact sensitive text</li> <li><b>Ignore</b>: Leave images alone</li> <li><b>Remove</b>: Cover image with opaque black box</li> </ul>
rtfImagePolicy'Ignore' | 'Remove'
<p>Possible values:</p> <ul> <li><b>Ignore</b>: Leave images alone</li> <li><b>Remove</b>: Replace each image with an opaque black box of the same size</li> </ul>
pdfSignaturePolicy'Redact' | 'Ignore'
<p>Possible values:</p> <ul> <li><b>Redact</b>: Cover signature with opaque black box</li> <li><b>Ignore</b>: Do not attempt to detect signature</li> </ul>
pdfSynthModePolicy'V1' | 'V2' | 'V5'
<p>Possible values:</p> <ul> <li><b>V1</b>: Original mode with incorrect font, size and style</li> <li><b>V2</b>: Legacy style-aware mode. Persisted V2 values now use the V5 font detector.</li> <li><b>V5</b>: Style-aware mode backed by the V5 OpenVINO font model</li> </ul>
docXCommentPolicy'Remove' | 'Ignore'
<p>Possible values:</p> <ul> <li><b>Remove</b>: Remove all comments for file</li> <li><b>Ignore</b>: Leave comments alone</li> </ul>
docXTablePolicy'Redact' | 'Remove'
<p>Possible values:</p> <ul> <li><b>Redact</b>: Treat table content normally, feed into redaction process.</li> <li><b>Remove</b>: Replace all characters and symbols in table with a placeholder.</li> </ul>
llmClassificationPolicy'Disabled' | 'Enabled' | 'PdfIdentificationAndSynthesis'
<p>Possible values:</p> <ul> <li><b>Disabled</b>: Do not use LLM for structured data classification</li> <li><b>Enabled</b>: Use LLM to classify structured data for PII detection</li> <li><b>PdfIdentificationAndSynthesis</b>: Use an LLM instead of the NER model and C# generators for PDF PII identification and synthesis. Other file types continue to use their existing detection and synthesis paths.</li> </ul>
llmTableClassificationPolicy'Disabled' | 'Enabled' | 'PdfIdentificationAndSynthesis'
<p>Possible values:</p> <ul> <li><b>Disabled</b>: Do not use LLM for structured data classification</li> <li><b>Enabled</b>: Use LLM to classify structured data for PII detection</li> <li><b>PdfIdentificationAndSynthesis</b>: Use an LLM instead of the NER model and C# generators for PDF PII identification and synthesis. Other file types continue to use their existing detection and synthesis paths.</li> </ul>
outputPathstring nullable

The Location to store dataset files. Not applicable to local datasets

ocrServiceProvider'Azure' | 'PyTesseract' | 'Textract' | 'None'

The OCR engine used for text extraction from images, scanned documents, and PDFs

Example request

{
  "generatorSetup": {
    "NAME_GIVEN": "Redaction",
    "NAME_FAMILY": "Redaction"
  },
  "labelBlockLists": {
    "NAME_FAMILY": {
      "regexes": [
        ".*\\s(disease|syndrome|disorder)"
      ]
    }
  },
  "labelAllowLists": {
    "HEALTHCARE_ID": {
      "regexes": [
        "[a-z]{2}\\d{9}"
      ]
    }
  }
}

Response

Returns the updated dataset

idstring
namestring
generatorMetadataobject nullable

A dictionary mapping entity type names to their transformation metadata configuration.

outputFormat'Original' | 'Markdown'

The output format for redacted files: Original preserves the source format, Markdown produces a markdown version.

generatorSetupobject nullable

A dictionary mapping entity type names to their transformation type (e.g. Redaction, Synthesis, Off).

labelBlockListsobject nullable
labelAllowListsobject nullable
tagsstring[]
lastUpdatedInstant

A point in time represented as an ISO 8601 timestamp string.

createdInstant

A point in time represented as an ISO 8601 timestamp string.

docXImagePolicy'Redact' | 'Ignore' | 'Remove'
<p>Possible values:</p> <ul> <li><b>Redact</b>: Run images through OCR and redact sensitive text</li> <li><b>Ignore</b>: Leave images alone</li> <li><b>Remove</b>: Cover image with opaque black box</li> </ul>
rtfImagePolicy'Ignore' | 'Remove'
<p>Possible values:</p> <ul> <li><b>Ignore</b>: Leave images alone</li> <li><b>Remove</b>: Replace each image with an opaque black box of the same size</li> </ul>
pdfSignaturePolicy'Redact' | 'Ignore'
<p>Possible values:</p> <ul> <li><b>Redact</b>: Cover signature with opaque black box</li> <li><b>Ignore</b>: Do not attempt to detect signature</li> </ul>
pdfSynthModePolicy'V1' | 'V2' | 'V5'
<p>Possible values:</p> <ul> <li><b>V1</b>: Original mode with incorrect font, size and style</li> <li><b>V2</b>: Legacy style-aware mode. Persisted V2 values now use the V5 font detector.</li> <li><b>V5</b>: Style-aware mode backed by the V5 OpenVINO font model</li> </ul>
docXCommentPolicy'Remove' | 'Ignore'
<p>Possible values:</p> <ul> <li><b>Remove</b>: Remove all comments for file</li> <li><b>Ignore</b>: Leave comments alone</li> </ul>
docXTablePolicy'Redact' | 'Remove'
<p>Possible values:</p> <ul> <li><b>Redact</b>: Treat table content normally, feed into redaction process.</li> <li><b>Remove</b>: Replace all characters and symbols in table with a placeholder.</li> </ul>
llmClassificationPolicy'Disabled' | 'Enabled' | 'PdfIdentificationAndSynthesis'
<p>Possible values:</p> <ul> <li><b>Disabled</b>: Do not use LLM for structured data classification</li> <li><b>Enabled</b>: Use LLM to classify structured data for PII detection</li> <li><b>PdfIdentificationAndSynthesis</b>: Use an LLM instead of the NER model and C# generators for PDF PII identification and synthesis. Other file types continue to use their existing detection and synthesis paths.</li> </ul>
llmTableClassificationPolicy'Disabled' | 'Enabled' | 'PdfIdentificationAndSynthesis'
<p>Possible values:</p> <ul> <li><b>Disabled</b>: Do not use LLM for structured data classification</li> <li><b>Enabled</b>: Use LLM to classify structured data for PII detection</li> <li><b>PdfIdentificationAndSynthesis</b>: Use an LLM instead of the NER model and C# generators for PDF PII identification and synthesis. Other file types continue to use their existing detection and synthesis paths.</li> </ul>
fileSource'Local' | 'Sharepoint' | 'Aws' | 'Sdk' | 'Azure' | 'OneLake'

The original upload location of source files (Local, S3, Azure, SharePoint, OneLake, or SDK).

customPiiEntityIdsstring[] nullable
operationsDatasetOperation[] nullable
awsCredentialSourcestring nullable
outputPathstring nullable
ocrServiceProvider'Azure' | 'PyTesseract' | 'Textract' | 'None'

The OCR engine used for text extraction from images, scanned documents, and PDFs

fileCountinteger