latestSwagger 2.02026-08-2053114259.7 KB

41da8739a690

Dataset Management

Import dataset settings

Imports the dataset settings from one dataset into this one. The settings on this dataset will be overridden

post/api/Dataset/{datasetId}/import

Path parameters

datasetIdstring required

Request body

fromDatasetIdstring required
importProjectSettingsboolean
importEntitySettingsboolean

Response

Returns the updated dataset

idstring
namestring
generatorMetadataobject nullable

A dictionary mapping entity type names to their transformation metadata configuration.

outputFormat'Original' | 'Markdown'

The output format for redacted files: Original preserves the source format, Markdown produces a markdown version.

generatorSetupobject nullable

A dictionary mapping entity type names to their transformation type (e.g. Redaction, Synthesis, Off).

labelBlockListsobject nullable
labelAllowListsobject nullable
tagsstring[]
lastUpdatedInstant

A point in time represented as an ISO 8601 timestamp string.

createdInstant

A point in time represented as an ISO 8601 timestamp string.

docXImagePolicy'Redact' | 'Ignore' | 'Remove'
<p>Possible values:</p> <ul> <li><b>Redact</b>: Run images through OCR and redact sensitive text</li> <li><b>Ignore</b>: Leave images alone</li> <li><b>Remove</b>: Cover image with opaque black box</li> </ul>
rtfImagePolicy'Ignore' | 'Remove'
<p>Possible values:</p> <ul> <li><b>Ignore</b>: Leave images alone</li> <li><b>Remove</b>: Replace each image with an opaque black box of the same size</li> </ul>
pdfSignaturePolicy'Redact' | 'Ignore'
<p>Possible values:</p> <ul> <li><b>Redact</b>: Cover signature with opaque black box</li> <li><b>Ignore</b>: Do not attempt to detect signature</li> </ul>
pdfSynthModePolicy'V1' | 'V2' | 'V5'
<p>Possible values:</p> <ul> <li><b>V1</b>: Original mode with incorrect font, size and style</li> <li><b>V2</b>: Legacy style-aware mode. Persisted V2 values now use the V5 font detector.</li> <li><b>V5</b>: Style-aware mode backed by the V5 OpenVINO font model</li> </ul>
docXCommentPolicy'Remove' | 'Ignore'
<p>Possible values:</p> <ul> <li><b>Remove</b>: Remove all comments for file</li> <li><b>Ignore</b>: Leave comments alone</li> </ul>
docXTablePolicy'Redact' | 'Remove'
<p>Possible values:</p> <ul> <li><b>Redact</b>: Treat table content normally, feed into redaction process.</li> <li><b>Remove</b>: Replace all characters and symbols in table with a placeholder.</li> </ul>
llmClassificationPolicy'Disabled' | 'Enabled' | 'PdfIdentificationAndSynthesis'
<p>Possible values:</p> <ul> <li><b>Disabled</b>: Do not use LLM for structured data classification</li> <li><b>Enabled</b>: Use LLM to classify structured data for PII detection</li> <li><b>PdfIdentificationAndSynthesis</b>: Use an LLM instead of the NER model and C# generators for PDF PII identification and synthesis. Other file types continue to use their existing detection and synthesis paths.</li> </ul>
llmTableClassificationPolicy'Disabled' | 'Enabled' | 'PdfIdentificationAndSynthesis'
<p>Possible values:</p> <ul> <li><b>Disabled</b>: Do not use LLM for structured data classification</li> <li><b>Enabled</b>: Use LLM to classify structured data for PII detection</li> <li><b>PdfIdentificationAndSynthesis</b>: Use an LLM instead of the NER model and C# generators for PDF PII identification and synthesis. Other file types continue to use their existing detection and synthesis paths.</li> </ul>
fileSource'Local' | 'Sharepoint' | 'Aws' | 'Sdk' | 'Azure' | 'OneLake'

The original upload location of source files (Local, S3, Azure, SharePoint, OneLake, or SDK).

customPiiEntityIdsstring[] nullable
operationsDatasetOperation[] nullable
awsCredentialSourcestring nullable
outputPathstring nullable
ocrServiceProvider'Azure' | 'PyTesseract' | 'Textract' | 'None'

The OCR engine used for text extraction from images, scanned documents, and PDFs

fileCountinteger