v36

latestOpenAPI 3.1.0raw.githubusercontent.com2026-08-0187270483.0 KB

Function Accuracy

Compare Metrics Between Function Versions

Compare metrics between two function versions.

Computes aggregate and field-level lift/regression between any two versions of a function: accuracy, precision, recall, F1, and PR-AUC. Field-level changes are returned only for fields whose lift exceeds 1% in either direction.

Supported for every function type that produces labeled transformations: extract, transform, analyze, join. Pass isRegression: true to compare only the regression dataset (rows produced by POST /v3/functions/regression) — the canonical way to judge a candidate version before promoting it.

Defaults: baselineVersionNum = currentVersionNum - 1, comparisonVersionNum = currentVersionNum.

post/v3/functions/compare

Request body

functionNamestring required

Name of the function to compare versions for

baselineVersionNuminteger

Baseline version number for comparison

If not provided, defaults to the previous version (current - 1).

comparisonVersionNuminteger

Comparison version number

If not provided, defaults to the current version.

isRegressionboolean

Whether to compare regression test data only

If true, only compares transformations marked as regression tests.

Response

The request has succeeded.

functionNamestring required

Name of the compared function

baselineVersionNuminteger required

Baseline version number used for comparison

comparisonVersionNuminteger required

Comparison version number

baselineTransformationCountinteger

Number of transformations used to calculate baseline metrics

comparisonTransformationCountinteger

Number of transformations used to calculate comparison metrics

messagestring

Optional message with additional details