For the complete documentation index, see llms.txt. This page is also available as Markdown.

DQ Job API

The DQ Job API allows you to manage and monitor DQ Jobs.

Run a DQ Job

post

Runs a DQ Job using pre-configured dataset definitions for a given dataset.

Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Query parameters
datasetstringRequired

Value for dataset is Case Sensitive

runDatestring · date-timeRequired

Run id

runDateEndstring · date-timeOptional

Run id end

agentNamestringOptional

Agent name. If not provided, system expects NO_AGENT be configured

Responses
200

Returns the identifier of the executed job

jobIdinteger · int64Optional
jobUuidstring · uuidOptional
agentIdinteger · int32Optional
agentUuidstring · uuidOptional
datasetstringOptional
runIdstring · date-timeOptional
statusstringOptional
activitystringOptional
activityStatusstringOptional
cmdLinestringOptional
descriptionstringOptional
jobExceptionstringOptional
usernamestringOptional
updtTsstring · date-timeOptional
pidstringOptional
remoteJobIdstringOptional
notifiedinteger · int32Optional
startTimestring · date-timeOptional
agentJobIdinteger · int64Optional
agentJobUuidstring · uuidOptional
post/v3/jobs/run

Run a DQ Job from the command line

post

Runs a DQ Job from the command line using pre-configured dataset definitions for a given dataset

Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Query parameters
agentNamestringOptional

Agent name

Body
cmdLinestringRequired
Responses
200

Returns the identifier of the executed job

jobIdinteger · int64Optional
jobUuidstring · uuidOptional
agentIdinteger · int32Optional
agentUuidstring · uuidOptional
datasetstringOptional
runIdstring · date-timeOptional
statusstringOptional
activitystringOptional
activityStatusstringOptional
cmdLinestringOptional
descriptionstringOptional
jobExceptionstringOptional
usernamestringOptional
updtTsstring · date-timeOptional
pidstringOptional
remoteJobIdstringOptional
notifiedinteger · int32Optional
startTimestring · date-timeOptional
agentJobIdinteger · int64Optional
agentJobUuidstring · uuidOptional
post/v3/jobs/runCmdLine

Return a list of DQ Jobs

get

Returns a list of DQ Jobs.

Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Query parameters
limitinteger · int32Optional

The maximum number of jobs to return

startTimeBeginningstring · date-timeOptional

Lower bound of the start time of the job (inclusive)

startTimeEndstring · date-timeOptional

Upper bound of the start time of the job (inclusive)

updateTimeBeginningstring · date-timeOptional

Lower bound of the update time of the job (inclusive)

updateTimeEndstring · date-timeOptional

Upper bound of the update time of the job (inclusive)

Responses
200

Returns a list of jobs

jobIdinteger · int64Optional
jobUuidstring · uuidOptional
agentIdinteger · int32Optional
agentUuidstring · uuidOptional
datasetstringOptional
runIdstring · date-timeOptional
statusstringOptional
activitystringOptional
activityStatusstringOptional
cmdLinestringOptional
descriptionstringOptional
jobExceptionstringOptional
usernamestringOptional
updtTsstring · date-timeOptional
pidstringOptional
remoteJobIdstringOptional
notifiedinteger · int32Optional
startTimestring · date-timeOptional
agentJobIdinteger · int64Optional
agentJobUuidstring · uuidOptional
get/v3/jobs

Retrieve a DQ Job by its Job ID

get

Retrieves a DQ Job by its Job ID

Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Path parameters
jobIdinteger · int64Required

The identifier of the job to retrieve

Responses
200

Returns the job identified by jobId

jobIdinteger · int64Optional
jobUuidstring · uuidOptional
agentIdinteger · int32Optional
agentUuidstring · uuidOptional
datasetstringOptional
runIdstring · date-timeOptional
statusstringOptional
activitystringOptional
activityStatusstringOptional
cmdLinestringOptional
descriptionstringOptional
jobExceptionstringOptional
usernamestringOptional
updtTsstring · date-timeOptional
pidstringOptional
remoteJobIdstringOptional
notifiedinteger · int32Optional
startTimestring · date-timeOptional
agentJobIdinteger · int64Optional
agentJobUuidstring · uuidOptional
get/v3/jobs/{jobId}

Wait for a DQ Job to complete

get

Wait for a DQ Job with a given Job ID to complete.

Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Path parameters
jobIdinteger · int64Required

The identifier of the job to wait for completion

Responses
200

Returns the job identified by jobId

jobIdinteger · int64Optional
jobUuidstring · uuidOptional
agentIdinteger · int32Optional
agentUuidstring · uuidOptional
datasetstringOptional
runIdstring · date-timeOptional
statusstringOptional
activitystringOptional
activityStatusstringOptional
cmdLinestringOptional
descriptionstringOptional
jobExceptionstringOptional
usernamestringOptional
updtTsstring · date-timeOptional
pidstringOptional
remoteJobIdstringOptional
notifiedinteger · int32Optional
startTimestring · date-timeOptional
agentJobIdinteger · int64Optional
agentJobUuidstring · uuidOptional
get/v3/jobs/{jobId}/waitForCompletion

Return DQ Job logs for a given dataset

get

Returns all DQ Job logs for a given dataset and run date.

Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Path parameters
jobIdinteger · int64Required

The identifier of the job to retrieve the log

Responses
200

Returns all the logs of the job identified by jobId

logIdinteger · int64Optional
activitystringOptional
stagestringOptional
logDescstringOptional
logHintstringOptional
stagePerfTierstringOptional
stagePerfDescstringOptional
stageTimeinteger · int64Optional
prettyStageTimestringOptional
get/v3/jobs/{jobId}/logs

Return the findings of a DQ Job

get

Return the findings of a job with a given job ID, including outliers, rule breaks, and dupes.

Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Path parameters
jobIdinteger · int64Required

The identifier of the job to retrieve the findings

Responses
200

Returns job findings (outliers, rule breaks, dupes) by jobId

datasetstringOptional
runIdstringOptional
runDatestring · date-timeOptional
rowsinteger · int64Optional
passFailinteger · int32Optional
passFailLimitinteger · int32Optional
peakinteger · int32Optional
dayOfWeekstringOptional
timeZonestringOptional
avgRowsinteger · int32Optional
colsinteger · int32Optional
activeRulesinteger · int32Optional
activeAlertsinteger · int32Optional
runTimestringOptional
shapeScoreinteger · int32Optional
dupeScoreinteger · int32Optional
patternScoreinteger · int32Optional
outlierScoreinteger · int32Optional
schemaScoreinteger · int32Optional
recordScoreinteger · int32Optional
ruleScoreinteger · int32Optional
sourceScoreinteger · int32Optional
behaviorScoreinteger · int32Optional
get/v3/jobs/{jobId}/findings

Return a file of the shapes break records of a Pushdown DQ Job

get

Returns a JSON, CSV, or SQL file containing the shapes break records of a Pushdown DQ Job with a given Job ID.

Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Path parameters
jobIdstringRequired

The identifier of the job to retrieve the findings

Query parameters
limitinteger · int32Optional

The maximum number of records to return

formatstringOptional

The format of the file to return. Default is CSV

Example: {"description":"CSV","value":"CSV"}
Responses
200

Returns all shape break records for the jobId

application/octet-stream
string · binaryOptional
get/v3/jobs/{jobId}/breaks/shapes

Return a file of the rule break records of a Pushdown DQ Job

get

Returns a JSON, CSV, or SQL file containing the rule break records of a Pushdown DQ Job with a given Job ID.

Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Path parameters
jobIdstringRequired

The identifier of the job to retrieve the findings

Query parameters
limitinteger · int32Optional

The maximum number of records to return

formatstringOptional

The format of the file to return. Default is CSV

Example: {"description":"CSV","value":"CSV"}
Responses
200

Returns all rule break records for the jobId

application/octet-stream
string · binaryOptional
get/v3/jobs/{jobId}/breaks/rules

Return a file of the outlier break records of a Pushdown DQ Job

get

Returns a JSON, CSV, or SQL file containing the outlier break records of a Pushdown DQ Job with a given Job ID.

Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Path parameters
jobIdstringRequired

The identifier of the job to retrieve the findings

Query parameters
limitinteger · int32Optional

The maximum number of records to return

formatstringOptional

The format of the file to return. Default is CSV

Example: {"description":"CSV","value":"CSV"}
Responses
200

Returns all outlier break records for the jobId

application/octet-stream
string · binaryOptional
get/v3/jobs/{jobId}/breaks/outliers

Return a file of the dupes break records of a Pushdown DQ Job

get

Return a JSON, CSV, or SQL file containing the dupes break records of a Pushdown DQ Job with a given Job ID.

Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Path parameters
jobIdstringRequired

The identifier of the job to retrieve the findings

Query parameters
limitinteger · int32Optional

The maximum number of records to return

formatstringOptional

The format of the file to return. Default is CSV

Example: {"description":"CSV","value":"CSV"}
Responses
200

Returns all dupe break records for the jobId

application/octet-stream
string · binaryOptional
get/v3/jobs/{jobId}/breaks/dupes

Return all DQ Job logs for a given dataset and run date

get

Returns all DQ Job logs for a given dataset and run date. Pre-authorization requirements:

  • hasDatasetAccess(#dataset)

Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Path parameters
datasetstringRequired

Dataset name

runDatestring · date-timeRequired

Run id

Responses
200

Returns all the logs of the job identified by dataset and runDate pair

logIdinteger · int64Optional
activitystringOptional
stagestringOptional
logDescstringOptional
logHintstringOptional
stagePerfTierstringOptional
stagePerfDescstringOptional
stageTimeinteger · int64Optional
prettyStageTimestringOptional
get/v3/jobs/{dataset}/{runDate}/logs

Return the findings for a given dataset and run date

get

Returns the findings, including outliers, rule breaks, and dupes, for a given dataset and run date. Pre-authorization requirements:

  • hasDatasetAccess(#dataset)

Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Path parameters
datasetstringRequired

Dataset name

runDatestring · date-timeRequired

Run id

Responses
200

Returns job findings (outliers, rule breaks, dupes) by dataset and runDate

datasetstringOptional
runIdstringOptional
runDatestring · date-timeOptional
rowsinteger · int64Optional
passFailinteger · int32Optional
passFailLimitinteger · int32Optional
peakinteger · int32Optional
dayOfWeekstringOptional
timeZonestringOptional
avgRowsinteger · int32Optional
colsinteger · int32Optional
activeRulesinteger · int32Optional
activeAlertsinteger · int32Optional
runTimestringOptional
shapeScoreinteger · int32Optional
dupeScoreinteger · int32Optional
patternScoreinteger · int32Optional
outlierScoreinteger · int32Optional
schemaScoreinteger · int32Optional
recordScoreinteger · int32Optional
ruleScoreinteger · int32Optional
sourceScoreinteger · int32Optional
behaviorScoreinteger · int32Optional
get/v3/jobs/{dataset}/{runDate}/findings

Return a file of the shapes break records of a Pushdown job with a given dataset name and run date

get

Returns a JSON, CSV, or SQL file containing the shapes break records of a Pushdown DQ Job with a given dataset name and run date. Pre-authorization requirements:

  • hasDatasetAccess(#dataset)

Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Path parameters
datasetstringRequired

Dataset name

runDatestring · date-timeRequired

Run id

Query parameters
limitinteger · int32Optional

The maximum number of records to return

formatstringOptional

The format of the file to return. Default is CSV

Example: {"description":"CSV","value":"CSV"}
Responses
200

Returns all shape break records for the job corresponding to the dataset and runDate

application/octet-stream
string · binaryOptional
get/v3/jobs/{dataset}/{runDate}/breaks/shapes

Return a file of the rule break records of a Pushdown DQ Job with a given dataset name and run date

get

Returns a JSON, CSV, or SQL file containing the rule break records of a Pushdown DQ Job with a given dataset name and run date. Pre-authorization requirements:

  • hasDatasetAccess(#dataset)

Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Path parameters
datasetstringRequired

Dataset name

runDatestring · date-timeRequired

Run id

Query parameters
limitinteger · int32Optional

The maximum number of records to return

formatstringOptional

The format of the file to return. Default is CSV

Example: {"description":"CSV","value":"CSV"}
Responses
200

Returns all rule break records for the job corresponding to the dataset and runDate

application/octet-stream
string · binaryOptional
get/v3/jobs/{dataset}/{runDate}/breaks/rules

Return a file of the outliers break records of a Pushdown DQ Job with a given dataset name and run date

get

Returns a JSON, CSV, or SQL file containing the outliers break records of a Pushdown DQ Job with a given dataset name and run date. Pre-authorization requirements:

  • hasDatasetAccess(#dataset)

Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Path parameters
datasetstringRequired

Dataset name

runDatestring · date-timeRequired

Run id

Query parameters
limitinteger · int32Optional

The maximum number of records to return

formatstringOptional

The format of the file to return. Default is CSV

Example: {"description":"CSV","value":"CSV"}
Responses
200

Returns all outlier break records for the job corresponding to the dataset and runDate

application/octet-stream
string · binaryOptional
get/v3/jobs/{dataset}/{runDate}/breaks/outliers

Return a file of the dupes break records of a Pushdown DQ Job with a given dataset name and run date

get

Returns a JSON, CSV, or SQL file containing the dupes break records of a Pushdown DQ Job with a given dataset name and run date. Pre-authorization requirements:

  • hasDatasetAccess(#dataset)

Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Path parameters
datasetstringRequired

Dataset name

runDatestring · date-timeRequired

Run id

Query parameters
limitinteger · int32Optional

The maximum number of records to return

formatstringOptional

The format of the file to return. Default is CSV

Example: {"description":"CSV","value":"CSV"}
Responses
200

Returns all dupe break records for the job corresponding to the dataset and runDate

application/octet-stream
string · binaryOptional
get/v3/jobs/{dataset}/{runDate}/breaks/dupes

Last updated

Was this helpful?