OptionalcreateOptionaljobDatabricks Jobs API job ID. Unset for a pure ingestion pipeline.
OptionallastWhen the most recent run completed. Pairs with run_state = SUCCEEDED.
OptionallastMost recent error message, if any. Pairs with run_state = FAILED.
OptionallastWhen the most recent run started. Pairs with run_state = RUNNING.
OptionallastOptionallifecycleScheduling lifecycle of the resource's underlying job/pipeline: whether it
is unscheduled, scheduled, stopped, or deleted. Distinct from run_state,
which reports the outcome of the most recent run.
OptionalpipelineDLT ingestion-pipeline ID. Set only when this status represents the datasource's ingestion pipeline (unset for job statuses).
Optionalrun
Read-only runtime status of one job or pipeline backing a resource.
Shared across resources: a Rule's single job, a Datasource's main / health / historical-ingestion jobs, and a Datasource's ingestion pipeline (the
pipeline_idfield is set only for the pipeline). For a datasource's historical ingestion, the shard count is simply the number ofhistorical_job_statusesentries — there is no separate count field.Two orthogonal axes are modeled separately (v1 conflated them into a single
jobStatusenum):lifecycle(is it configured / does it still exist) andrun_state(what the most recent or in-flight run did).Every field that holds a
ResourceStatusis OUTPUT_ONLY at its use site (Datasource ingest/health/historical/pipeline statuses, Rule status), so the inner fields don't repeat the annotation.