OptionalcomputeOptionaldependsAn optional array of objects specifying the dependency graph of the task. All tasks specified in this field must complete successfully before executing this task.
The key is task_key, and the value is the name assigned to the dependent task.
OptionaldescriptionAn optional description for this task.
OptionaldisableAn option to disable auto optimization in serverless
OptionaldisabledAn optional flag to disable the task. If set to true, the task will not run even if it is part of a job.
OptionalemailAn optional set of email addresses notified when the task run begins or completes. The default behavior is to not send any emails.
OptionalenvironmentThe key that references an environment spec in a job. This field is required for Python script, Python wheel and dbt tasks when using serverless compute.
OptionalhealthOptionallibrariesAn optional list of libraries to be installed on the cluster. The default value is an empty list.
OptionalmaxAn optional maximum number of times to retry an unsuccessful run. A run is considered to be unsuccessful if it completes with the FAILED result_state or INTERNAL_ERROR life_cycle_state. The value -1 means to retry indefinitely and the value 0 means to never retry.
OptionalminAn optional minimal interval in milliseconds between the start of the failed run and the subsequent retry run. The default behavior is that unsuccessful runs are immediately retried.
OptionalnotificationOptional notification settings that are used when sending notifications to each of the email_notifications and webhook_notifications for this task run.
OptionalretryAn optional policy to specify whether to retry a job when it times out. The default behavior is to not retry on timeout.
OptionalrunAn optional value indicating the condition that determines whether the task should be run once its dependencies have been completed. When omitted, defaults to ALL_SUCCESS. See :method:jobs/create for a list of possible values.
OptionalspecIf existing_cluster_id, the ID of an existing cluster that is used for all runs. When running jobs or tasks on an existing cluster, you may need to manually restart the cluster if it stops responding. We suggest running jobs and tasks on new clusters for greater reliability
If new_cluster, a description of a new cluster that is created for each run.
If job_cluster_key, this task is executed reusing the cluster specified in job.settings.job_clusters.
OptionaltaskDO NOT ADD ANY NEW FIELDS TO JobTask OUTSIDE OF THIS ONEOF as it will break the TaskRegistry
The task runs a notebook when the notebook_task field is present.
The task runs a JAR when the spark_jar_task field is present.
The task runs a Python file when the spark_python_task field is present.
(Legacy) The task runs the spark-submit script when the spark_submit_task field is present. Databricks recommends using the spark_jar_task instead; see Spark Submit task for jobs.
The task triggers a pipeline update when the pipeline_task field is present. Only pipelines configured to use triggered more are supported.
The task runs a Python wheel when the python_wheel_task field is present.
The task runs one or more dbt commands when the dbt_task field is present. The dbt task requires both Databricks SQL and the ability to use a serverless or a pro SQL warehouse.
The task runs a SQL query or file, or it refreshes a SQL alert or a legacy SQL dashboard when the sql_task field is present.
The task triggers another job when the run_job_task field is present.
The task evaluates a condition that can be used to control the execution of other tasks when the condition_task field is present.
The condition task does not require a cluster to execute and does not support retries or notifications.
The task executes a nested task for every input provided when the for_each_task field is present.
The task runs a clean rooms notebook
when the clean_rooms_notebook_task field is present.
The task evaluates a alert_task field is present.
The task triggers a Power BI semantic model update when the power_bi_task field is present.
The task refreshes a dashboard and sends a snapshot to subscribers.
Task type for dbt cloud, deprecated in favor of the new name dbt_platform_task
The task runs a Python operator task.
OptionaltaskA unique name for the task. This field is used to refer to this task from other tasks. This field is required and must be unique within its parent job. On Update or Reset, this field is used to reference the tasks to be updated or reset.
OptionaltimeoutAn optional timeout applied to each run of this job task. A value of 0 means no timeout.
OptionalwebhookA collection of system notification IDs to notify when the run begins or completes. The default behavior is to not send any system notifications. Task webhooks respect the task notification settings.
Task level compute configuration.