OptionaldbtOptionaljarA list of parameters for jobs with Spark JAR tasks, for example "jar_params": ["john doe", "35"].
The parameters are used to invoke the main function of the main class specified in the Spark JAR task.
If not specified upon run-now, it defaults to an empty list.
jar_params cannot be specified in conjunction with notebook_params.
The JSON representation of this field (for example {"jar_params":["john doe","35"]}) cannot exceed 10,000 bytes.
⚠ Deprecation note Use job parameters to pass information down to tasks.
OptionaljobJob-level parameters used in the run. for example "param": "overriding_val"
OptionallatestThe ID of the latest repair. This parameter is not required when repairing a run for the first time, but must be provided on subsequent requests to repair the same run.
OptionalnotebookA map from keys to values for jobs with notebook task, for example "notebook_params": {"name": "john doe", "age": "35"}.
The map is passed to the notebook and is accessible through the dbutils.widgets.get function.
If not specified upon run-now, the triggered run uses the job’s base parameters.
notebook_params cannot be specified in conjunction with jar_params.
⚠ Deprecation note Use job parameters to pass information down to tasks.
The JSON representation of this field (for example {"notebook_params":{"name":"john doe","age":"35"}}) cannot exceed 10,000 bytes.
OptionalperformanceThe performance mode on a serverless job. The performance target determines the level of compute performance or cost-efficiency for the run. This field overrides the performance target defined on the job level.
STANDARD: Enables cost-efficient execution of serverless workloads.PERFORMANCE_OPTIMIZED: Prioritizes fast startup and execution times through rapid scaling and optimized cluster performance.OptionalpipelineControls whether the pipeline should perform a full refresh
OptionalpythonOptionalpythonA list of parameters for jobs with Python tasks, for example "python_params": ["john doe", "35"].
The parameters are passed to Python file as command-line parameters. If specified upon run-now, it would overwrite
the parameters specified in job setting. The JSON representation of this field (for example {"python_params":["john doe","35"]})
cannot exceed 10,000 bytes.
⚠ Deprecation note Use job parameters to pass information down to tasks.
Important
These parameters accept only Latin characters (ASCII character set). Using non-ASCII characters returns an error. Examples of invalid, non-ASCII characters are Chinese, Japanese kanjis, and emojis.
OptionalrerunIf true, repair all failed tasks. Only one of rerun_tasks or rerun_all_failed_tasks can be used.
OptionalrerunIf true, repair all tasks that depend on the tasks in rerun_tasks, even if they were previously successful. Can be also used in combination with rerun_all_failed_tasks.
OptionalrerunThe task keys of the task runs to repair.
OptionalrunThe job run ID of the run to repair. The run must not be in progress.
OptionalsparkA list of parameters for jobs with spark submit task, for example "spark_submit_params": ["--class", "org.apache.spark.examples.SparkPi"].
The parameters are passed to spark-submit script as command-line parameters. If specified upon run-now, it would overwrite the
parameters specified in job setting. The JSON representation of this field (for example {"python_params":["john doe","35"]})
cannot exceed 10,000 bytes.
⚠ Deprecation note Use job parameters to pass information down to tasks.
Important
These parameters accept only Latin characters (ASCII character set). Using non-ASCII characters returns an error. Examples of invalid, non-ASCII characters are Chinese, Japanese kanjis, and emojis.
OptionalsqlA map from keys to values for jobs with SQL task, for example "sql_params": {"name": "john doe", "age": "35"}. The SQL alert task does not support custom parameters.
⚠ Deprecation note Use job parameters to pass information down to tasks.
An array of commands to execute for jobs with the dbt task, for example
"dbt_commands": ["dbt deps", "dbt seed", "dbt deps", "dbt seed", "dbt run"]⚠ Deprecation note Use job parameters to pass information down to tasks.