OptionallibrariesOptionalspecIf existing_cluster_id, the ID of an existing cluster that is used for all runs. When running jobs or tasks on an existing cluster, you may need to manually restart the cluster if it stops responding. We suggest running jobs and tasks on new clusters for greater reliability
If new_cluster, a description of a new cluster that is created for each run.
If job_cluster_key, this task is executed reusing the cluster specified in job.settings.job_clusters.
An optional list of libraries to be installed on the cluster. The default value is an empty list.