OptionalerrorOptionalexecutionThe number duration of the script execution in seconds
OptionalstatusThe current status of the script
OptionalstderrThe stderr output from the init script execution. Only populated when init scripts debug is enabled and script execution fails.
Optionalstoragedestination needs to be provided. e.g.
{ "dbfs": { "destination" : "dbfs:/home/cluster_log" } }
destination and either the region or endpoint need to be provided. e.g.
{ \"s3\": { \"destination\": \"s3://cluster_log_bucket/prefix\", \"region\": \"us-west-2\" } }
Cluster iam role is used to access s3, please make sure the cluster iam role in
instance_profile_arn has permission to write data to the s3 destination.
destination needs to be provided, e.g.
{ "file": { "destination": "file:/my/local/file.sh" } }
destination needs to be provided, e.g.
{ "gcs": { "destination": "gs://my-bucket/file.sh" } }
destination needs to be provided, e.g.
abfss://<container-name>@<storage-account-name>.dfs.core.windows.net/<directory-name>
destination needs to be provided, e.g.
{ "workspace": { "destination": "/cluster-init-scripts/setup-datadog.sh" } }
destination needs to be provided. e.g.
{ \"volumes\" : { \"destination\" : \"/Volumes/my-init.sh\" } }
Additional details regarding errors (such as a file not found message if the status is FAILED_FETCH). This field should only be used to provide additional information to the status field, not duplicate it.