Databricks SDK for JavaScript
    Preparing search index...

    Interface GcpAttributes

    Attributes set during cluster creation which are related to GCP.

    interface GcpAttributes {
        availability?: GcpAvailability;
        bootDiskSize?: number;
        confidentialComputeType?: ConfidentialComputeType;
        firstOnDemand?: number;
        googleServiceAccount?: string;
        localSsdCount?: number;
        usePreemptibleExecutors?: boolean;
        zoneId?: string;
    }
    Index

    Properties

    availability? bootDiskSize? confidentialComputeType? firstOnDemand? googleServiceAccount? localSsdCount? usePreemptibleExecutors? zoneId?

    Properties

    availability?: GcpAvailability

    This field determines whether the spark executors will be scheduled to run on preemptible VMs, on-demand VMs, or preemptible VMs with a fallback to on-demand VMs if the former is unavailable.

    bootDiskSize?: number

    Boot disk size in GB

    confidentialComputeType?: ConfidentialComputeType

    The confidential computing technology for this cluster's instances. Currently only SEV_SNP is supported, and only on N2D instance types. When not set, no confidential computing is applied.

    firstOnDemand?: number

    The first first_on_demand nodes of the cluster will be placed on on-demand instances. This value should be greater than 0, to make sure the cluster driver node is placed on an on-demand instance. If this value is greater than or equal to the current cluster size, all nodes will be placed on on-demand instances. If this value is less than the current cluster size, first_on_demand nodes will be placed on on-demand instances and the remainder will be placed on availability instances. Note that this value does not affect cluster size and cannot currently be mutated over the lifetime of a cluster.

    googleServiceAccount?: string

    If provided, the cluster will impersonate the google service account when accessing gcloud services (like GCS). The google service account must have previously been added to the environment by an account administrator.

    localSsdCount?: number

    If provided, each node (workers and driver) in the cluster will have this number of local SSDs attached. Each local SSD is 375GB in size. Refer to GCP documentation for the supported number of local SSDs for each instance type.

    usePreemptibleExecutors?: boolean

    This field determines whether the spark executors will be scheduled to run on preemptible VMs (when set to true) versus standard compute engine VMs (when set to false; default). Note: Soon to be deprecated, use the 'availability' field instead.

    zoneId?: string

    Identifier for the availability zone in which the cluster resides. This can be one of the following:

    • "HA" => High availability, spread nodes across availability zones for a deployment region [default].
    • "AUTO" => picks an availability zone to schedule the cluster on.
    • A GCP availability zone => Pick One of the available zones for (machine type + region) from https://cloud.google.com/compute/docs/regions-zones.

    Settings

    Member Visibility

    On This Page

    Properties