Databricks SDK for JavaScript
    Preparing search index...

    Interface PipelinesGcpAttributes

    Attributes set during cluster creation which are related to Gcp.

    interface PipelinesGcpAttributes {
        availability?: PipelinesGcpAvailability;
        bootDiskSize?: number;
        googleServiceAccount?: string;
        localSsdCount?: number;
        zoneId?: string;
    }
    Index

    Properties

    availability? bootDiskSize? googleServiceAccount? localSsdCount? zoneId?

    Properties

    availability?: PipelinesGcpAvailability

    This field determines whether the spark executors will be scheduled to run on preemptible VMs, on-demand VMs, or preemptible VMs with a fallback to on-demand VMs if the former is unavailable.

    bootDiskSize?: number

    boot disk size in GB

    googleServiceAccount?: string

    If provided, the cluster will impersonate the google service account when accessing gcloud services (like GCS). The google service account must have previously been added to the environment by an account administrator.

    localSsdCount?: number

    The number of local SSDs to attach to each worker and driver for this cluster. If left unspecified, the default number of local SSDs for the node type will be used.

    NOTE: Each instance type can only support a certain number of attached local SSDs. The value specified in local_ssd_count must be valid for BOTH the driver and worker instance type. See GCP docs here: https://cloud.google.com/compute/docs/disks#local_ssd_machine_type_restrictions

    Validation is performed at the RPC layer and the RPC will be rejected if the specified local_ssd_count is invalid.

    zoneId?: string

    Identifier for the availability zone in which the cluster resides. This can be one of the following:

    • "HA" => High availability, spread nodes across availability zones for a deployment region [default].
    • "AUTO" => picks an availability zone to schedule the cluster on.
    • A GCP availability zone => Pick One of the available zones for (machine type + region) from https://cloud.google.com/compute/docs/regions-zones.

    Settings

    Member Visibility

    On This Page

    Properties