Databricks SDK for JavaScript
    Preparing search index...

    Interface KafkaConfig

    interface KafkaConfig {
        authConfig?: AuthConfig;
        backfillSource?: BackfillSource;
        bootstrapServers?: string;
        extraOptions?: Record<string, string>;
        ingestionConfig?: IngestionConfig;
        keySchema?: SchemaConfig;
        name?: string;
        subscriptionMode?: SubscriptionMode;
        valueSchema?: SchemaConfig;
    }
    Index

    Properties

    authConfig? backfillSource? bootstrapServers? extraOptions? ingestionConfig? keySchema? name? subscriptionMode? valueSchema?

    Properties

    authConfig?: AuthConfig

    Authentication configuration for connection to topics.

    backfillSource?: BackfillSource

    A user-provided and managed source for backfilling data. Historical data is used when creating a training set from streaming features linked to this Kafka config. In the future, a separate table will be maintained by for forward filling data. The schema for this source must match exactly that of the key and value schemas specified for this Kafka config.

    bootstrapServers?: string

    A comma-separated list of host/port pairs pointing to Kafka cluster.

    extraOptions?: Record<string, string>

    Catch-all for miscellaneous options. Keys should be source options or Kafka consumer options (kafka.*)

    ingestionConfig?: IngestionConfig

    Configuration for ingesting Kafka data into a -managed Delta table.

    keySchema?: SchemaConfig

    Schema configuration for extracting message keys from topics. At least one of key_schema and value_schema must be provided.

    name?: string

    Name that uniquely identifies this Kafka config within the metastore. This will be the identifier used from the Feature object to reference these configs for a feature. Can be distinct from topic name.

    subscriptionMode?: SubscriptionMode

    Options to configure which Kafka topics to pull data from.

    valueSchema?: SchemaConfig

    Schema configuration for extracting message values from topics. At least one of key_schema and value_schema must be provided.

    Settings

    Member Visibility

    On This Page

    Properties