Databricks SDK for JavaScript
    Preparing search index...

    Interface DeltaTableSource

    interface DeltaTableSource {
        dataframeSchema?: string;
        filterCondition?: string;
        fullName?: string;
        transformationSql?: string;
    }
    Index

    Properties

    dataframeSchema? filterCondition? fullName? transformationSql?

    Properties

    dataframeSchema?: string

    Schema of the resulting dataframe after transformations, in Spark StructType JSON format (from df.schema.json()). Required if transformation_sql is specified. Example: {"type":"struct","fields":[{"name":"col_a","type":"integer","nullable":true,"metadata":{}},{"name":"col_c","type":"integer","nullable":true,"metadata":{}}]}

    filterCondition?: string

    Single WHERE clause to filter delta table before applying transformations. Will be row-wise evaluated, so should only include conditionals and projections.

    fullName?: string

    The full three-part (catalog, schema, table) name of the Delta table.

    transformationSql?: string

    A single SQL SELECT expression applied after filter_condition. Should contains all the columns needed (eg. "SELECT , col_a + col_b AS col_c FROM x.y.z WHERE col_a > 0" would have transformation_sql ", col_a + col_b AS col_c") If transformation_sql is not provided, all columns of the delta table are present in the DataSource dataframe.

    Settings

    Member Visibility

    On This Page

    Properties