OptionalconnectorOptionaldestinationRequired. Destination catalog to store tables.
OptionaldestinationRequired. Destination schema to store tables in. Tables with the same name as the source tables are created in this destination schema. The pipeline fails If a table with the same name already exists.
OptionalfanoutFanout options for multi-table routing from streaming sources. When set, records are routed to destination tables based on a per-record routing key. The key value becomes the table name: {destination_catalog}.{destination_schema}.{key_value}.
OptionalsourceThe source catalog name. Might be optional depending on the type of source.
OptionalsourceSchema name in the source database. Currently required; this field will become optional in an upcoming release, since some source types (for example streaming / message-bus connectors) do not use it. When that change ships, this field's type in the generated SDKs and CLI will change from required to optional (nullable); clients that assume it is always present should handle its absence.
OptionaltableConfiguration settings to control the ingestion of tables. These settings are applied to all tables in this schema and override the table_configuration defined in the IngestionPipelineDefinition object.
(Optional) Source Specific Connector Options