Interface FileFilter

Type Declaration

• { $case: "pathFilter"; pathFilter: string }

  • $case: "pathFilter"

  • pathFilter: string

    Include files with file names matching the pattern Based on https://spark.apache.org/docs/latest/sql-data-sources-generic-options.html#path-glob-filter

• { $case: "modifiedBefore"; modifiedBefore: string }

  • $case: "modifiedBefore"

  • modifiedBefore: string

    Include files with modification times occurring before the specified time. Timestamp format: YYYY-MM-DDTHH:mm:ss (e.g. 2020-06-01T13:00:00) Based on https://spark.apache.org/docs/latest/sql-data-sources-generic-options.html#modification-time-path-filters

• { $case: "modifiedAfter"; modifiedAfter: string }

  • $case: "modifiedAfter"

  • modifiedAfter: string

    Include files with modification times occurring after the specified time. Timestamp format: YYYY-MM-DDTHH:mm:ss (e.g. 2020-06-01T13:00:00) Based on https://spark.apache.org/docs/latest/sql-data-sources-generic-options.html#modification-time-path-filters