To get started we need to define the table we want to load our data into. We define the table schema, including validations that should be applied to data that is imported.

Base Schema

The schema is a list of columns that define the table. Each column has a name and type. The type is used as one of the validtions steps when loading data. Data will be converted to the type specified in the schema, and if that conversion fails, the data will marked as invalid.

Validations

Validations are applied to data as it is loaded. If a validation fails, the data is marked as invalid. You can choose how to handle invalid data, either by taking noaction which ignores the data, nullify which sets value to null, or skiprow which skips the entire row if any value is invalid.

Required

Required columns are columns that must be present in the data. If a required column is missing, the data is marked as invalid. The validation action will then be applied like any other invalid data.