What type of data quality checks do you perform on the data?
During onboarding the following checks are performed on the data:
- Primary key checks (no duplicate rows or null values).
- White spaces (no trailing or leading spaces in the data).
- Data types for each column match what is specified in the schema.
- Data ranges for each column match what is specified in the schema.
- Column orders and existence of columns match what is specified in the schema.
On an ongoing basis, the data is mainly validated for freshness (timeliness of the data delivery) and volume (the number of rows and the size of the data table updated).