Batch
A set of records processed together as one unit, such as a day of orders loaded overnight or one uploaded file.
Batches are a natural unit for checking. A batch with far fewer rows than usual, or with a new column, is worth stopping before it is mixed into everything else.
See also
- ETLExtract, transform, load: taking data out of a source system, cleaning and reshaping it, and then writing the result into a destination.
- Schema driftUnannounced change in the structure of a recurring data feed: a column renamed, added, dropped, reordered, or changed in type between one delivery and the next.
- ValidationChecking values against rules, such as a date being in the past or a state code being on the allowed list, and reporting what fails.