Docs
Browse Docs
Glossary

Sampling

Examining a subset of the rows in place of all of them, either to get a quick picture of a dataset or to check the result of a change by hand.

The first rows of a file are a poor sample, because files are often sorted and the oldest or tidiest rows come first. Rows chosen at random give a fairer picture, and rare problems can still slip past any sample.

See also

  • Data profilingExamining a dataset to describe what is actually in it: types, ranges, distinct values, blanks, and patterns, column by column.
  • Human reviewHaving a person examine a proposed change, and accept, correct, or reject it, before it is applied to the data.
  • ValidationChecking values against rules, such as a date being in the past or a state code being on the allowed list, and reporting what fails.

Karg checks for many of these when it profiles a file, applies the fixes it is confident about, and sets the rest aside for your review. See how it works, or have our team clean your data for you.