Docs
Browse Docs
Glossary

Normalization

Converting values to a common form or scale. The word is used for text (one case, one spacing), for numbers (a common range), and for database design (removing repetition).

Because the word has three unrelated meanings, say which one you mean. In data cleaning it usually means making text or units consistent.

Where it comes up

  • Mixed unitsValues in one column are measured in different units, sometimes with the unit written in the cell and sometimes not.
  • Stray whitespace and invisible charactersTwo values look identical on screen but differ by a trailing space, a non-breaking space, or a hidden character.

See also

  • StandardizationRewriting values so that everything of one kind follows one format: every date year first, every phone number in the same pattern.
  • Canonical valueThe one agreed spelling for a thing that can be written several ways, such as VA for Virginia, virginia, and Va.

Karg checks for many of these when it profiles a file, applies the fixes it is confident about, and sets the rest aside for your review. See how it works, or have our team clean your data for you.