Docs
Browse Docs
Field guide · Structure and layout

Inconsistent column names across files

Files that should share one layout name the same column differently, or use the same name for different things.

What it looks like

Before
fileheader as writtenstandard name
march.csvEmail·
april.csvE-mail Address·
may.csvemail_addr·
may.csvContact·
After
fileheader as writtenstandard name
march.csvEmailemail
april.csvE-mail Addressemail
may.csvemail_addremail
may.csvContactneeds a decision
Each row here is a column header, not a record. Contact might hold an email address, a phone number, or a person's name; the values in that column have to be read before it is mapped.

How it happens

  • The export template was changed between one period and the next.
  • Each department or supplier built its own version of the sheet.
  • Headers were retyped by hand, with different spacing, case, and abbreviations.

What it breaks

  • Stacking the files produces several partly filled columns where one full column was expected.
  • A script that looks for a column by name fails, or quietly skips files that lack it.
  • Columns that share a name but not a meaning are merged, and the mix is hard to detect later.

How to spot it

  • List the headers of every file side by side before combining anything.
  • After stacking, look for columns that are empty for whole files.
  • Compare the kind of values under each header, not just the header text.

How to fix it

  • Define one standard set of column names, with a short description of what each holds.
  • Map every header in every file to a standard name, and keep the mapping so the next batch can reuse it.
  • Decide from the values, not the name, when two headers look alike. Where the values do not settle it, ask whoever produced the file.
  • Rename before combining, so the files stack on matching columns.

TermsSchema, Schema drift, Mapping, Data dictionary

Karg checks for many of these when it profiles a file, applies the fixes it is confident about, and sets the rest aside for your review. See how it works, or have our team clean your data for you.