Outliers from entry errors
A value sits far outside the rest because of a slipped key, an extra zero, or a misplaced decimal point.
What it looks like
Before
| employee | weekly_hours | review |
|---|---|---|
| Ana Ruiz | 40 | · |
| Ben Cho | 400 | · |
| Dee Park | 4 | · |
| Eli Ward | 38.5 | · |
After
| employee | weekly_hours | review |
|---|---|---|
| Ana Ruiz | 40 | · |
| Ben Cho | 400 | flagged: more hours than a week holds |
| Dee Park | 4 | flagged: possible, confirm |
| Eli Ward | 38.5 | · |
How it happens
- A key was pressed twice, or the decimal point was typed one place off.
- A value was entered in the wrong field, such as a postal code in a quantity column.
- A unit was assumed, so a figure in cents was typed into a column of dollars.
What it breaks
- A single extreme value moves an average or a total far more than hundreds of ordinary rows.
- Charts rescale to fit the outlier and flatten everything else.
- Removing extremes automatically also removes real ones, which are often the rows that matter most.
How to spot it
- Sort the column and read both ends.
- Test against limits that come from the real world: hours in a week, a plausible human age, stock that cannot go below zero.
- Compare each value with others for the same person, product, or site. A value ten times its neighbors is worth a look.
How to fix it
- Flag first. Deciding that a value is an error is separate from deciding what it should have been.
- Correct only with evidence: the source document, a related field, or the person who entered it.
- Where no evidence exists, keep the value, mark it, and decide openly whether to include it in each analysis.
- Keep a record of every value that was changed and why.
- Mixed unitsValues in one column are measured in different units, sometimes with the unit written in the cell and sometimes not.
- Disguised missing valuesA cell is not empty, but what it holds means there is no value: N/A, a dash, 999, or the word none.
- Impossible datesA value is shaped like a date but names a day that does not exist or could not have happened.
TermsOutlier, Anomaly, Validation, Human review