Partially filled rows
A row has some of its fields and lacks others, so it is usable for some purposes and not for others.
What it looks like
Before
| name | phone | postal_code | status | |
|---|---|---|---|---|
| Ana Ruiz | ana@example.com | 804-555-0142 | 23220 | · |
| Ben Cho | ben@example.com | · | · | · |
| Cara Diaz | · | · | · | · |
After
| name | phone | postal_code | status | |
|---|---|---|---|---|
| Ana Ruiz | ana@example.com | 804-555-0142 | 23220 | complete |
| Ben Cho | ben@example.com | · | · | email only |
| Cara Diaz | · | · | · | no way to contact, needs a decision |
How it happens
- A form was abandoned partway through and the partial entry was saved.
- Records were created with the minimum needed at the time, with a plan to finish them later.
- Rows from a source with fewer fields were combined with rows from a richer one.
What it breaks
- Analyses that need complete rows silently shrink to a subset that may not resemble the whole.
- Outreach fails for records that lack the one field the channel needs.
- Sparse rows are hard to match, so they are often undetected duplicates of fuller ones.
How to spot it
- Count the filled fields in each row and look at how the counts are distributed.
- Check which fields tend to be missing together. That often traces back to one source or one version of a form.
- Look for rows with only an identifier and nothing else.
How to fix it
- Define which fields are required for each use. A row can be complete enough for email and useless for mail.
- Check whether a sparse row matches a fuller record for the same entity before treating it as a separate one.
- Deciding to drop incomplete rows is a judgment about the analysis, not a cleaning step. Record how many were dropped and why.
- True blanksA cell is really empty, and the file does not say whether the value is unknown, not applicable, or was never asked for.
- Near-duplicate recordsTwo rows describe the same real thing but differ enough that an exact comparison misses them.
- Disguised missing valuesA cell is not empty, but what it holds means there is no value: N/A, a dash, 999, or the word none.
TermsCompleteness, Missing value, Record, Data quality