What counts as a duplicate row?

Two rows that match exactly in every cell. Rows that differ by even one character — including an extra space — are treated as different rows until whitespace is trimmed.

How do I remove near-duplicate rows with different spacing?

Enable Trim Whitespace together with Remove Duplicates in the same run. Trimming first normalizes the spacing so the exact-match dedup catches rows that only differed by padding.

Documentation

Removing duplicates

Drop exact-duplicate rows and verify what was removed.

Quick answer

Datio removes exact full-row duplicates: check the duplicate count in the CSV Cleaner, enable Remove Duplicates, run, compare the original vs. cleaned row counts, and export the deduplicated CSV.

Steps

Open Tools → CSV Cleaner and load the file.
Check the duplicate-row count shown before cleaning.
Enable Remove Duplicates (exact full-row match) and run.
Compare original vs. cleaned row counts in the result summary.
Export the deduplicated CSV.

Tips

Dedup is exact-match on the whole row — near-duplicates with different spacing must be whitespace-trimmed first.
Use the Data Profiler afterward to confirm the duplicate count is zero.

Common questions

What counts as a duplicate row?: Two rows that match exactly in every cell. Rows that differ by even one character — including an extra space — are treated as different rows until whitespace is trimmed.
How do I remove near-duplicate rows with different spacing?: Enable Trim Whitespace together with Remove Duplicates in the same run. Trimming first normalizes the spacing so the exact-match dedup catches rows that only differed by padding.

Use it in

CSV Cleaner →

Back to documentation Cleaning data Handling missing values Converting formats

Documentation

Removing duplicates

Drop exact-duplicate rows and verify what was removed.

Quick answer

Datio removes exact full-row duplicates: check the duplicate count in the CSV Cleaner, enable Remove Duplicates, run, compare the original vs. cleaned row counts, and export the deduplicated CSV.

Steps

Open Tools → CSV Cleaner and load the file.
Check the duplicate-row count shown before cleaning.
Enable Remove Duplicates (exact full-row match) and run.
Compare original vs. cleaned row counts in the result summary.
Export the deduplicated CSV.

Tips

Dedup is exact-match on the whole row — near-duplicates with different spacing must be whitespace-trimmed first.
Use the Data Profiler afterward to confirm the duplicate count is zero.

Common questions

What counts as a duplicate row?: Two rows that match exactly in every cell. Rows that differ by even one character — including an extra space — are treated as different rows until whitespace is trimmed.
How do I remove near-duplicate rows with different spacing?: Enable Trim Whitespace together with Remove Duplicates in the same run. Trimming first normalizes the spacing so the exact-match dedup catches rows that only differed by padding.

Use it in

CSV Cleaner →

Back to documentation Cleaning data Handling missing values Converting formats

Removing duplicates

Quick answer

Steps

Tips

Common questions

Use it in

Loading Datio workspace…

Removing duplicates

Quick answer

Steps

Tips

Common questions

Use it in