Duplicate Line Remover & Repeated-Line Report
Find the repeats. See how often they appear. Keep exactly what you need.
Or drop a .txt, .csv, .tsv or .log file · Up to 10 MB
Plain text in. Clean text out. Nothing uploaded.
Repeated-line report
See which lines repeat and how often. Matching follows your settings; the report shows the first original spelling. Up to 100 groups are displayed.
Add text to find repeated lines.
| Repeated line | Occurrences |
|---|
Understand your duplicates before you clean.
The repeated-line report lists the first original version of each matching group and its occurrence count. It examines your input before deduplication, after your empty-line and matching settings are applied. A maximum of 100 groups is displayed; the entire input is still processed.
Get the result you expect
- Keep first preserves the earliest copy; keep last preserves the latest copy and its position.
- Remove all duplicates keeps only groups that occur once. It can produce an empty result.
- Matching options change comparisons, not the spelling or spacing of retained lines.
Files are read as UTF-8 text. CSV and TSV are handled by physical line, without parsing quoted records or columns. Input is limited to 10 million characters; uploads to 10 MB.