YOUR EVERYDAY TEXT TOOLKIT

Duplicate Line Remover & Repeated-Line Report

Find the repeats. See how often they appear. Keep exactly what you need.

Local processing. No signup. Your text stays on your device.
YOUR TEXT WORKSPACE Runs locally in your browser

Or drop a .txt, .csv, .tsv or .log file · Up to 10 MB

Cleaning options

Make it your own
Original text stays untouched.

Ready when you are. Paste your text to get started.

The keepers

Plain text in. Clean text out. Nothing uploaded.

Original lines0
Unique lines0
Duplicates removed0
Duplicate rate0%
Input characters0
Input words0

Repeated-line report

See which lines repeat and how often. Matching follows your settings; the report shows the first original spelling. Up to 100 groups are displayed.

Add text to find repeated lines.

Repeated lineOccurrences

Understand your duplicates before you clean.

The repeated-line report lists the first original version of each matching group and its occurrence count. It examines your input before deduplication, after your empty-line and matching settings are applied. A maximum of 100 groups is displayed; the entire input is still processed.

Remove blank lines without deduplicating →

Get the result you expect

  • Keep first preserves the earliest copy; keep last preserves the latest copy and its position.
  • Remove all duplicates keeps only groups that occur once. It can produce an empty result.
  • Matching options change comparisons, not the spelling or spacing of retained lines.

Files are read as UTF-8 text. CSV and TSV are handled by physical line, without parsing quoted records or columns. Input is limited to 10 million characters; uploads to 10 MB.