Duplicate Line Remover
Remove repeated lines from text with one click.
About this calculator
Paste a list with repeated lines and get back the unique lines, in the original order. Choose whether matching is case-sensitive, whether to keep the first or last occurrence, and whether to drop blank lines.
Handy for cleaning email lists, keyword lists, logs, URLs and exports from spreadsheets.
How to use it
- Paste your lines, one per line.
- Set the options: Case-sensitive, Keep last occurrence, Remove blank lines.
- Press Remove Duplicates and copy the result.
Method
The tool reads the list line by line and remembers each line it has seen. Later repeats are dropped. With 'Keep last' the list is processed from the end instead. Case-insensitive mode compares lines in lower case so Apple and apple match.
Worked example
Input: a, b, a, c, b (one per line)
| Result (keep first) | a, b, c |
| Result (keep last) | a, c, b |
Tips and common mistakes
- Trim spaces first so 'apple ' and 'apple' match.
- Use case-insensitive mode for email addresses.
- Sort the list first if order does not matter.
- Compare counts before and after to see how many duplicates were removed.
- For spreadsheets, copy a single column.
Frequently asked questions
How do I remove duplicate lines?
Paste the lines and press Remove Duplicates.
Does it keep the original order?
Yes.
Is it case-sensitive?
You can switch this on or off.
Can it keep the last occurrence?
Yes, tick Keep last occurrence.
Does it remove blank lines?
Yes, if you tick that option.
Is there a size limit?
Only your browser's memory.