Text Tools
Remove duplicate lines.
Paste a list and get it back with repeated lines removed. Choose whether case and spacing matter, keep the first or last copy, sort the result, or show only the lines that repeat.
Input
Result
Paste a list to remove its duplicates.
About this duplicate line remover
Each line is compared with every other line, and repeated lines are removed so every value appears once. It works on emails, URLs, keywords, SKUs, log lines and any other list that has one item per line.
Worked example
apple
banana
Apple
banana
cherryWith the defaults the output is apple, banana, Apple, cherry (one per line): "Apple" and "apple" are different until you tick Ignore case, and then the first spelling wins. Switching Show to "Only lines that repeat" returns just banana.
Options
- Keep first or last: the copy you keep decides both which spelling survives (with ignore case on) and where the line sits in the output.
- Trim spaces: "a" and "a " count as the same line, and the output is trimmed. Leave it off when trailing whitespace matters, for example in code.
- Sort: A to Z uses natural order, so
item2comes beforeitem10. Length sorts shortest first. Shuffle randomises the order. - Only duplicates / only unique: find the values that repeat, or the ones that never do, instead of deduplicating.
Limits
Matching is exact after the options above; similar but not identical lines (a typo, different punctuation) are kept. Input is limited to 5 MB. Processing runs in your browser.
FAQ
How do I remove duplicate lines but keep the original order?
Leave Sort on "Keep original order". The first occurrence of each line stays where it was and later copies are removed.
How do I find which lines are duplicated?
Set Show to "Only lines that repeat". The status line also counts how many distinct lines appeared more than once.
Does it work with a large list?
Yes, up to 5 MB of text in one go. The list is processed on your device and never uploaded.