Remove Duplicate Lines
Remove duplicate lines from text, keeping only the first occurrence of each unique line, with a case-sensitivity toggle.
Result:
How to remove duplicate lines from text
Paste your list into the box above, one item per line. Every line after the first occurrence of a duplicate is removed automatically, and the result updates live. Toggle case-sensitive matching depending on whether "Apple" and "apple" should count as the same line.
Example
"apple\nbanana\nApple\napple\ncherry" becomes "apple\nbanana\nApple\ncherry" with case-sensitive matching (since "Apple" and "apple" differ), or "apple\nbanana\ncherry" with case-insensitive matching on.
Common Use Cases
- Cleaning a mailing list or contact list before sending a campaign.
- Deduplicating keywords, tags, or log entries.
- Tidying up a pasted list before importing it into a spreadsheet.
FAQs
Which occurrence of a duplicate is kept?
The first occurrence of each unique line is kept; every later repeat of that exact line is removed.
Is matching case-sensitive?
By default, yes — "Apple" and "apple" are treated as different lines. Untick the case-sensitive option to treat them as duplicates of each other.
Does it trim whitespace before comparing lines?
No — lines are compared exactly as typed, so a line with trailing spaces is treated as different from the same line without them. Run the Text Cleaner tool first if you need to normalize whitespace before deduplicating.