>
PERMARKET
Tools › Text › Dedupe Lines
DUP

Dedupe Lines

Remove duplicate lines from a list, with case and trim options.

Ad · Large Rectangle (336×280)

How to use Dedupe Lines

Free dedupe tool: strip repeated lines from any list, optionally ignoring case and surrounding spaces.

  1. Open Dedupe Lines on toolpermarket — the form is ready, so type your numbers and read the result.

  2. In the Your list field, paste the lines you want cleaned, one per row. Tick Case-insensitive if "Apple" and "apple" should count as the same line.

  3. Press Dedupe to compute the result. The output appears immediately below the form. Edit a value and press the button once more to see the updated answer.

  4. Read the result and use it as needed. If the number looks off, re-check your inputs and run it again — the math is deterministic, so the same entries always return the same answer.

Worked example. Paste a list with repeated emails, tick Trim spaces, and get back each address only once.

Tips for accurate results.

  • Trim spaces first when copies came from different sources with stray padding.

  • Case-insensitive is safest for human names and words that vary only in capitals.

  • Blank lines are always dropped, so a trailing newline will not create an empty row.

When to use Dedupe Lines. Cleaning a mailing list before a send. Removing repeat entries from a keywords or tags list. Prepping a de-duplicated set of URLs or IDs.

When you actually reach for this

  • You pasted a log or list and want repeated entries collapsed to one.
  • You are cleaning a mailing list and need unique rows.

Where this tool stops being accurate

  • Comparison is exact and case-sensitive by default, so "Apple" and "apple" count as two lines.
  • It keeps the first occurrence and drops later duplicates, preserving original order.
  • Leading/trailing spaces make otherwise identical lines look different; trim first if that matters.

Frequently asked questions

Are the lines uploaded?

Never. The list is read, compared locally, and the unique result stays on your device.

What does Case-insensitive do?

It treats lines that differ only in upper or lower letters as the same, keeping just the first copy. Leave it off to treat them as distinct.

Does it keep my original order?

Yes. The first occurrence of each line is kept in the order it appeared, so the result reads the way your list started.

Why are "New York" and "new york" both kept?

Exact mode treats them as different strings. Turn on case-insensitive dedupe if you want them merged — but be aware that may also merge words you intended to keep distinct.

Does it remove blank lines?

Only if you enable blank-line removal; otherwise a blank line is just another unique line and is kept once.