- All tools
- Text Tools
Remove duplicate lines
Remove duplicate lines
Load your text in the input form on the left and you'll instantly get text with no duplicate lines in the output area. Powerful, free, and fast. Load text lines – get unique text lines
Remove duplicate lines Examples
Click to try!
Remove Duplicate Items from List
Removes duplicate items from a shopping list, keeping only the first occurrence of each item.
Operation Mode
Remove All Duplicate Lines
If this option is selected, then all repeated lines across entire text are removed, starting from the second occurrence.
Remove Consecutive Duplicate Lines
If this option is selected, then only consecutive repeated lines are removed.
Leave Absolutely Unique Text Lines
If this option is selected, then all lines that appear more than once are removed.
Newlines, Tabs and Spaces
Preserve All Newlines
Leave all empty lines in the output.
Filter All Newlines
Process newlines as regular lines.
Delete All Newlines
Before filtering uniques, remove all newlines.
Before filtering uniques, remove tabs and spaces from the beginning and end of all lines.
Sort Lines
After removing the duplicates, sort the unique lines.
Clean Consecutive Duplicates
Removes consecutive duplicates from log entries, which often happen when a system repeatedly logs the same error.
Operation Mode
Remove All Duplicate Lines
If this option is selected, then all repeated lines across entire text are removed, starting from the second occurrence.
Remove Consecutive Duplicate Lines
If this option is selected, then only consecutive repeated lines are removed.
Leave Absolutely Unique Text Lines
If this option is selected, then all lines that appear more than once are removed.
Newlines, Tabs and Spaces
Preserve All Newlines
Leave all empty lines in the output.
Filter All Newlines
Process newlines as regular lines.
Delete All Newlines
Before filtering uniques, remove all newlines.
Before filtering uniques, remove tabs and spaces from the beginning and end of all lines.
Sort Lines
After removing the duplicates, sort the unique lines.
Extract Unique Entries Only
Filters a list to keep only entries that appear exactly once, removing any duplicated items entirely.
Operation Mode
Remove All Duplicate Lines
If this option is selected, then all repeated lines across entire text are removed, starting from the second occurrence.
Remove Consecutive Duplicate Lines
If this option is selected, then only consecutive repeated lines are removed.
Leave Absolutely Unique Text Lines
If this option is selected, then all lines that appear more than once are removed.
Newlines, Tabs and Spaces
Preserve All Newlines
Leave all empty lines in the output.
Filter All Newlines
Process newlines as regular lines.
Delete All Newlines
Before filtering uniques, remove all newlines.
Before filtering uniques, remove tabs and spaces from the beginning and end of all lines.
Sort Lines
After removing the duplicates, sort the unique lines.
Sort and Clean Data
Removes duplicate items from a list, trims whitespace, and sorts the results alphabetically.
Operation Mode
Remove All Duplicate Lines
If this option is selected, then all repeated lines across entire text are removed, starting from the second occurrence.
Remove Consecutive Duplicate Lines
If this option is selected, then only consecutive repeated lines are removed.
Leave Absolutely Unique Text Lines
If this option is selected, then all lines that appear more than once are removed.
Newlines, Tabs and Spaces
Preserve All Newlines
Leave all empty lines in the output.
Filter All Newlines
Process newlines as regular lines.
Delete All Newlines
Before filtering uniques, remove all newlines.
Before filtering uniques, remove tabs and spaces from the beginning and end of all lines.
Sort Lines
After removing the duplicates, sort the unique lines.
Related tools
- All tools
- Text Tools
- SplitSplit text into multiple parts using a separator
- Join TextJoin text elements with a specified separator
- String To morseQuickly encode text to morse
- Text ReplacerQuickly replace text in your content
- Repeat TextRepeat text multiple times
- Truncate TextTruncate text to a specified length
- Reverse TextReverse any text character by character
- Randomize caseRandomize the case of letters in text
- Convert to UppercaseConvert text to uppercase
- Extract substringExtract a portion of text between specified positions
- Create palindromeCreate text that reads the same forward and backward
- PalindromeCheck if text reads the same forward and backward
- Text QuoterAdd quotes around text with various styles
- Rotate TextShift characters in text by position.
- ROT13 Encoder/DecoderEncode or decode text using ROT13 cipher.
- Base64 Encoder/DecoderEncode or decode data using Base64.
- Text StatisticsGet statistics about your text
- Text CensorQuickly mask bad words or replace them with alternative words.
- Password GeneratorGenerate secure random passwords with custom options
- String URL encoderQuickly URL-escape a string.
- String URL decoderQuickly URL-unescape a string.
- URL EditorInspect and edit URL components and query parameters.
- Unicode Encoder / DecoderEncode or decode text using Unicode escape sequences.
- Hidden Character DetectorFind hidden Unicode characters in text
- Email ExtractorExtract email addresses from text
- Compare TextsCompare two texts and spot differences instantly
- Slug GeneratorGenerate URL-friendly slugs from text.
- BcryptHash strings with Bcrypt
- Table Text ConverterConvert tables between Markdown, CSV, HTML, MySQL, and JSON
- UUID GeneratorCryptographically secure RFC 4122 v4 UUID generator.
- Lorem Ipsum GeneratorPlaceholder text generator by words, sentences, or paragraphs.
- Markdown PreviewerFast, secure Markdown editor with real-time sanitized preview.
- Case ConverterConvert text across casing conventions and programming styles.