Tool to deduplicate a list. Doubles or duplicates are a repeated redundant information present twice (or more) in a list, usually useless.
Duplicates in a List - dCode
Tag(s) : Data Processing
dCode is free and its tools are a valuable help in games, maths, geocaching, puzzles and problems to solve every day!
A suggestion ? a feedback ? a bug ? an idea ? Write to dCode!
A duplicate is a redundant element (double or triple or more) in a set of elements (a list).
Indicate / copy-paste items in the List field. dCode detects if the list is a list of terms (one per line) or a list of words (with separator) and finds redundant items repeated more than once in order to un-duplicate.
Example: A,B,C,D,A,B,C,A,B,A can be deduplicated as A,B,C,D (repeated terms were removed)
Be carefull to take into account all writing variants of a same element: ignore accents and diacritics allow to treat words like item and ìtém as a same word twice. Also, ignoring uppercase and lowercase allow to detect item and ITEM as a duplication of the same word and delete them.
By listing items, dCode detector counts the number of appearance of each, the list can be sorted to detect the most duplicated ones.
dCode counts duplicates/redundancies, so 2 identical items is counted 1 duplicate. N identical elements is counted N-1.