Unique Words Extractor
Filter out duplicate words and extract a clean list of unique vocabulary
Extracted Vocabulary
Boil a text down to its distinct vocabulary
A long passage may contain thousands of words but only a few hundred different ones. The Unique Words Extractor removes the repeats and gives you a single list of each word used, which is handy for building word lists, checking vocabulary size or preparing text for further processing.
How to extract the vocabulary
- Paste your writing into the Source Text box.
- Choose a sort order with the option cards: Sort A-Z, Sort Z-A or Sort by Length.
- Click Extract Unique Words.
- Read the Extracted Vocabulary box, where words are separated by commas, and check the three tiles beneath it for Total Words, Unique Words and Reduction Rate.
- Use Copy List to copy the words, or Save TXT to download them as unique_words.txt.
What the settings do
All text is converted to lowercase first, so Apple and apple count as the same word. Sort A-Z orders words alphabetically, Sort Z-A reverses that, and Sort by Length puts the longest words first. The Reduction Rate shows how much the text shrank once repeats were removed, for example 60 percent means only 40 percent of the original word count remained.
Ways to put it to use
- Language learners collecting the vocabulary from a chapter or a song lyric to study.
- Writers checking how varied their word choice is across a draft.
- Developers or analysts who need a de-duplicated word list from a corpus before indexing or tagging.
- Teachers making a word bank from a reading passage for a spelling test.
Details that affect the list
Words are recognized as runs of letters, digits and underscores, so numbers appear in the list as words and a contraction such as don't is split into two fragments at the apostrophe. Accented letters and non-Latin characters count as separators, which breaks up words in languages that use them, so this tool suits basic English text best. Nothing is stemmed or grouped by meaning, so run, runs and running stay separate. The alphabetical sorting is plain character order, so digits come before letters and 10 sorts ahead of 2. The output is a comma-separated line rather than one word per line, so paste it into a spreadsheet and split by comma if you need rows. Editing the source text clears the previous results until you extract again. The work happens in your browser.
Related Tools
Related Tools