A hopefully comprehensive list of currently 286 tools used in corpus compilation and analysis.
This list is kept up to date by its users. Hence, please feel free to contribute by suggesting new tools.
You can also make suggestions, e.g., corrections, regarding individual tools by clicking the ✎ symbol. As this is a non-commercial side (side, side) project, checking and incorporating updates usually takes some time.
There is also a comprehensive list of all tags in the database.
| Tool | Description | Tags | Platforms | Pricing |
|---|---|---|---|---|
| jTokenizer ✎ | Tokenizing natural language | tokenizer | Free | |
| Natural Language Toolkit ✎ | Platform for building Python programs to work with human language data | tokenizer, tagger | Unix, Mac, Windows (+Python 3.4) | Free |
| SoMaJo ✎ | A tokenizer and sentence splitter for German and English web and social media texts. | tokenizer, sentence boundary detector | Linux, Mac, Windows | Free, Open Source |
| Tweet NLP ✎ | Tweet tokenizer, PoS Tagger, hierarchical word clusters, and a dependency parser for tweets, along with annotated corpora and web-based annotation tools. Clusters: http://www.cs.cmu.edu/~ark/TweetNLP/cluster_viewer.html | pos tagger, tokenizer, parser | Free | |
| TXM ✎ | XML & TEI compatible text analysis software based on TreeTagger, the CQP search engine and the R statistical environment. | text analysis, concordancer, r, statistics, search tool, tokenizer, xml | Windows,Mac,Linux,Tomcat | Free |
| Unitok ✎ | An annotation-aware tokenizer that splits text into line-by-line tokens. | tokenizer | Free | |
| YACSI Chinese Tokeniser / PoS Tagger ✎ | A Chinese tokenizer and PoS tagger | chinese, tokenizer, pos tagger | Windows | Free |
| Word Frequency Analyser ✎ | A web-based tool for analyzing word frequencies that also produces frequency charts and word clouds. | pos tagger, tokenizer, lemmatizer, frequency analysis | Web | Free |
Last Updated: July 04, 2025.
In case you are interested, the data is also available in JSON format.