A hopefully comprehensive list of currently 286 tools used in corpus compilation and analysis.
This list is kept up to date by its users. Hence, please feel free to contribute by suggesting new tools.
You can also make suggestions, e.g., corrections, regarding individual tools by clicking the ✎ symbol. As this is a non-commercial side (side, side) project, checking and incorporating updates usually takes some time.
There is also a comprehensive list of all tags in the database.
| Tool | Description | Tags | Platforms | Pricing |
|---|---|---|---|---|
| Trafilatura ✎ | Trafilatura is a Python package and command-line tool which seamlessly downloads, parses, and scrapes web page data. | corpus creation, python, R, compilation, crawler, boilerplate remover, data, xml, scraping | Python | Free, Open Source |
| TWINT ✎ | A Twitter scraping tool written in Python that allows for scraping Tweets from Twitter profiles without using Twitter's API. | twitter, social media, scraping | Linux, Windows, Mac | Open Source |
Last Updated: March 10, 2025.
In case you are interested, the data is also available in JSON format.