Trove Newspaper and Gazette Harvester¶

Current version: v1.3.0

The Trove Newspaper & Gazette Harvester Harvester makes it easy to download large quantities of digitised articles from Trove's newspapers and gazettes. Just give it a search from the Trove web interface, and the harvester will save the metadata of all the articles in a CSV (spreadsheet) file for further analysis. You can also save the full text of every article, as well as copies of the articles as JPG images, and even PDFs. While the web interface will only show you the first 2,000 results matching your search, the Newspaper & Gazette Harvester will get everything.

The Jupyter notebooks in this repository use the Trove Newspaper and Gazette Harvester to download large quantities of digitised newspaper articles from Trove. There's also a few examples of how you can analyse and explore the harvested data.

The notebooks include:

• Using TroveHarvester to get newspaper articles in bulk — an easy introduction to the TroveHarvester tool
• Trove Harvester web app — a simple web interface to the TroveHarvester, the easiest way to harvest data from Trove (runs in Voila)
• Harvesting articles that mention "Anzac Day" on Anzac Day – import the Harvester as a Python library to harvest a complex search
• Display the results of a harvest as a searchable database using Datasette – load your harvested data into a SQLite database and explore it using Datasette
• Exploring your TroveHarvester data — use Pandas to analyse your data and create some visualisations
• Explore harvested text files (experimental) — analyse the full text content of harvested articles

See the GLAM Workbench for more details.

Cite as¶

See the GLAM Workbench or Zenodo for up-to-date citation details.

This repository is part of the GLAM Workbench.
If you think this project is worthwhile, you might like to sponsor me on GitHub.