1. trove-journals
  2. Create-digitised-journals-list.ipynb

Create a list of Trove's digitised periodicals

Everyone know's about Trove's newspapers, but there is also a growing collection of digitised periodicals available in the 'Magazines & newsletters' category. They're not easy to find, however, which is why I created the Trove Titles web app.

This notebook uses the Trove API to harvest metadata relating to digitised periodicals – or more accurately, periodicals that are freely available online in a digital form. This includes some born digital publications that are available to view in formats like PDF and MOBI, but excludes some digital journals that have access restrictions.

The search strategy to find digitised (and digital) periodicals takes advantage of the fact that Trove's digitised resources (excluding the newspapers) all have an identifier that includes the string nla.obj. So we start by searching in the journals zone for records that include nla.obj and have the format 'Periodical'. By specifying 'Periodical' we exclude individual articles from digitised journals.

Then it's just a matter of looping through all the results and checking to see if a record includes a fulltext link to a digital copy. If it does it gets saved.

You can see the results in this CSV file. Obviously you could extract additional metadata from each record if you wanted to.

The default fields are:

  • title – the title of the periodical
  • contributor – information about creator or publisher
  • issued – publication date, or date range
  • format – the type of publication, all entries should include 'Periodical', but may include other types such as 'Government publication'
  • trove_id – the 'nla.obj' part of the fulltext_url, a unique identifier for the digital periodical
  • trove_url – url of the periodical's metadata record in Trove
  • fulltext_url – the url of the landing page of the digital version of the periodical
  • fulltext_url_type – the type of digital periodical, one of 'digitised', 'edeposit', or 'other'

I've used this list to harvest all the OCRd text from digitised periodicals.

In [70]:
# Let's import the libraries we need.
import requests
import pandas as pd
from bs4 import BeautifulSoup
import time
import json
import os
import re
from tqdm.auto import tqdm
from requests.adapters import HTTPAdapter
from requests.packages.urllib3.util.retry import Retry
from slugify import slugify
from IPython.display import display, HTML
from datetime import datetime

s = requests.Session()
retries = Retry(total=5, backoff_factor=1, status_forcelist=[ 502, 503, 504 ])
s.mount('https://', HTTPAdapter(max_retries=retries))
s.mount('http://', HTTPAdapter(max_retries=retries))

Add your Trove API key

You can get a Trove API key by following these instructions.

In [71]:
# Add your Trove API key between the quotes
api_key = 'YOUR API KEY'

Define some functions to do the work

In [80]:
def get_total_results(params):
    '''
    Get the total number of results for a search.
    '''
    these_params = params.copy()
    these_params['n'] = 0
    response = s.get('https://api.trove.nla.gov.au/v2/result', params=these_params)
    data = response.json()
    return int(data['response']['zone'][0]['records']['total'])


def get_fulltext_urls(links):
    '''
    Loop through the identifiers to find a link to the digital version of the journal.
    '''
    urls = []
    for link in links:
        if link['linktype'] == 'fulltext' and 'nla.obj' in link['value']:
            url = link['value']
            if 'digitised' in link['linktext'].lower():
                url_type = 'digitised'
            elif 'edeposit' in link['linktext'].lower():
                url_type = 'edeposit'
            else:
                url_type = 'other'
            urls.append({'url': url, 'url_type': url_type})
    return urls

def listify(value):
    if not isinstance(value, list):
        value = [value]
    return value

def format_list(record, field):
    value = record.get(field, [])
    value = listify(value)
    return ' | '.join(value)


def get_titles():
    '''
    Harvest metadata about digitised journals.
    With a little adaptation, this basic pattern could be used to harvest
    other types of works from Trove.
    '''
    url = 'http://api.trove.nla.gov.au/v2/result'
    titles = []
    params = {
        # We can 'NOT' the format facet in the query
        'q': '"nla.obj-" NOT format:Article',
        #'q': '"nla.obj-" NOT format:Article',
        'zone': 'article',
        'l-format': ['Periodical'], # Journals only
        # 'l-format': 'Government publication', # Journals only
        'include': 'links',
        'bulkHarvest': 'true', # Needed to maintain a consistent order across requests
        'key': api_key,
        'n': 100,
        'encoding': 'json'
    }
    start = '*'
    total = get_total_results(params)
    with tqdm(total=total) as pbar:
        while start:
            params['s'] = start
            response = s.get(url, params=params)
            data = response.json()
            # If there's a startNext value then we get it to request the next page of results
            try:
                start = data['response']['zone'][0]['records']['nextStart']
            except KeyError:
                start = None
            for work in data['response']['zone'][0]['records']['work']:
                # Check to see if there's a link to a digital version
                try:
                    fulltext_urls = get_fulltext_urls(work['identifier'])
                except (KeyError, TypeError):
                    pass
                else:
                    for fulltext_url in fulltext_urls:
                        trove_id = re.search(r'(nla\.obj\-\d+)', fulltext_url['url']).group(1)
                        # Get basic metadata
                        # You could add more work data here
                        # Check the Trove API docs for work record structure
                        title = {
                            'title': work['title'],
                            'contributor': format_list(work, 'contributor'),
                            'issued': work.get('issued', ''),
                            'format': format_list(work, 'type'),
                            'fulltext_url': fulltext_url['url'], 
                            'trove_url': work['troveUrl'],
                            'trove_id': trove_id,
                            'fulltext_url_type': fulltext_url['url_type']
                        }
                        titles.append(title)
            time.sleep(0.2)
            pbar.update(100)
    return titles

Run the harvest

In [81]:
titles = get_titles()
In [82]:
df = pd.DataFrame(titles)
df.head()
Out[82]:
title contributor issued format fulltext_url trove_url trove_id fulltext_url_type
0 Laws, etc. (Acts of the Parliament) Victoria 1900-2021 Government publication | Periodical | Periodic... http://nla.gov.au/nla.obj-54127737 https://trove.nla.gov.au/work/10078182 nla.obj-54127737 digitised
1 The Silver stream songster 1890-1900 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-614066685 https://trove.nla.gov.au/work/10087062 nla.obj-614066685 digitised
2 Report / Defence Force Remuneration Tribunal Australia. Defence Force Remuneration Tribunal 1980-2021 Government publication | Periodical | Periodic... https://nla.gov.au/nla.obj-2137302489 https://trove.nla.gov.au/work/10096343 nla.obj-2137302489 digitised
3 Country web (Online) Rural Women's Network (N.S.W.) 1993-2021 Government publication | Periodical | Periodic... https://nla.gov.au/nla.obj-2337896017 https://trove.nla.gov.au/work/10100510 nla.obj-2337896017 edeposit
4 Territory of Papua : annual report for the per... Australia. Department of External Territories 1940-1949 Government publication | Periodical | Periodic... https://nla.gov.au/nla.obj-2060262652 https://trove.nla.gov.au/work/10103835 nla.obj-2060262652 digitised
In [83]:
# How many journals are there?
df.shape
Out[83]:
(7318, 8)

For some reason there are a number of duplicates in the list, where multiple Trove work records point to the same digitised journal. We an display the duplicates like this.

In [84]:
# SHow all the rows
pd.set_option('display.max_rows', None)
# Show dupes
df.loc[df.duplicated(subset=['trove_id'], keep=False)].sort_values(by=['trove_id', 'fulltext_url_type'])
Out[84]:
title contributor issued format fulltext_url trove_url trove_id fulltext_url_type
3020 Wings (Sydney, N.S.W. : Online) 2019-2021 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-1226109179 https://trove.nla.gov.au/work/236307958 nla.obj-1226109179 edeposit
6479 Wings (Sydney, N.S.W.) Royal Australian Air Force Association 1946-2021 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-1226109179 https://trove.nla.gov.au/work/30060307 nla.obj-1226109179 edeposit
1454 [Event programme] / Australian Festival of Cha... 1990-2021 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-1252107366 https://trove.nla.gov.au/work/205602387 nla.obj-1252107366 edeposit
4434 [Event programme] / Australian Festival of Cha... Australian Festival of Chamber Music (Townsvil... 1990-2021 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-1252107366 https://trove.nla.gov.au/work/237613201 nla.obj-1252107366 edeposit
437 Newsletter (Redland Libraries) Redcliffe Art Society 1970-2021 Periodical | Periodical/Journal, magazine, oth... https://nla.gov.au/nla.obj-1252138665 https://trove.nla.gov.au/work/163411531 nla.obj-1252138665 edeposit
1003 Newsletter (Redland Libraries) Redland (Qld.). Council. Library 2000-2021 Government publication | Periodical | Periodic... https://nla.gov.au/nla.obj-1252138665 https://trove.nla.gov.au/work/189939461 nla.obj-1252138665 edeposit
1361 The Brisbane Bushwalker Brisbane Bushwalkers Club 1900-2021 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-1252263267 https://trove.nla.gov.au/work/200641459 nla.obj-1252263267 edeposit
5650 The Brisbane bushwalker : monthly magazine of ... Brisbane Bushwalkers Club 1965-2021 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-1252263267 https://trove.nla.gov.au/work/24167477 nla.obj-1252263267 edeposit
444 The Queensland geologist Geological Society of Australia. Queensland Di... 2000-2021 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-1252284018 https://trove.nla.gov.au/work/163412146 nla.obj-1252284018 edeposit
521 The Queensland geologist : bimonthly newslette... Geological Society of Australia. Queensland Di... 1900-2021 Government publication | Periodical | Periodic... https://nla.gov.au/nla.obj-1252284018 https://trove.nla.gov.au/work/16824694 nla.obj-1252284018 edeposit
1415 The shadowland newsletter Wegner, J. P 2015-2021 Periodical | Periodical/Journal, magazine, oth... https://nla.gov.au/nla.obj-1771610885 https://trove.nla.gov.au/work/203345085 nla.obj-1771610885 edeposit
7184 The Atlas of the solar system / Patrick Moore ... Moore, Patrick, 1923- 1983-2021 Book | Book/Illustrated | Periodical | Periodi... https://nla.gov.au/nla.obj-1771610885 https://trove.nla.gov.au/work/7113005 nla.obj-1771610885 edeposit
538 Community perspective / Queensland Ombudsman Queensland. Ombudsman 2012-2021 Government publication | Periodical | Periodic... https://nla.gov.au/nla.obj-2203792171 https://trove.nla.gov.au/work/169738738 nla.obj-2203792171 edeposit
4424 Community Perspectives : June 2016 2016-2021 Government publication | Periodical | Periodic... https://nla.gov.au/nla.obj-2203792171 https://trove.nla.gov.au/work/237605038 nla.obj-2203792171 edeposit
1043 Newsletter (United Nations Association of Aust... United Nations Association of Australia, Queen... 2004-2021 Periodical | Periodical/Journal, magazine, other https://www.nla.gov.au/nla.obj-2730255354 https://trove.nla.gov.au/work/191160614 nla.obj-2730255354 edeposit
1072 The United Nations Association Queensland news Queensland Committee for UNICEF 1983-2021 Periodical | Periodical/Journal, magazine, other https://www.nla.gov.au/nla.obj-2730255354 https://trove.nla.gov.au/work/19158481 nla.obj-2730255354 edeposit
1344 ... Report on State Finances of the Queensland... Queensland Treasury and Trade 2014-2021 Government publication | Periodical | Periodic... https://www.nla.gov.au/nla.obj-2730305180 https://trove.nla.gov.au/work/200334034 nla.obj-2730305180 edeposit
6680 Report on State finances of the Queensland Gov... Queensland. Treasury Department 2003-2021 Periodical | Periodical/Journal, magazine, oth... https://www.nla.gov.au/nla.obj-2730305180 https://trove.nla.gov.au/work/33653816 nla.obj-2730305180 edeposit
4790 Into paper : newsletter of the Papermakers of ... Papermakers of Queensland Periodical | Periodical/Journal, magazine, other https://www.nla.gov.au/nla.obj-2730310000 https://trove.nla.gov.au/work/239069372 nla.obj-2730310000 edeposit
6673 Into paper : newsletter of the Papermakers of Qld Papermakers of Queensland 1990-2021 Periodical | Periodical/Journal, magazine, other https://www.nla.gov.au/nla.obj-2730310000 https://trove.nla.gov.au/work/33589633 nla.obj-2730310000 edeposit
1115 Petroleum and Gas Downstream Safety News Queensland. Department of Natural Resources an... 2012-2021 Periodical | Periodical/Journal, magazine, oth... https://www.nla.gov.au/nla.obj-2730357838 https://trove.nla.gov.au/work/192033185 nla.obj-2730357838 edeposit
6856 Petroleum and gas safety news Queensland. Department of Natural Resources an... 2005-2021 Government publication | Periodical | Periodic... https://www.nla.gov.au/nla.obj-2730357838 https://trove.nla.gov.au/work/35782199 nla.obj-2730357838 edeposit
944 Link (Cycling Queensland) Cycling Queensland 2012-2021 Periodical | Periodical/Journal, magazine, other https://www.nla.gov.au/nla.obj-2730381154 https://trove.nla.gov.au/work/188531919 nla.obj-2730381154 edeposit
6706 The link Bicycle Institute of Queensland 1900-1990 Periodical | Periodical/Journal, magazine, other https://www.nla.gov.au/nla.obj-2730381154 https://trove.nla.gov.au/work/33679327 nla.obj-2730381154 edeposit
1369 Land cover change in Queensland / Resources Sc... Queensland. Department of Natural Resources an... 1995-2021 Periodical | Periodical/Journal, magazine, oth... https://www.nla.gov.au/nla.obj-2731003675 https://trove.nla.gov.au/work/200643494 nla.obj-2731003675 edeposit
4791 Land cover change in Queensland / Resources Sc... Queensland. Department of Science, Information... 2010-2021 Government publication | Periodical | Periodic... https://www.nla.gov.au/nla.obj-2731003675 https://trove.nla.gov.au/work/239069376 nla.obj-2731003675 edeposit
1376 Queensland Transport and Roads Investment Prog... Queensland. Department of Transport and Main R... 2010-2021 Periodical | Periodical/Journal, magazine, oth... https://www.nla.gov.au/nla.obj-2731057754 https://trove.nla.gov.au/work/200686170 nla.obj-2731057754 edeposit
1421 Queensland transport and roads investment prog... Queensland. Department of Transport and Main R... 2015 Government publication | Periodical | Periodic... https://www.nla.gov.au/nla.obj-2731057754 https://trove.nla.gov.au/work/203535781 nla.obj-2731057754 edeposit
6438 ChinWag ACT Rescue and Foster 2009-2021 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-309084555 https://trove.nla.gov.au/work/28425123 nla.obj-309084555 digitised
6437 ChinWag ACT Rescue and Foster 2009-2021 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-309084555 https://trove.nla.gov.au/work/28425123 nla.obj-309084555 edeposit
729 Art in Australia Smith, Sydney Ure, 1887-1949 1916-1942 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-325167134 https://trove.nla.gov.au/work/18109818 nla.obj-325167134 digitised
728 Art in Australia Smith, Sydney Ure, 1887-1949 1916-1942 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-325167134 https://trove.nla.gov.au/work/18109818 nla.obj-325167134 other
6665 Photographic review of reviews 1894 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-389050007 https://trove.nla.gov.au/work/33565755 nla.obj-389050007 digitised
4518 Photographic review of reviews (Online) 1894 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-389050007 https://trove.nla.gov.au/work/238058947 nla.obj-389050007 other
6683 The Australian woman's mirror 1924-1961 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-389050376 https://trove.nla.gov.au/work/33657268 nla.obj-389050376 digitised
4470 The Australian woman's mirror (Online) 1924-1961 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-389050376 https://trove.nla.gov.au/work/237942979 nla.obj-389050376 other
6915 Newsletter (International Bank Note Society. ... International Bank Note Society. Melbourne Cha... 2000-2021 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-411508348 https://trove.nla.gov.au/work/37859870 nla.obj-411508348 edeposit
6916 Newsletter (International Bank Note Society. ... International Bank Note Society. Melbourne Cha... 2000-2021 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-411508348 https://trove.nla.gov.au/work/37859870 nla.obj-411508348 other
828 U3A Sunshine e-Voice University of the Third Age (Sunshine Coast, Q... 2012-2021 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-483060448 https://trove.nla.gov.au/work/185170546 nla.obj-483060448 edeposit
2176 U3A Sunshine e-Voice (Online) U3A Sunshine Coast Incorporated 2012-2021 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-483060448 https://trove.nla.gov.au/work/227406722 nla.obj-483060448 edeposit
613 Newsletter (Genealogical Society of Queensland... Genealogical Society of Queensland. Ipswich Br... 1900-2021 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-485357469 https://trove.nla.gov.au/work/17504125 nla.obj-485357469 edeposit
2181 Bremer echoes (Online) Ipswich Genealogical Society 2015-2021 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-485357469 https://trove.nla.gov.au/work/227470178 nla.obj-485357469 edeposit
2790 The New South Wales Post Office directory 1887-1908 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-518308191 https://trove.nla.gov.au/work/23458620 nla.obj-518308191 digitised
4472 The New South Wales Post Office directory (Onl... 1887-1908 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-518308191 https://trove.nla.gov.au/work/237945398 nla.obj-518308191 other
7018 Everyones 1920-1937 Microform | Periodical | Periodical/Journal, m... http://nla.gov.au/nla.obj-522690001 https://trove.nla.gov.au/work/5550156 nla.obj-522690001 digitised
4471 Everyones (Sydney, N.S.W. : Online) 1920-1937 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-522690001 https://trove.nla.gov.au/work/237943749 nla.obj-522690001 other
6983 Month (Sydney, N.S.W.) Moore, J. Sheridan 1857-1860 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-597762006 https://trove.nla.gov.au/work/5525268 nla.obj-597762006 digitised
4478 Month (Sydney, N.S.W. : Online) 1857-1860 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-597762006 https://trove.nla.gov.au/work/238004028 nla.obj-597762006 other
6984 The South-Asian register 1827-1828 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-597769314 https://trove.nla.gov.au/work/5525462 nla.obj-597769314 digitised
4474 South-Asian register (Online) 1827-1828 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-597769314 https://trove.nla.gov.au/work/237956276 nla.obj-597769314 other
1708 Tegg's monthly magazine 1836 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-598267619 https://trove.nla.gov.au/work/21508050 nla.obj-598267619 digitised
4476 Tegg's monthly magazine (Online) 1836 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-598267619 https://trove.nla.gov.au/work/237995271 nla.obj-598267619 other
7067 Rugby League news (Sydney, N.S.W.) New South Wales Rugby Football League 1920-1973 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-598579045 https://trove.nla.gov.au/work/6193573 nla.obj-598579045 digitised
4469 Rugby League news (Sydney, N.S.W. : Online) 1920-1973 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-598579045 https://trove.nla.gov.au/work/237942681 nla.obj-598579045 other
2150 FBA Update / Fitzroy Basin Association XXXX 1900-2021 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-626845723 https://trove.nla.gov.au/work/226576932 nla.obj-626845723 edeposit
2474 Reef Guardian Councils highlight reports Great Barrier Reef Marine Park Authority 2016-2021 Government publication | Periodical | Periodic... https://nla.gov.au/nla.obj-626845723 https://trove.nla.gov.au/work/230265052 nla.obj-626845723 edeposit
1751 Bookfellow (Sydney, N.S.W. : 1899) 1899 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-636005630 https://trove.nla.gov.au/work/21701137 nla.obj-636005630 digitised
4479 Bookfellow (Sydney, N.S.W. : 1899 : Online) 1899 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-636005630 https://trove.nla.gov.au/work/238004103 nla.obj-636005630 other
886 Australian magazine (Sydney, N.S.W. : 1899) 1899 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-636091247 https://trove.nla.gov.au/work/18685300 nla.obj-636091247 digitised
4481 Australian magazine (Sydney, N.S.W. : 1899 : O... 1899 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-636091247 https://trove.nla.gov.au/work/238008662 nla.obj-636091247 other
120 The bulletin Butler, S. T. (Stuart Thomas) 1880-2021 Periodical | Periodical/Newspaper | Periodical... https://nla.gov.au/nla.obj-68375465 https://trove.nla.gov.au/work/11500235 nla.obj-68375465 digitised
751 Bulletin (Sydney, N.S.W. : 1880) 1880-2021 Periodical | Periodical/Journal, magazine, oth... https://nla.gov.au/nla.obj-68375465 https://trove.nla.gov.au/work/181758222 nla.obj-68375465 other
897 Dun's gazette for New South Wales 1909-1958 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-724008889 https://trove.nla.gov.au/work/18731562 nla.obj-724008889 digitised
4473 Dun's gazette for New South Wales (Online) 1909-1958 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-724008889 https://trove.nla.gov.au/work/237946453 nla.obj-724008889 other
308 Victorian almanac for ... (Melbourne, Vic. : 1... 1860 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-729278011 https://trove.nla.gov.au/work/13645498 nla.obj-729278011 digitised
547 Victorian almanac for ... (Melbourne, Victoria... 1859-1927 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-729278011 https://trove.nla.gov.au/work/17053735 nla.obj-729278011 digitised
1188 Weldon's matrimonial gazette 1896 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-744869630 https://trove.nla.gov.au/work/19323982 nla.obj-744869630 digitised
4516 Weldon's matrimonial gazette (Online) 1896 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-744869630 https://trove.nla.gov.au/work/238056012 nla.obj-744869630 other
35 The New South Wales school magazine of literat... New South Wales. Department of Education 1950-1960 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-748141557 https://trove.nla.gov.au/work/10753694 nla.obj-748141557 digitised
4508 New South Wales school magazine of literature ... New South Wales. Department of Education 1950-1960 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-748141557 https://trove.nla.gov.au/work/238053149 nla.obj-748141557 other
803 Australian magazine (Sydney, N.S.W. : 1838) 1838 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-752101760 https://trove.nla.gov.au/work/18429775 nla.obj-752101760 digitised
4489 Australian magazine (Sydney, N.S.W. : 1838 : O... 1838 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-752101760 https://trove.nla.gov.au/work/238034966 nla.obj-752101760 other
888 New South Wales magazine (1833) 1833-1834 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-753076802 https://trove.nla.gov.au/work/18691103 nla.obj-753076802 digitised
4506 New South Wales magazine (1833 : Online) 1833-1834 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-753076802 https://trove.nla.gov.au/work/238053011 nla.obj-753076802 other
109 The Sydney coronal / by Charles M'Donald M'Donald, Charles, active 1838 1835-1836 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-753479079 https://trove.nla.gov.au/work/11415630 nla.obj-753479079 digitised
4515 Sydney coronal (Online) M'Donald, Charles 1835-1836 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-753479079 https://trove.nla.gov.au/work/238055834 nla.obj-753479079 other
6987 Tegg's New South Wales pocket almanac and reme... 1836-1844 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-754081281 https://trove.nla.gov.au/work/5527029 nla.obj-754081281 digitised
4485 Tegg's New South Wales pocket almanac and reme... 1836-1844 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-754081281 https://trove.nla.gov.au/work/238033317 nla.obj-754081281 other
2714 Alcohol and other drug treatment services in A... Australian Institute of Health and Welfare 2001-2021 Government publication | Periodical | Periodic... https://nla.gov.au/nla.obj-754925659 https://trove.nla.gov.au/work/234305861 nla.obj-754925659 edeposit
2715 Alcohol and other drug treatment services in A... Australian Institute of Health and Welfare 2001-2021 Government publication | Periodical | Periodic... http://nla.gov.au/nla.obj-754925659 https://trove.nla.gov.au/work/234305861 nla.obj-754925659 other
7092 Liberty (Sydney, N.S.W.) 1932-1934 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-760289107 https://trove.nla.gov.au/work/6399562 nla.obj-760289107 digitised
4484 Liberty (Sydney, N.S.W. : Online) 1932-1934 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-760289107 https://trove.nla.gov.au/work/238033248 nla.obj-760289107 other
304 The Sydney once a week magazine Barlee, Charles Haynes 1878 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-760335335 https://trove.nla.gov.au/work/13572556 nla.obj-760335335 digitised
4480 Sydney once a week magazine (Online) 1878 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-760335335 https://trove.nla.gov.au/work/238006103 nla.obj-760335335 other
883 The Literary news : a review and magazine of f... 1837-1838 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-765536757 https://trove.nla.gov.au/work/18674223 nla.obj-765536757 digitised
4477 Literary news (Online) 1837-1838 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-765536757 https://trove.nla.gov.au/work/238002346 nla.obj-765536757 other
1925 Australia and the bookfellow 1907 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-768289925 https://trove.nla.gov.au/work/22318978 nla.obj-768289925 digitised
4496 Australia and the bookfellow (Online) 1907 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-768289925 https://trove.nla.gov.au/work/238042370 nla.obj-768289925 other
1926 Australia (Sydney, N.S.W. : 1907) 1907 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-768329137 https://trove.nla.gov.au/work/22319382 nla.obj-768329137 digitised
4495 Australia (Sydney, N.S.W. : 1907 : Online) 1907 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-768329137 https://trove.nla.gov.au/work/238042365 nla.obj-768329137 other
1927 Bookfellow (Sydney, N.S.W. : 1911) 1911-1925 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-768936943 https://trove.nla.gov.au/work/22319620 nla.obj-768936943 digitised
4505 Bookfellow (Sydney, N.S.W. : 1911 : Online) 1911-1925 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-768936943 https://trove.nla.gov.au/work/238051629 nla.obj-768936943 other
7022 The New Triad 1927-2021 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-788254980 https://trove.nla.gov.au/work/5552221 nla.obj-788254980 digitised
4507 New Triad (Online) 1927-1928 Periodical | Periodical/Journal, magazine, other http://nla.gov.au/nla.obj-788254980 https://trove.nla.gov.au/work/238053099 nla.obj-788254980 other
6418 Triad (Sydney, N.S.W.) 1892-1927 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-875780662 https://trove.nla.gov.au/work/27592184 nla.obj-875780662 digitised
4482 Triad (Sydney, N.S.W. : Online) 1915-1927 Periodical | Periodical/Journal, magazine, other https://nla.gov.au/nla.obj-875780662 https://trove.nla.gov.au/work/238009872 nla.obj-875780662 other
In [85]:
df.sort_values(by=['trove_id', 'fulltext_url_type']).drop_duplicates(subset='trove_id', keep='last').shape
Out[85]:
(7270, 8)
In [86]:
# Save as CSV and display a download link
csv_file = f'digital-journals-{datetime.now().strftime("%Y%m%d")}.csv'
#csv_file = f'government-publications-periodicals-{datetime.now().strftime("%Y%m%d")}.csv'
df.to_csv(csv_file, index=False)
display(HTML(f'<a href="{csv_file}" download="{csv_file}">{csv_file}</a>'))
digital-journals-20210805.csv

Created by Tim Sherratt for the GLAM Workbench.

Work on this notebook was supported by the Humanities, Arts and Social Sciences (HASS) Data Enhanced Virtual Lab.