Univeristy of Minnesota River Surface Area Dataset¶

Source¶

https://data-catalog.mint.isi.edu/datasets/da6b6d47-7672-4e6e-a455-7bbc7e7ceb99

Description¶

The original University of Minnesota dataset contains timeseries surface area measurements (sq km) on 1.5 km x 1.5 km samples of Ethiopian rivers from satellite imagery data. This version of the data aggregates the measurements by woreda. Each surface measurement bounding box is intersected with the woredas. The river surface area of the bounding box is allocated to the woredas based on the fraction of coverage.

In [1]:

import io, os, json
import pandas as pd
from requests import post, put, delete, get
from requests.auth import HTTPBasicAuth
from io import StringIO
from IPython.display import display, HTML

In [2]:

datamart_api_url = "https://dsbox02.isi.edu:8888/datamart-api-wm"
user = "datamart" 
password = "datamart-api-789" 
auth = HTTPBasicAuth(user, password)

API Examples¶

Get metadata about Aggregated dataset¶

GET /metadata/datasets/UMINNESOTA_AGGREGATE

In [3]:

url = f"{datamart_api_url}/metadata/datasets/UMINNESOTA_AGGREGATE"
response = get(url, auth=auth)
df = pd.DataFrame(response.json())
df

Out[3]:

	name	description	url	dataset_id	last_update	last_update_precision
0	University of Minnesota River Segment Surface ...	This dataset provides surface area timeseries ...	https://data-catalog.mint.isi.edu/datasets/da6...	UMINNESOTA_AGGREGATE	2021-02-08T20:27:52	14

Get metadata about Aggregated dataset¶

GET /metadata/datasets/UMINNESOTA_AGGREGATE

In [4]:

url = f"{datamart_api_url}/metadata/datasets/UMINNESOTA_AGGREGATE"
response = get(url, auth=auth)
df = pd.DataFrame(response.json())
df

Out[4]:

	name	description	url	dataset_id	last_update	last_update_precision
0	University of Minnesota River Segment Surface ...	This dataset provides surface area timeseries ...	https://data-catalog.mint.isi.edu/datasets/da6...	UMINNESOTA_AGGREGATE	2021-02-08T20:27:52	14

Get variables for the dataset (Only area is available)¶

GET /metadata/datasets/UMINNESOTA_AGGREGATE/variables

In [5]:

url = f"{datamart_api_url}/metadata/datasets/UMINNESOTA_AGGREGATE/variables"
response = get(url, auth=auth)
print(json.dumps(response.json(), indent=2))

[
  {
    "name": "area",
    "variable_id": "area",
    "description": "area occupied by an object",
    "corresponds_to_property": "P2046",
    "qualifier": [
      {
        "name": "point in time",
        "identifier": "P585"
      },
      {
        "name": "stated in",
        "identifier": "P248"
      }
    ]
  }
]

Get complete timeseries data¶

GET /datasets/UMINNESOTA_AGGREGATE/variables/area

In [6]:

url = f"{datamart_api_url}/datasets/UMINNESOTA_AGGREGATE/variables/area"
response = get(url, auth=auth)
df = pd.read_csv(StringIO(response.text))
display(HTML(df.fillna('').head(20).to_html(index=False)))

dataset_id	variable_id	variable	main_subject	main_subject_id	value	time	time_precision	country	country_id	admin1	admin2	admin3
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.890742	2015-09-03T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	3.199364	2015-10-03T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.291919	2015-10-20T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	2.815357	2015-10-23T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	2.550545	2015-11-12T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	2.101641	2015-11-22T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.043004	2015-11-29T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.008762	2015-12-09T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	1.404479	2015-12-22T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.016544	2015-12-29T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	1.044410	2016-01-01T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.017962	2016-01-08T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	1.024617	2016-01-11T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.000471	2016-01-18T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.987476	2016-01-21T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.973092	2016-01-31T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.000047	2016-03-08T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.667883	2016-03-11T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.679573	2016-03-21T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.555958	2016-04-10T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede

Get timeseries data for Oromia Region¶

GET /datasets/UMINNESOTA_AGGREGATE/variables/area?admin1=Oromia%20Region

In [7]:

url = f"{datamart_api_url}/datasets/UMINNESOTA_AGGREGATE/variables/area?admin1=Oromia%20Region"
response = get(url, auth=auth)
df = pd.read_csv(StringIO(response.text))
display(HTML(df.fillna('').head(20).to_html(index=False)))

dataset_id	variable_id	variable	main_subject	main_subject_id	value	time	time_precision	country	country_id	admin1	admin2	admin3
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	1.717146	2015-11-16T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	1.709987	2015-11-26T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	1.946228	2015-12-06T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	1.256033	2015-12-16T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	1.246286	2016-01-05T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	1.732435	2016-01-25T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	1.537135	2016-02-14T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	0.038018	2016-02-24T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	1.044107	2016-03-15T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	0.384933	2016-03-25T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	0.162296	2016-04-04T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	0.082511	2016-04-14T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	0.141154	2016-04-24T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	1.128079	2016-05-04T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	1.196033	2016-05-14T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	1.849900	2016-05-24T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	1.662880	2016-06-13T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	0.135097	2016-06-23T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	1.150687	2016-07-03T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset
UMINNESOTA_AGGREGATE	area	area	Boset	Q2422429	1.276699	2016-07-13T00:00:00Z	day	Ethiopia	Q115	Oromia Region	Misraq Shewa Zone	Boset

Get timeseries data for Tsegede woreda¶

GET /datasets/UMINNESOTA_AGGREGATE/variables/area?admin3=Tsegede

In [8]:

url = f"{datamart_api_url}/datasets/UMINNESOTA_AGGREGATE/variables/area?admin3=Tsegede"
response = get(url, auth=auth)
df = pd.read_csv(StringIO(response.text))
display(HTML(df.fillna('').head(20).to_html(index=False)))

dataset_id	variable_id	variable	main_subject	main_subject_id	value	time	time_precision	country	country_id	admin1	admin2	admin3
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.890742	2015-09-03T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	3.199364	2015-10-03T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.291919	2015-10-20T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	2.815357	2015-10-23T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	2.550545	2015-11-12T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	2.101641	2015-11-22T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.043004	2015-11-29T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.008762	2015-12-09T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	1.404479	2015-12-22T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.016544	2015-12-29T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	1.044410	2016-01-01T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.017962	2016-01-08T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	1.024617	2016-01-11T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.000471	2016-01-18T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.987476	2016-01-21T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.973092	2016-01-31T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.000047	2016-03-08T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.667883	2016-03-11T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.679573	2016-03-21T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede
UMINNESOTA_AGGREGATE	area	area	Tsegede	Q1445950	0.555958	2016-04-10T00:00:00Z	day	Ethiopia	Q115	Tigray Region	Mi'irabawi Zone	Tsegede