HRRR Forecast Collection Best Time Series

Read a collection of GRIB2 files on AWS as a single dataset using the Zarr library, via fsspec's ReferenceFileSystem. This notebook also demonstrates both how to generate the JSON file that fsspec uses, speeding up extracting the metadata from each GRIB2 file using Reference File Maker with a Dask Cluster.
Requires development version of fsspec_reference_maker

  • pip install --user git+https://github.com/intake/fsspec-reference-maker
In [1]:
import xarray as xr
import hvplot.xarray
import datetime as dt
import pandas as pd
import dask
import panel as pn
import json
import fsspec
from fsspec_reference_maker.grib2 import scan_grib
from fsspec_reference_maker.combine import MultiZarrToZarr