Time series: Main Notebook
This Notebook is part of the Household Data Package of Open Power System Data.

1. About Open Power System Data

This notebook is part of the project Open Power System Data. Open Power System Data develops a platform for free and open data for electricity system modeling. We collect, check, process, document, and provide data that are publicly available but currently inconvenient to use. More info on Open Power System Data:

2. About Jupyter Notebooks and GitHub

This file is a Jupyter Notebook. A Jupyter Notebook is a file that combines executable programming code with visualizations and comments in markdown format, allowing for an intuitive documentation of the code. We use Jupyter Notebooks for combined coding and documentation. We use Python 3 as programming language. All Notebooks are stored on GitHub, a platform for software development, and are publicly available. More information on our IT-concept can be found here. See also our step-by-step manual how to use the dataplatform.

3. About CoSSMic

All time series were collected during the course of the European CoSSMic project from October 2013 to December 2016.

CoSSMic stands for Collaborating Smart Solar-powered Microgrids. The consortium addressed the coupling of solar panels with smart energy sharing solutions and storage capabilities, while researching a decentralized, agent-based model approach, to optimize the potentials to exchange energy inside small communities. The complete CoSSMic Mission Statement may provide further insight.

To test these concepts and ideas, CoSSMic contacted local business owners, residents and administrators of public buildings in Konstanz (Germany) and Caserta (Italy), to deploy and iteratively improve developed open-source measuring and control systems and collect hands-on information about specific device and user consumption behaviours.

4. About this data package

We provide data in different chunks, or datap ackages. The one you are looking at right now, household_data, contains scripts to create time series data of detailed household consumption and generation. It includes data of small businesses, as well as private households, in a resolution up to single device consumptions.

All available data feeds consist of the actually transmitted energy value in kWh, already integrated in deployed MID-certified metering devices. The metering device keeps track of the cumulative power consumption/generation of the device. Hence, even though there are some data gaps due to communication outages, the overall energy consumption/generation is retained.

Each household includes data about their grid import/export, with some having decentral energy generation through installed Photovoltaic (PV) systems. Though further pv generation, batteries, electric vehicles or other appliances are available only for certain households, the overall dataset contains load information according to the following naming conventions:

  • grid_import: Energy imported from the public grid
  • grid_export: Energy exported to the public grid
  • consumption: Total household energy consumption
    (Note: This is different from grid_import, if a Photovoltaic system with a single, bidirectional household meter is installed. For many households with feed-in tariffs, this additional feed is unnecessary, as all generated energy is exported into the grid, while all consumed energy is imported from the grid)
  • pv: Total Photovoltaic energy generation
  • ev: Electric Vehicle charging energy
  • storage_charge: Battery charging energy
  • storage_discharge: Battery discharged energy
  • heat_pump: Heat pump energy consumption
  • circulation_pump: Circulation pump energy consumption, circulating the heated water of e.g. boilers
  • air_conditioning: Air conditioning energy consumption
  • ventilation: Ventilation energy consumption
  • dishwasher: Dishwasher energy consumption
  • washing_machine: Washing machine energy consumption
  • refrigerator: Refrigerator energy consumption
  • freezer: Freezer energy consumption
  • cooling_aggregate: Cooling aggregate energy consumption
  • facility: Energy consumption of an industrial- or research-facility
  • area: Energy consumption of an area, consisting of several smaller loads

This data package contains the measurements of the German trial site in Konstanz, but packages from the italian site may follow in the future. The time series become available at different points in time and contain short outages depending on the sources. The most complete dataset is available from February 2016. The data has been downloaded from the households, resampled and merged in large CSV files in its initially conducted 3-minute intervals, as well as later on in 1-minute intervals. Additionally, data in 15 and 60-minute resolution is provided for compatibility with other time series data.

5. Data sources

The data sources are backups from the trial site household systems of the CoSSMic project. With the decentralized approach of CoSSMic, each household stored their own data locally, by running an emoncms webserver on a Raspberry Pi. Emoncms is a powerful open-source web-app for processing, logging and visualizing energy, temperature and other environmental data and was used as a mediator between all drivers and services. A complete list of data sources is provided on the data package information website. They are also contained in the JSON file that contains all metadata.

6. License

This notebook as well as all other documents in this repository is published under the MIT License.