To demonstrate the use of the grid2op framework, we propose here to show how to make some quick studies on a purely fictious test case, a 5 bus system.
This system should not be used for deep research purpose. It is provided here as an example and a tool to get used to how some analyses can be performed using grid2op.
First, we can create a environment:
import grid2op
from tqdm.notebook import tqdm # for easy progress bar
from grid2op.Plot import Plotting
env = grid2op.make_new("rte_case5_example", test=True)
/home/donnotben/Documents/Grid2Op_dev/getting_started/grid2op/MakeEnv/MakeNew.py:205: UserWarning: You are using a development environment. This is really not recommended for training agents.
In grid2op, to make more concrete the powergrid, we also added some visual capabilities to represent, for example, the names of the objects on the grid, or the thermal limit, or any other data you want. All of that is for now only available in the matplotlib "plot helper" and can be accessed as followed.
This utility function allows you to visualize where are the object located on the map. Each object has its own color, and is represented with its name and its id (id starts at 0, following python convention).
display_mod = "matplotlib" # "plotly" "matplotlib", "pygame"
plot_helper = Plotting(env.observation_space, display_mod=display_mod)
_ = plot_helper.plot_layout()
/home/donnotben/Documents/Grid2Op_dev/getting_started/grid2op/Plot/Plotting.py:47: UserWarning: Matplotlib is currently using module://ipykernel.pylab.backend_inline, which is a non-GUI backend, so cannot show the figure.
It is, with the same method, also possible to visualize any data on the powergrid, for example, we can inspect the thermal limit (line property) as follow:
_ = plot_helper.plot_info(line_info=env._thermal_limit_a,
colormap="line")
The above plot can be improved. It has lots of useless informations for the purpose (all the names of the loads, generetors and substations). They can be remove simply with:
_ = plot_helper.plot_info(line_info=env._thermal_limit_a,
load_info=[None for el in range(env.n_load)],
gen_info=[None for el in range(env.n_gen)],
sub_info=[None for el in range(env.n_sub)],
colormap="line")
Similarly, it is possible to display some data about the generators, for example the maximum value of power they can produce.
_ = plot_helper.plot_info(line_info=[None for el in range(env.n_line)],
load_info=[None for el in range(env.n_load)],
gen_info=env.gen_pmax,
sub_info=[None for el in range(env.n_sub)],
colormap="gen")
Of course we can also project on the powergrid some information about the loads, for example their ID
_ = plot_helper.plot_info(line_info=[None for el in range(env.n_line)],
load_info=[el for el in range(env.n_load)],
gen_info=[None for el in range(env.n_gen)],
sub_info=[None for el in range(env.n_sub)],
colormap="load")
Now we can see how well the "do nothing" agent (the most basic imaginable) can performe, using some "gym like" methods
from grid2op.Agent import DoNothingAgent
my_agent = DoNothingAgent(env.action_space)
Now do the standard gym loop, and we save all the observations:
all_obs = []
obs = env.reset()
all_obs.append(obs)
reward = env.reward_range[0]
done = False
nb_step = 0
with tqdm(total=env.chronics_handler.max_timestep()) as pbar:
while True:
action = my_agent.act(obs, reward, done)
obs, reward, done, _ = env.step(action)
pbar.update(1)
if done:
break
all_obs.append(obs)
nb_step += 1
HBox(children=(FloatProgress(value=0.0, max=2016.0), HTML(value='')))
We can check if the episode has been completed, or if there has been a game over:
print("Number of timesteps computed: {}".format(nb_step))
print("Total maximum number of timesteps possible: {}".format(env.chronics_handler.max_timestep()))
Number of timesteps computed: 94 Total maximum number of timesteps possible: 2016
As we see here, there is a game over: the agent successfully managed 94 timesteps, while the episode could have lasted 2016.
Let's try to investigate this, for example by plotting the last observation. First we need to create a utilities that will make the plot:
last_obs = all_obs[-1]
_ = plot_helper.plot_obs(last_obs)
/home/donnotben/Documents/Grid2Op_dev/getting_started/grid2op/Plot/Plotting.py:47: UserWarning: Matplotlib is currently using module://ipykernel.pylab.backend_inline, which is a non-GUI backend, so cannot show the figure.
As we can see, the last obsevation is pretty clear: 4 powerlines have been disconnected, thus isolating the load on the bottom right. This lead to a game over.
It's also possible, of course, to inspect the previous state, just before this one:
previous_obs = all_obs[-2]
_ = plot_helper.plot_obs(previous_obs)
And now we can know the cause for this problem: all the powerlines that could provide power on the bottom right load are overloaded in this situation, so the protection worked and disconnect them to prevent hurting the surroundings.