CVE¶

Common Vulnerabilities and Exposures Identifier (CVE ID) is a unique, alphanumeric identifier assigned by the CVE Program. Each identifier references a specific vulnerability. A CVE ID enables automation and multiple parties to discuss, share, and correlate information about a specific vulnerability, knowing they are referring to the same thing

source: www.cve.org

You can see this notebook directly via:

Generation time¶

In [1]:

from datetime import datetime, timezone, timedelta

timezone_offset = 0.0
tzinfo = timezone(timedelta(hours=timezone_offset))
generation_time = datetime.now(tzinfo).strftime('%Y-%m-%d %H:%M:%S %z')
print(generation_time)

2024-04-16 05:31:46 +0000

Creative Commons¶

This notebook and generated diagrams are released with Creative Commons liecense (CC BY 4.0).

In [2]:

import requests
import urllib3

urllib3.disable_warnings()

urls = ['https://mirrors.creativecommons.org/presskit/icons/cc.xlarge.png',
       'https://mirrors.creativecommons.org/presskit/icons/by.xlarge.png']
for url in urls:
    file_name = url.split("/")[-1:][0]
    print(file_name)

    file = requests.get(url, verify=False)
    open(file_name, 'wb').write(file.content)

cc.xlarge.png
by.xlarge.png

CVE data downloading¶

All CVE IDs are taken from cve.mitre.org/data/downloads/index.html

In [3]:

url = 'https://cve.mitre.org/data/downloads/allitems.xml.Z'
file_name = url.split("/")[-1:][0]
print(file_name)

allitems.xml.Z

In [4]:

import requests
import urllib3

urllib3.disable_warnings()

file = requests.get(url, verify=False)
open(file_name, 'wb').write(file.content)

Out[4]:

69886215

In [5]:

import unlzw3
from pathlib import Path

uncompressed_data = unlzw3.unlzw(Path(file_name))

In [6]:

with open(file_name[:-2], 'wb') as file:
    file.write(uncompressed_data)

In [7]:

import glob

file_name = glob.glob('*.xml')[-1]
print(file_name)

allitems.xml

CVE data parsing¶

In [8]:

import pandas as pd 
import xml.etree.ElementTree as et 

tree = et.parse(file_name)
root = tree.getroot()
df_cols = ["number", "year"]
rows = []

for item in root:
    item_name = item.attrib.get("name")
    item_year = item_name[4:8]
    rows.append({"number": item_name, "year": item_year})

df = pd.DataFrame(rows, columns = df_cols)

print(df)

                number  year
0        CVE-1999-0001  1999
1        CVE-1999-0002  1999
2        CVE-1999-0003  1999
3        CVE-1999-0004  1999
4        CVE-1999-0005  1999
...                ...   ...
311256  CVE-2024-30266  2024
311257  CVE-2024-30267  2024
311258  CVE-2024-30268  2024
311259  CVE-2024-30269  2024
311260  CVE-2024-30270  2024

[311261 rows x 2 columns]

In [9]:

df = df.groupby(['year'], as_index=False)[['number']].count()
df.reset_index(drop=True, inplace=True)
df.index += 1

df.style.bar(subset=['number'], color='#FF6200')

Out[9]:

	year	number
1	1999	1579
2	2000	1243
3	2001	1573
4	2002	2436
5	2003	1603
6	2004	2779
7	2005	4901
8	2006	7256
9	2007	6767
10	2008	7325
11	2009	5164
12	2010	5351
13	2011	5341
14	2012	6739
15	2013	7525
16	2014	10562
17	2015	9706
18	2016	11367
19	2017	19574
20	2018	21931
21	2019	21615
22	2020	31397
23	2021	31034
24	2022	33547
25	2023	39863
26	2024	13083

CVE data saving¶

CSV file is available in GitHub repository, see:

In [10]:

csv_filename = 'cve-number-of-entries.csv'

df.to_csv(csv_filename, index=False)

CVE data ploting¶

PNG files are available in GitHub repository with two background versions, see:

In [11]:

import pandas as pd
import matplotlib.pyplot as plt
import datetime

df = pd.read_csv(csv_filename)

df.plot(x='year', 
        xlabel='Year',
        y='number', 
        ylabel='Number of CVE',
        kind='bar', 
        title='Number of CVE per year')
plt.tight_layout()
plt.legend(['CVE'])
plt.figtext(0.15, 0.02, f"Generated on {generation_time} thanks to limberduck.org based on source: cve.mitre.org", ha="left", fontsize=7)
fig = plt.gcf()
fig.set_size_inches(10,6)
fig.patch.set_facecolor('white')
plt.grid(True)

img_cc = plt.imread('cc.xlarge.png')
newax_cc = fig.add_axes([0.88, 0.0, 0.05, 0.05], anchor='NE', zorder=-1)
newax_cc.imshow(img_cc)
newax_cc.axis('off')
img_by = plt.imread('by.xlarge.png')
newax_by = fig.add_axes([0.92, 0.0, 0.05, 0.05], anchor='NE', zorder=-1)
newax_by.imshow(img_by)
newax_by.axis('off')

plt.savefig('cve-number-of-entries-bg-white.png', dpi = 300, facecolor = 'white')
plt.savefig('cve-number-of-entries-bg-transparent.png', dpi = 300, transparent = True)