Notebook

Verify release¶

This notebook is to help committers automatically verify a Sedona release and cast their votes.

In [9]:

import os

PATH="../"
SEDONA_CURRENT_VERSION="1.3.1-incubating"

Import the public keys of existing release managers¶

You should see a >0 number in the "Total number processed: " below.

In [10]:

os.system("gpg --import " + PATH + "KEYS")

gpg: key 3A79A47AC26FF4CD: "Jia Yu <jiayu@apache.org>" not changed
gpg: key 6C883CA80E7FD299: "PawelKocinski <imbruced@apache.org>" not changed
gpg: key 8B504ED095522E76: "Kanchan Chowdhury <kanchanchy@apache.org>" not changed
gpg: key CD1626B04F876FB0: "Mo Sarwat <mosarwat@apache.org>" not changed
gpg: Total number processed: 4
gpg:              unchanged: 4

Out[10]:

1. Verify the signature¶

You should see two "Good signature from" below.

In [11]:

os.system("gpg --verify " + PATH + "apache-sedona-" + SEDONA_CURRENT_VERSION +"-src.tar.gz.asc")
os.system("gpg --verify " + PATH + "apache-sedona-" + SEDONA_CURRENT_VERSION +"-bin.tar.gz.asc")

gpg: assuming signed data in '../apache-sedona-1.3.1-incubating-src.tar.gz'
gpg: Signature made Mon 12 Dec 2022 09:25:46 AM UTC
gpg:                using RSA key 9918351F1EE867E42017EA833A79A47AC26FF4CD
gpg: Good signature from "Jia Yu <jiayu@apache.org>" [unknown]
gpg: WARNING: This key is not certified with a trusted signature!
gpg:          There is no indication that the signature belongs to the owner.
Primary key fingerprint: 9918 351F 1EE8 67E4 2017  EA83 3A79 A47A C26F F4CD
gpg: assuming signed data in '../apache-sedona-1.3.1-incubating-bin.tar.gz'
gpg: Signature made Mon 12 Dec 2022 09:19:15 AM UTC
gpg:                using RSA key 9918351F1EE867E42017EA833A79A47AC26FF4CD
gpg: Good signature from "Jia Yu <jiayu@apache.org>" [unknown]
gpg: WARNING: This key is not certified with a trusted signature!
gpg:          There is no indication that the signature belongs to the owner.
Primary key fingerprint: 9918 351F 1EE8 67E4 2017  EA83 3A79 A47A C26F F4CD

Out[11]:

2.1 Verify the checksum of source code¶

You should see two identical hex codes in the two lines below.

In [12]:

os.system("shasum -a 512 " + PATH +"apache-sedona-" + SEDONA_CURRENT_VERSION + "-src.tar.gz")
os.system("cat " + PATH + "apache-sedona-" + SEDONA_CURRENT_VERSION + "-src.tar.gz.sha512")

6402f5f71f7b5e79e73034ac79590f9fcb4398d0ae7aa2eb547e4a5b0cec835b0c1afc317b0d24e3bcf31ae481e1bfaa46e24097b33801e92f0ccdeaff31695b  ../apache-sedona-1.3.1-incubating-src.tar.gz
6402f5f71f7b5e79e73034ac79590f9fcb4398d0ae7aa2eb547e4a5b0cec835b0c1afc317b0d24e3bcf31ae481e1bfaa46e24097b33801e92f0ccdeaff31695b  apache-sedona-1.3.1-incubating-src.tar.gz

Out[12]:

2.2 Verify the checksum of binary code¶

You should see two identical hex codes in the two lines below.

In [13]:

os.system("shasum -a 512 " + PATH +"apache-sedona-" + SEDONA_CURRENT_VERSION + "-bin.tar.gz")
os.system("cat " + PATH + "apache-sedona-" + SEDONA_CURRENT_VERSION + "-bin.tar.gz.sha512")

70f32d796e3e74160f1edd4f82803be0830841e49292b1562b2d79ff193dc27e56cca37548525c447b16118486a691902f42a3ed972c745f7a525e16b8089c3b  ../apache-sedona-1.3.1-incubating-bin.tar.gz
70f32d796e3e74160f1edd4f82803be0830841e49292b1562b2d79ff193dc27e56cca37548525c447b16118486a691902f42a3ed972c745f7a525e16b8089c3b  apache-sedona-1.3.1-incubating-bin.tar.gz

Out[13]:

3.1 Check if the DISCLAIMER is in place¶

You should see the content of the DISCLAMER file

In [14]:

os.system("cat " + PATH + "apache-sedona-" + SEDONA_CURRENT_VERSION + "-src/DISCLAIMER")

Apache Sedona is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.

Out[14]:

3.2 Check if the NOTICE is in place¶

You should see the content of the NOTICE file

In [15]:

os.system("cat " + PATH + "apache-sedona-" + SEDONA_CURRENT_VERSION + "-src/NOTICE")

Apache Sedona (incubating)
Copyright 2020-2022 The Apache Software Foundation

This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).



GeoSpark development team
Copyright 2015-2020

This product was derived from the GeoSpark project.

Out[15]:

4. Compile the source code¶

You should see "BUILD SUCCESS" after running the last command. This will take about 5 minutes to finish and print lots of output. Please scroll down to the bottom of this notebook.

Cast your vote in the voting email¶

If you have seen all required content, you can cast your +1 vote as follows:

+1

I checked:
* Download links are valid
* Checksums and PGP signatures are valid
* DISCLAIMER and NOTICE are included
* Source code artifacts have correct names matching the current release
* The project can compile from the source code

In [ ]:

os.system("(cd " + PATH + "apache-sedona-" + SEDONA_CURRENT_VERSION + "-src;mvn clean install -DskipTests)")

[INFO] Scanning for projects...
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for org.apache.sedona:sedona-core-3.0_2.12:jar:1.3.1-incubating
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.sedona:sedona-core-${spark.compat.version}_${scala.compat.version}:[unknown-version], /home/jovyan/apache-sedona-1.3.1-incubating-src/core/pom.xml, line 28, column 17
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for org.apache.sedona:sedona-sql-3.0_2.12:jar:1.3.1-incubating
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.sedona:sedona-sql-${spark.compat.version}_${scala.compat.version}:[unknown-version], /home/jovyan/apache-sedona-1.3.1-incubating-src/sql/pom.xml, line 28, column 14
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for org.apache.sedona:sedona-viz-3.0_2.12:jar:1.3.1-incubating
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.sedona:sedona-viz-${spark.compat.version}_${scala.compat.version}:[unknown-version], /home/jovyan/apache-sedona-1.3.1-incubating-src/viz/pom.xml, line 28, column 14
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for org.apache.sedona:sedona-python-adapter-3.0_2.12:jar:1.3.1-incubating
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.sedona:sedona-python-adapter-${spark.compat.version}_${scala.compat.version}:[unknown-version], /home/jovyan/apache-sedona-1.3.1-incubating-src/python-adapter/pom.xml, line 27, column 17
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for org.apache.sedona:sedona-flink_2.12:jar:1.3.1-incubating
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.sedona:sedona-flink_${scala.compat.version}:[unknown-version], /home/jovyan/apache-sedona-1.3.1-incubating-src/flink/pom.xml, line 28, column 14
[WARNING] 
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING] 
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING] 
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO] 
[INFO] sedona-parent                                                      [pom]
[INFO] org.apache.sedona:sedona-common                                    [jar]
[INFO] org.apache.sedona:sedona-core-3.0_2.12                             [jar]
[INFO] org.apache.sedona:sedona-sql-3.0_2.12                              [jar]
[INFO] org.apache.sedona:sedona-viz-3.0_2.12                              [jar]
[INFO] org.apache.sedona:sedona-python-adapter-3.0_2.12                   [jar]
[INFO] org.apache.sedona:sedona-flink_2.12                                [jar]
[INFO] 
[INFO] ------------------< org.apache.sedona:sedona-parent >-------------------
[INFO] Building sedona-parent 1.3.1-incubating                            [1/7]
[INFO] --------------------------------[ pom ]---------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:3.1.0:clean (default-clean) @ sedona-parent ---
[INFO] Deleting /home/jovyan/apache-sedona-1.3.1-incubating-src/target
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-maven-version) @ sedona-parent ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.7.0:process (process-resource-bundles) @ sedona-parent ---
[INFO] Preparing remote bundle org.apache:apache-jar-resource-bundle:1.4
[INFO] Copying 3 resources from 1 bundle.
[INFO] 
[INFO] --- scala-maven-plugin:3.2.1:add-source (scala-compile-first) @ sedona-parent ---
[INFO] Add Source directory: /home/jovyan/apache-sedona-1.3.1-incubating-src/src/main/scala
[INFO] Add Test Source directory: /home/jovyan/apache-sedona-1.3.1-incubating-src/src/test/scala
[INFO] 
[INFO] --- scala-maven-plugin:3.2.1:compile (scala-compile-first) @ sedona-parent ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-compiler-plugin:3.10.1:compile (default) @ sedona-parent ---
[INFO] No sources to compile
[INFO] 
[INFO] --- scala-maven-plugin:3.2.1:testCompile (scala-test-compile) @ sedona-parent ---
[INFO] No sources to compile
[INFO] 
[INFO] --- scalatest-maven-plugin:2.2.0:test (test) @ sedona-parent ---
[INFO] ScalaTest report directory: /home/jovyan/apache-sedona-1.3.1-incubating-src/target/surefire-reports
[INFO] Tests are skipped.
[INFO] 
[INFO] --- resolved-pom-maven-plugin:1.0:resolve-pom (resolve-my-pom) @ sedona-parent ---
[INFO] Filtering pom at /home/jovyan/apache-sedona-1.3.1-incubating-src/pom.xml to /home/jovyan/apache-sedona-1.3.1-incubating-src/target/resolved-pom.xml
[INFO] Filtered pom to /home/jovyan/apache-sedona-1.3.1-incubating-src/target/resolved-pom.xml
[INFO] 
[INFO] --- maven-site-plugin:3.7.1:attach-descriptor (attach-descriptor) @ sedona-parent ---
[INFO] No site descriptor found: nothing to attach.
[INFO] 
[INFO] >>> scala-maven-plugin:3.2.1:doc-jar (attach-javadocs) > generate-sources @ sedona-parent >>>
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-maven-version) @ sedona-parent ---
[INFO] 
[INFO] <<< scala-maven-plugin:3.2.1:doc-jar (attach-javadocs) < generate-sources @ sedona-parent <<<
[INFO] 
[INFO] 
[INFO] --- scala-maven-plugin:3.2.1:doc-jar (attach-javadocs) @ sedona-parent ---
[INFO] No source files found
[INFO] 
[INFO] --- maven-shade-plugin:2.1:shade (default) @ sedona-parent ---
[INFO] No artifact matching filter edu.ucar:cdm-core
[INFO] Replacing original artifact with shaded artifact.
[INFO] 
[INFO] --- maven-javadoc-plugin:2.10.4:jar (attach-javadocs) @ sedona-parent ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable package
[INFO] 
[INFO] --- checksum-maven-plugin:1.9:artifacts (default) @ sedona-parent ---
[INFO] 
[INFO] --- maven-install-plugin:2.5.2:install (default-install) @ sedona-parent ---
[INFO] Installing /home/jovyan/apache-sedona-1.3.1-incubating-src/target/resolved-pom.xml to /home/jovyan/.m2/repository/org/apache/sedona/sedona-parent/1.3.1-incubating/sedona-parent-1.3.1-incubating.pom
[INFO] Installing /home/jovyan/apache-sedona-1.3.1-incubating-src/target/resolved-pom.xml to /home/jovyan/.m2/repository/org/apache/sedona/sedona-parent/1.3.1-incubating/sedona-parent-1.3.1-incubating.pom
[INFO] 
[INFO] ------------------< org.apache.sedona:sedona-common >-------------------
[INFO] Building org.apache.sedona:sedona-common 1.3.1-incubating          [2/7]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:3.1.0:clean (default-clean) @ sedona-common ---
[INFO] Deleting /home/jovyan/apache-sedona-1.3.1-incubating-src/common/target
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-maven-version) @ sedona-common ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.7.0:process (process-resource-bundles) @ sedona-common ---
[INFO] Preparing remote bundle org.apache:apache-jar-resource-bundle:1.4
[INFO] Copying 3 resources from 1 bundle.
[INFO] 
[INFO] --- maven-resources-plugin:3.1.0:resources (default-resources) @ sedona-common ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jovyan/apache-sedona-1.3.1-incubating-src/common/src/main/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- scala-maven-plugin:3.2.1:add-source (scala-compile-first) @ sedona-common ---
[INFO] Add Source directory: /home/jovyan/apache-sedona-1.3.1-incubating-src/common/src/main/scala
[INFO] Add Test Source directory: /home/jovyan/apache-sedona-1.3.1-incubating-src/common/src/test/scala
[INFO] 
[INFO] --- scala-maven-plugin:3.2.1:compile (scala-compile-first) @ sedona-common ---
[INFO] /home/jovyan/apache-sedona-1.3.1-incubating-src/common/src/main/java:-1: info: compiling
[INFO] Compiling 7 source files to /home/jovyan/apache-sedona-1.3.1-incubating-src/common/target/classes at 1670841513818
[INFO] prepare-compile in 0 s
[INFO] compile in 6 s
[INFO] 
[INFO] --- maven-compiler-plugin:3.10.1:compile (default-compile) @ sedona-common ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 7 source files to /home/jovyan/apache-sedona-1.3.1-incubating-src/common/target/classes
[INFO] /home/jovyan/apache-sedona-1.3.1-incubating-src/common/src/main/java/org/apache/sedona/common/utils/GeomUtils.java: /home/jovyan/apache-sedona-1.3.1-incubating-src/common/src/main/java/org/apache/sedona/common/utils/GeomUtils.java uses unchecked or unsafe operations.
[INFO] /home/jovyan/apache-sedona-1.3.1-incubating-src/common/src/main/java/org/apache/sedona/common/utils/GeomUtils.java: Recompile with -Xlint:unchecked for details.
[INFO] 
[INFO] --- maven-compiler-plugin:3.10.1:compile (default) @ sedona-common ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 7 source files to /home/jovyan/apache-sedona-1.3.1-incubating-src/common/target/classes
[INFO] /home/jovyan/apache-sedona-1.3.1-incubating-src/common/src/main/java/org/apache/sedona/common/utils/GeomUtils.java: /home/jovyan/apache-sedona-1.3.1-incubating-src/common/src/main/java/org/apache/sedona/common/utils/GeomUtils.java uses unchecked or unsafe operations.
[INFO] /home/jovyan/apache-sedona-1.3.1-incubating-src/common/src/main/java/org/apache/sedona/common/utils/GeomUtils.java: Recompile with -Xlint:unchecked for details.
[INFO] 
[INFO] --- maven-resources-plugin:3.1.0:testResources (default-testResources) @ sedona-common ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jovyan/apache-sedona-1.3.1-incubating-src/common/src/test/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- scala-maven-plugin:3.2.1:testCompile (scala-test-compile) @ sedona-common ---
[INFO] /home/jovyan/apache-sedona-1.3.1-incubating-src/common/src/test/java:-1: info: compiling
[INFO] Compiling 1 source files to /home/jovyan/apache-sedona-1.3.1-incubating-src/common/target/test-classes at 1670841524358