Remove gbp csit jobs and packer images

These jobs are all disabled and the project has been inactive since end
of 2019. Let's remove the CSIT jobs which in turn allows us to remove
the package images that are unmaintained.

Issue: RELENG-154
Change-Id: Ic17d656755670f7b21eb2ac7353aa85e64690743
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Update cloud image

Job: builder-openstack-update-cloud-image/163
Change-Id: I66653b196a1101e08bfa8babeed36cec0a1530c1
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Merge "Update cloud image Ubuntu16.04 mininet ovs"

Merge "Update cloud image CentOS7 builder x86_64"

Merge "Update cloud image Ubuntu18.04 mininet ovs"

Merge "Update cloud image CentOS7 robot x86_64"

Merge "Update python3 pip packages"

Update python3 pip packages

Signed-off-by: Srinivas Rachakonda <srinivas.rachakonda@gmail.com>
Change-Id: Ic8a85901b6bef5d4e207aa9501c58200716ecc51

Update cloud image CentOS7 robot x86_64

Job: builder-openstack-update-cloud-image/162
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>
Change-Id: I303703e127f495ebee8797a7e196587866cc39a5

Merge "Update cloud image CentOS7 robot x86_64"

Merge "Update cloud image CentOS8 builder x86_64"

Bump version of conf.yaml file

When branch cutting we not only need to bump pom.xml file versions but
we also need to bump conf.yaml file versions for all projects.

Issue: DOCS-129
Change-Id: I0aa6838d1fd4e2df536a4e30fb8751b7d3a466bf
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Fix commit msg to version correctly on bump

When version bump when branch cutting we want to bump by x.(y+1).z
and when performing a release bump we want to bump by x.y.(z+1)
however the current code always sets the message to "Bump version by
x.y.(z+1)" regardless of what kind of bump it was.

Change-Id: Ic88946b61f9381792c5c61190530d5d8b35e03ee
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Update cloud image Ubuntu18.04 mininet ovs

Job: builder-openstack-update-cloud-image/161
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>
Change-Id: I77c9ac3bab957df615f3a9f7ea33235a32528d78

Stream silicon should be silicon csit list

When we branch cut the jobs looks like we missed this one spot where
silicon csit list was not updated to silicon and still pointed to
aluminium.

Change-Id: If4c138e73d6ab281a82419e7520a714825b64bcc
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Update cloud image CentOS7 devstack stein

Job: builder-openstack-update-cloud-image/160
Change-Id: Idce2953cf17e7069acfe6ba2a9aee1df8863991d
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Update cloud image Ubuntu16.04 mininet ovs

Job: builder-openstack-update-cloud-image/159
Change-Id: I2567c0e63bb889e68646ea8a0f73c2666eb95a54
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Update cloud image CentOS7 builder x86_64

Job: builder-openstack-update-cloud-image/157
Change-Id: Iac9f8f69a8e518482a1e3849627ea0851bb67200
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Update cloud image CentOS7 devstack rocky

Job: builder-openstack-update-cloud-image/155
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>
Change-Id: I128556900ac347d3df650ac062c148446b9428d8

Merge "Update cloud image list docs"

Merge "Update global-jjb to the latest v0.56.0"

Update global-jjb to the latest v0.56.0

Change-Id: Ib30dedb84712d2a171fd15ee7133d175282941f8
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Add prettier for auto formatting

It appears that we inconsistently use 2 and 4 space indents for YAML
however 2 space indents appear to be the dominant one in practice so
set config to that so that the least amount of changes happen when
prettier is applied.

This patch is also a preparation patch for RELENG-152 as the automation
we want to add for managing JJB updates when branch cutting requires
a consistent formatting of the YAML files so that auto-generated output
can match appropriately with minimal formatting changes.

Issue: RELENG-152
Change-Id: Ie35521de0378b7892f06ff7f36d470847c78989f
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Auto-generated patches to resolve prettier / yamllint

This is an auto-generated patch to handle prettier and yamllint rules.
Please refer to the next patch that handles adding the prettier linter
for the code behind this. Also update the .yamllint rules in
preparation for prettier inclusion.

Both patches should be merged together.

Issue: RELENG-152
Change-Id: Icbc11e7ee634c3e07941afe2b0d754f167e5c80c
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Setup pre-commit hooks for Python code

This sets up pre-commit hooks for the Python projects that are in this
repo. This also resolves any lint issues in existing files.

Change-Id: If5f8fba811759f6cbe44f04a1fbf1ce400a2ead7
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Update cloud image list docs

Job: builder-update-image-list/937
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>
Change-Id: Ief09a556340f669328b398a9cd65c9d6e78ec323

Auto Update CSIT Jobs to run for silicon

Job: integration-update-csit-tests-silicon/11
Change-Id: I57234b20a0772fa8688e8d562538d30e1b9bf510
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Merge "Split out release-merge job to separate project"

Merge "Fix cloud-images.rst generation script"

Merge "Add a 4c-4g docker system for ansible roles"

Update cloud image CentOS8 builder x86_64

Job: builder-openstack-update-cloud-image/153
Change-Id: I073bf3e691249dac1d2f14b50827f4374817ffe9
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Update cloud image CentOS7 robot x86_64

Job: builder-openstack-update-cloud-image/151
Change-Id: I6af7aece23188fd7e03258232fe5404ad168c567
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Add a 4c-4g docker system for ansible roles

The LF ansible role jobs are running real Docker builds as tests now
and the systems need to test more image types in parallel which means
they can use more CPU and RAM to improve their build times.

Change-Id: I75796cb2faadc136e4fde31223fb223c64b53882
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Auto-format INFO.yaml with prettier

This is a preparation patch for enabling prettier to auto-format YAML
files in the releng/builder project.

Issue: INFRA-152
Change-Id: I4bb890038159c0e1639af93b81e0e965c6eee60c
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Merge "Migrate write-good hook to pre-commit"

Migrate write-good hook to pre-commit

This migrates write-good hook over to pre-commit which is the final
hook needed to remove our coala dependency.

Also resolve write-good suggestions on files except jenkins.rst (it is
currently too large a task for my time so place an exception there until
we have cycles to take care of it).

Ref: https://jira.linuxfoundation.org/browse/RELENG-2642
Change-Id: I26b5a416d93ea69cbf319e14c138e971bcb4e6af
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Merge "Add CentOS8 images to the jenkins-config"

Add CentOS8 images to the jenkins-config

Change-Id: I9c99c0a5956db6afdd4173efbc17be479985d4ed
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix cloud-images.rst generation script

The script failed at some point back in April and generated an empty
list of cloud images that was not noticed until now. This patch fixes
that script so that we have documented supported images again.

The macro lf-infra-pre-build is able to install all the tools we need
for this job so utilize that rather than maintaining our own virtualenv
and openstack installation.

Issue: RELENG-153
Change-Id: I49c750e8051d605bf8526c73b6c8bd808f05a550
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Merge "Configure OpenJDK11 for jsonrpc-sonar job"

Configure OpenJDK11 for jsonrpc-sonar job

Signed-off-by: Richard Kosegi <richard.kosegi@gmail.com>
Change-Id: I8edb28ea834cd18c24997907db2e31d8b7375711

Update validate-ar jobs for aluminium

Job: autorelease-update-validate-jobs-aluminium/14
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>
Change-Id: I55a6855fe54b580a85a7441a4234b19ce537955a

Split out release-merge job to separate project

Split all of the release-merge jobs into a separate project definition.
This resolves issue where the branch cutting script is grabbing this
definition and copying it to the next release every time we do branch
cutting causing duplicate job definitions. Considering there can be
only a single release-merge job per-project it makes sense that it
has it's own separate project definition that is separate from jobs
that can have multiple streams and branches.

Also configure all the jobs to use a 2c-1g system (smallest available
system) considering that it's essentially a curl script that hits a
Nexus Rest API.

Change-Id: Id701e77ed9f1ba61f6d53e4d49869d0cf118306a
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Update validate-ar jobs for silicon

Job: autorelease-update-validate-jobs-silicon/1
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>
Change-Id: I070144c11515ce8192fd1d57461555fa4322a2ee

Merge "Add missing silicon jobs for distribution"

Merge "Update merge view job filter"

Add missing mvn-params for plastic sonar job

Issue: JSD IT-20364
Change-Id: Ib5fda076bd161ef2dafb1ce21b5ef042022b1ab1
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Add sonar job for odltools

Issue: JSD IT-20364
Change-Id: I5bcbeb209b90d0a2045a8eba0ef4014fff3ba95e
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Add sonar job for odlsaf

Issue: JSD IT-20364
Change-Id: Iffdd10fa7ad4f9b249579a7b34bde2c364d53d99
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Add sonar job for odlguice

Issue: JSD IT-20364
Change-Id: Ie6e21bdd17edfef7c512be043f6e7f9de8bce61b
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Add sonar job for odlmicro

Issue: JSD IT-20364
Change-Id: I9cde12a58cd94b0761df76afbe5a70aa9bd039b8
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Add missing silicon jobs for distribution

We missed one project section when updated the distribution jobs
for the aluminium branch cut.

Change-Id: I1d1c40e81c125735a19075f70a643a3214ef52d5
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Revert "Update cloud image"

This reverts commit 0d5a67dd8b26972a459b1295683b261cb9060ef7.

Change-Id: I419677e60a17640098cb980b747e72ded108a985
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Add autorelease silicon jobs

Change-Id: I24e0faa32f46f107d4852d32c2cac2ddd2016baa
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Update merge view job filter

Merge jobs are now in the form maven-merge since Magnesium so need
to adjust the filter parameters for it to pick up the appropriate
jobs.

Change-Id: Iccdceb3d1f44f6c51829bb7268a211901a0a4c39
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Branch cut for stable/aluminium stream

Change-Id: I7f671d7ec40e322a06bdffb838c51d72bc8f5c4b
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Merge "Updating the Python pip packages"

Merge "Move alt-datastores Sonar scan to Sonarcloud"

Merge "Move bgpcep Sonar scan to Sonarcloud"

Merge "Move unimgr Sonar scan to Sonarcloud"

Merge "Move transportpce Sonar scan to Sonarcloud"

Merge "Move telemetry Sonar scan to Sonarcloud"

Merge "Move openflowplugin Sonar scan to Sonarcloud"

Merge "Move p4plugin Sonar scan to Sonarcloud"

Merge "Move sfc Sonar scan to Sonarcloud"

Merge "Move lispflowmapping Sonar scan to Sonarcloud"

Merge "Move netvirt Sonar scan to Sonarcloud"

Merge "Move genius Sonar scan to Sonarcloud"

Merge "Move dlux Sonar scan to Sonarcloud"

Merge "Move detnet Sonar scan to Sonarcloud"

Merge "Move coe Sonar scan to Sonarcloud"

Merge "Move bier Sonar scan to Sonarcloud"

Merge "Move archetypes Sonar scan to Sonarcloud"

Merge "Move plastic Sonar scan to Sonarcloud"

Updating the Python pip packages

Signed-off-by: Srinivas Rachakonda <srinivas.rachakonda@gmail.com>
Change-Id: I672a188fb3a27fd55dbf08f99bedb42ae947046e

Update cloud image

Job: builder-openstack-update-cloud-image/148
Change-Id: Ia49789aca39ba1ec1b7824c5380bf2031b9c208b
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Add ODL CI Jobs for odlsaf project

Issue: JSD IT-20316
Change-Id: Ie73a868ed03ab6d773b756b1f9cde85094bc00d3
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Update common-packer to the latest 0.6.2

Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: Ifec050e8d089eea2ebd17ad20d37962bbbd7a3e8

Update the CentOS7 to the latest

The original commit 3a2c72c39cb465544382efca3d42b40400d78ee4
missed updating a few files.

Change-Id: Ia353d3f8a36dc46802f846d5b7f47fcb9dd0a9a2
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Upgrade CentOS7 image to the latest

Fixes broken shell check binary

Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: I8c7e47321c73624cb9d0bc63d2add8d2d01304b4

Fix shellcheck error

Fix a shellcheck error that was found while trying to get images updated

Change-Id: I754f4002fbad0ec09825d78c598721bd399fb774
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Upgrade CentOS7 image to the latest

Change-Id: I5078464b07b3e8cec1e5d9448febb142674376e0
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Update common-packer to the latest v0.6.1

Change-Id: I931888e9dd5c57b331f6ec1e95cda9aa550e0811
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Merge "Switch infrautils to being MRI"

Update validate-ar jobs for aluminium

Job: autorelease-update-validate-jobs-aluminium/12
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>
Change-Id: I0a3a1d392188b3d3bfe45188fe98b51dd2c19438

Switch infrautils to being MRI

infrautils is now a MRI project:
- use 'master' instead of 'aluminium' to keep job continuity
- remove infrautils-distribution-check-aluminium
- do not trigger distribution-merge in aluminium

Change-Id: Ibc7c9c288b17a2f1dc28d08ef6b6dab6836cb5c1
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Remove infrautils-javadocs

Infrautils is building its own javadoc package as part of its
build, remove javadoc jobs.

Change-Id: I2ad24cc0e17a402ffbeb23a4b81cdece6af157d2
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Merge "Revert "Build infrautils with maven-3.6""

Update common-packer to v0.6.0

This update includes installing the sigul client into the base
CentOS 7 image, so that it does not need to be downloaded each time
it is to be used.

Change-Id: Ia2c7c8975fc7ec755fde90b6a06c417b54504f3d
Issue-ID: LF-Jira IT-20204
Signed-off-by: Eric Ball <eball@linuxfoundation.org>

Revert "Build infrautils with maven-3.6"

This reverts commit bbe9de2506c6c0ab705b4b2926ef8824e5eba24e, as
it seems distcheck/javadoc-verify jobs have trouble running with it.

Change-Id: Id83030fefae9f2517eb438a45e537fbeb5a80fa7
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Merge "Do not trigger distribution-merge by controller"

Do not trigger distribution-merge by controller

Controller is MRI in aluminium, its merge jobs should not be
triggering distribution re-merge.

Change-Id: If38e0f38b48fc79aec116f8506743d6fdafbae02
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Add infrautils-release jobs

In preparation for transitioning to being MRI, infrautils needs to
have release jobs.

Change-Id: I3e3d4f1f8231b43b33532227e80eb5b71c098b55
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Build infrautils with maven-3.6

This speeds up the build process a bit.

Change-Id: Ibc8babbed53f6899147bcdbcc0cf4ffc9c95ec4e
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Decode Base64 before parsing Gerrit comment

The Gerrit Trigger plugin defaults to sending us a Base64 encoded
value now so we need to decode it first before we can parse it.

Issue: RELENG-151
Change-Id: Id91c596b117dbf432cff9c52c6990104d628037d
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Decode Base64 before parsing Gerrit comment

The Gerrit Trigger plugin appears to be sending us a Base64 encoded
value now so we need to decode it first before we can parse it.

Issue: RELENG-151
Change-Id: I07f40f787a9c8c5167bdb9a7b4a491e55a80f569
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Merge "Set the correct Jenkins user as Git email"

Merge "Use https to save a redirect"

Set the correct Jenkins user as Git email

This setups up the email to the correct user account for the real
Jenkins user.

Change-Id: I400576b410a1c33eb09ed5b108522a304d44963a
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Set -x so that we can see where script fails

Because we have `set -e` configured if the shell script fails
on a command that doesn't print out any details we may be lost
as to when / where failure occurs, set -x so that we can trace
where the script ended.

Change-Id: Ied07ca2c9fbd45b7e770688ca61f30231586b216
Signed-off-by: Thanh Ha <zxiiro@gmail.com>