Merge "Remove packaging jobs from builder"

Merge "Remove ansible from builder"

Merge "Change Netconf Testtool version"

Change Netconf Testtool version

Signed-off-by: Venkatrangan Govindarajan <gvrangan@gmail.com>
Change-Id: I3c05f7e3be6283799677bfeff3c79fd36eced3a1

Reduce the num of parallel robot instances to 20

Reduce the number of parallel instances to ensure that
the maxTotalcores quotas set on cloud provider does not exceed
the set limit.

Issue: IT-21093
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: I1c606230610362b95fc0b1085ec1d9cd66a81ca3

Fix controller car perf test

Change-Id: I1c5a1c3fcd8f07951604de308e30f3d864d76af7
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Enable AWS S3 log shipping for ODL

Logs will be created on AWS S3 buckets for jobs
that run on ODL Jenkins releng and sandbox.

Issue: https://jira.linuxfoundation.org/browse/INFRA-6159
Change-Id: I3cc5fd8429ea64cb71b1287e2086f130aa99bdd0
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Remove ODL packaging, ansible and puppet jobs

ODL packaging, ansible and puppet projects are aproved
for archival since they are no longer maintained.

Ref: https://wiki.opendaylight.org/display/ODL/2020-11-05+TSC+Minutes
Issue: https://jira.linuxfoundation.org/browse/RELENG-3247
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: Ide520514d5e9c2f2f7c9205504d783d793f7cf10

Use public address for auto generated review

This will use the integration-dev email address to notify
when a new auto-generated gerrit review is created to
add/remove CSIT jobs.

Signed-off-by: Jamo Luhrsen <jluhrsen@gmail.com>
Change-Id: I50a2213ed4c869dae25c6b9b214b5e92d6cfd352

Update global-jjb to the latest v0.58.0

- Pull in Override semver regex for projects

Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: I175175ce927a0186e5d3b36a5563c88308fe3b2d

Add yangtools-6.0.x jobs

yangtools will be branching 6.0.x support branch, create the jobs
to support it.

Change-Id: I825883d4fe7073914c389d5d0cc0c47ca02d113b
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Add Labels into cloud config files

Add labels where missing
Going forward we will use these for our
JCASC efforts

Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: Ic660fd3c9a9ca6136d0290e362d0c916d4e0cc28

Add netconf-1.7.4.x jobs

We will be needing an off-SR release, add the jobs to support
that.

Change-Id: I1d2fc5206a0570eeeb5600beca5f3ec4f655fcde
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Add netconf release management

We will be transitioning to MRI and also need an off-SR release,
add release job to support that.

Change-Id: I2e6ff33cece78cbc6a2f6b4b01bfd2b025b1830f
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Use v1.0.3 tag for write-good hook

Change-Id: I3cc238d5bfa69c2ff58b68e7234fd12467e7d7f7
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Remove committer permissions from emerritus

The these folks are listed as committer emeritus which means they
are no longer active committers on the project. Update the INFO.yaml
to reflect that.

Change-Id: Id1442b34379043ccc1a9d27dca96e88178587e21
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Update PTL to Anil Belur

Anil Belur has volunteered to step up as the PTL for the
releng/builder project.

Change-Id: I41c6c270f7af30c3a893ded5ab8467b3d76f5e0b
Ref: https://lists.opendaylight.org/g/app-dev/message/642
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Update validate-ar jobs for silicon

Job: autorelease-update-validate-jobs-silicon/14
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>
Change-Id: Ifd4a402cc44333928b7e58fce6c067399549a6a6

Remove Faseela from committer list

Faseela is no longer active in ODL and has requested to be removed
from the releng/builder committer group.

Change-Id: I7521b608acc21f0a687b7b50458fcbe9257d1a69
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Auto Update CSIT Jobs to run for silicon

Job: integration-update-csit-tests-silicon/71
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>
Change-Id: Ie20b066fe848729fde5ab35c439f0e11bb8cc3a1

Netvirt CSIT to run as SM project

Change-Id: If86f7fe150b55d9b417d1c1c1c97231b6a05ffe3
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

fix odlmicro CSIT

- Download of the testtool fails
- this patch moves the testtool version to Aluminium SR1

Signed-off-by: Venkatrangan Govindarajan <gvrangan@gmail.com>
Change-Id: Id47d5fc83e0a14c99f2b78cafa9d53fbcb293ce3

Add IS_KARAF_APPL parameter globally in CSIT

Change-Id: I828a579b43c4feedd6b92f1521c2d6d106f647c6
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Add controller-2.0.x jobs

controller is just about to branch for Aluminium's 2.0.x branch,
add the jobs to support it.

Change-Id: I2377c04f42ef75167de5ab52c4223d14ac37f356
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Merge "Fix ovsdb sonar configuration"

Merge "Fix bgpcep UT aggregation"

Fix bgpcep UT aggregation

This bit was missed in previous update, make sure we correct
the sonar configuration.

Change-Id: I535ddcc415792b2e469417e7d9b88a37ec61e6dc
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Fix ovsdb sonar configuration

ovsdb needs JDK11 to compile, fix the sonar job definition.

Change-Id: Id3b6a3ae13c6221f0e97c91885528c48947d04ee
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Fix odlmicro sonar

oldmicro is aligned with Aluminium, hence it must use jdk11 for
its sonar.

Change-Id: Icb7a0fcf1b13fda150265dd70b02f08b13839e73
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Merge "Auto Update CSIT Jobs to run for silicon"

Auto Update CSIT Jobs to run for aluminium

Job: integration-update-csit-tests-aluminium/315
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>
Change-Id: I19c31bb5f2932acf8c1bebc2c6001e97853126d4

Auto Update CSIT Jobs to run for silicon

Job: integration-update-csit-tests-silicon/62
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>
Change-Id: I2bbd41524ec6215b318898132ea7cac8fb3fed5a

Merge "Remove odlmicro CSIT from AR test"

Merge "Remove odlmicro sonar aggregation"

Merge "Remove odlplastic sonar aggregation"

Enable infrautils sonar aggregation

infrautils' aggregator contains the aggregation prerequisite,
take advantage of it in sonar job.

Change-Id: If80b978ea4866f17d139a9a4a8df39768ec10f49
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Remove odlmicro sonar aggregation

odlmicro's project structure does not meet ODL project layout
guicelines (parent vs. aggregator pom.xml) and therefore does
not have the build order required for sonar report aggregation.

Use default sonar configuration, as that is appropriate for this
project. It also eliminates a warning.

Change-Id: I0f3fc02a162da2616a31f600d7223bc67ba3ca58
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Remove odlplastic sonar aggregation

plastic is a single-artifact project, aggregation does not make any
sense. The configuration actually hurts, as it incurs a sonar warning.

Change-Id: I2581faf5b01b952d77a4b48dd5db1965d08ca7ed
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Fix aggregated project reporting

This change was tried with yangtools, now fix all properly-configured
projects.

Change-Id: Ibf31981f95f74830739582fe6a594256b757b6e3
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Fix yangtools sonar test coverage

We want to be using aggregate execution profile, but those reports
are currently broken, as sonar just picks up individual execution
reports.

Make sure sonar reporting also runs jacoco:report with the aggregate
file, so Sonar ends up with aggregate execution reports.

Change-Id: Iec0a0703608e0f4879425a27e5a66a6d244f731e
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Remove odlmicro CSIT from AR test

Also add after project merge trigger

Change-Id: I3e8c8144a66a5eaa7e743aeff9c425a9c8f4429e
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Merge "Auto Update CSIT Jobs to run for silicon"

Auto Update CSIT Jobs to run for aluminium

Job: integration-update-csit-tests-aluminium/307
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>
Change-Id: I64d3210574377e441500d65aea906c3790fe306a

Auto Update CSIT Jobs to run for silicon

Job: integration-update-csit-tests-silicon/54
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>
Change-Id: I54dad84589cecb16e15e8d3b45f57faed2bd4840

Remove packaging jobs from builder

The repo is being archived since its no longer
maintained.

Ref: https://lists.opendaylight.org/g/release/message/19312
Change-Id: Ice333d364d9da370861398fd926669574c28ba48
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Remove ansible from builder

The repo is no longer maintained and archived.

Ref: https://lists.opendaylight.org/g/release/message/19312
Change-Id: I4c151e2349e42b1a143264daf7429a60e97b4152
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Adding new job for odlmicro CSIT

- It is a non karaf controller
- Added new script to invoke the robot command  only
- odlmicro will be installed by the robot test

JIRA: ODLMICRO-32
Signed-off-by: Venkatrangan Govindarajan <gvrangan@gmail.com>
Change-Id: I1341ea98c6b1e4a68c3aded4386eedd58c2691d8

Change os-branch from queens to rocky

Signed-off-by: Srinivas Rachakonda <srinivas.rachakonda@gmail.com>
Change-Id: Id0557515e669cde24296f56127c9d96805c2ded7

Refactor odlguice jobs

This project is release integrated and low maintenance so only
master jobs are required for now.

Change-Id: Id71c8b53c2756623d797eb8b0a51ca3c5cf73da2
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Add infrautils-1.8.x jobs

infrautils is now MRI, hence it retains its master branch and
creates branches to support SRs. This creates the Aluminium branch
jobs.

Change-Id: Iba8b9876a5e697dc548ff0dcf50a1ed5ed1d769b
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Update cloud image list docs

Job: builder-update-image-list/970
Change-Id: I45c1c7b123fac06b53b8a804138cbac01ea84cf8
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Merge "Minimize CSIT dependencis in mininet-ovs-2.8 image"

Merge "Update cloud image"

Remove TSDR dependencies

Cassandra and HBase copied to /tmp was something packaged specifically
for the TSDR project which is now inactive. Considering no active
projects are using these anymore remove them to clean up our builder.

Change-Id: Id8551b4e08de2fd08409444811801d2ecd6b815b
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Update cloud image

Job: builder-openstack-update-cloud-image/173
Change-Id: I11f7fdf08ff7717559ec3789a64829c92e4d3ea7
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Merge "Update validate-ar jobs for magnesium"

Merge "Purge ODL Sodium jobs from builder"

Purge ODL Sodium jobs from builder

Sodium is EOL since Aluminium is released the branch
is locked, we no longer require jobs for the branch.

Change-Id: I4397e71c22bb411e7ff2ce65a579b4818f085769
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Run lftools builds in parallel mode

Speed up lftools builds by running tox in parallel mode.

Change-Id: Iddc3e4eadc6a3619f0c4cf8fe2ad6ac7c2c243c6
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Improve the branch cutting script

This script rewrites the branch cutting script entirely with Python to
use a library that understands YAML. This allows us to smartly parse
the YAML and manipulate the data based on well defined conditions for
supported use cases when updating jobs.

This new script also rely's on pre-commit's prettier hook to format the
YAML files after the script is run in order to maintain consistent and
human readable formatting since Python's YAML libraries strip all
formatting when loading the data stream.

This also adds Python linters to pre-commit as there is Python code
that needs to be managed now.

Issue: RELENG-152
Change-Id: I6360f3a47285197cd9a9be1e95156ea174c919ba
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Merge "Use the right disable-job parameter"

Merge "Install Docker in regular builder"

Use the right disable-job parameter

Change I3154632d476dfe351d680dd16f8fd8936652b42f set the wrong
parameter to set the jobs to disable. This uses the correct parameter
which should disable the job.

Change-Id: I5196a20b1ae213222303bf4f1f8a0f54891529b3
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Increase params of netconf max device job

the netconf scale numbers have increased and the job
sometimes takes longer than 6 hours now, so increasing
it to 12 hours. Also, the job is maxing out at 950
and we don't know the failure point any more so increasing
those params to start at 400 devices, increment by 200
and stop at 3k max.

Signed-off-by: Jamo Luhrsen <jluhrsen@gmail.com>
Change-Id: If4e3d61a120b56d359660d09c31d8af690f9027b

Update validate-ar jobs for magnesium

Job: autorelease-update-validate-jobs-magnesium/18
Change-Id: Iebc0b26331daea7bd7eec34947b9fa820ebeb887
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Merge "Fix prefix check script"

Fix prefix check script

Fix the prefix check that matches any line with "prefix:"
that fails tox.

The prefix check fails on the following line
which is valid.

failure-notification-prefix: "[releng]"

require a space before prefix: now it cannot match
failure-notification-prefix:

Change-Id: I2d5ee1eb7c858bd5eac03af02f44db2f4a9e46a8
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Merge "Fix Openstack (rocky/stein) stacking issues"

Fix Openstack (rocky/stein) stacking issues

- pip update is done.
- Also more cpu resources needed as more instances are created
- Rocky seems to work fine.
- Stein has some compute issues that needs debugging.

Signed-off-by: Venkatrangan Govindarajan <gvrangan@gmail.com>
Change-Id: I3154632d476dfe351d680dd16f8fd8936652b42f

Update global-jjb to the latest v0.57.3

Update defaults with the required inputs for the openstack-cron
job email notifications.

Change-Id: If940875fda0a5a71c32ba592753c7fba68f89ceb
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Merge "Update global-jjb to the latest v0.57.2"

Add more resources to odlsaf build

Change-Id: Ie9bb528a82db50a0714991c703e4532836d8156f
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Reduce build Xmx

2G image cannot use Xmx of 2G.

Change-Id: Ic7cfc5f0a2131d7355f085cda70f4ee52d14fbfc
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Update global-jjb to the latest v0.57.2

Change-Id: I5948877ab06e2550113d289254b4d5ff8053b2bf
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix warning message while running pre-commit

[WARNING] Unexpected key(s) present on
https://github.com/jumanjihouse/pre-commit-hooks: sha

Change-Id: Ibac0e649eec8650e237aab5d8f63769200da1ab7
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Switch to upstream write-good hook

The change has been merged.

Change-Id: I67667b4005ebba1d9ab4fed205d41582e49df264
Ref: https://github.com/btford/write-good/pull/119
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix the recent issue with python3

Signed-off-by: Venkatrangan Govindarajan <gvrangan@gmail.com>
Change-Id: I7f6169b98dcb0d8e215e41dff6590beff12d3e3c

Update global-jjb to the latest v0.57.0

Change-Id: I0574d2d96ccbeec1bcbc4c662cf929e827be38f9
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Merge "Update lf-infra-docs-conf-release-announce"

Merge "Updating cryptography to 2.9.0"

Updating cryptography to 2.9.0

paramiko 2.7.1 has requirement for cryptography>=2.5

Signed-off-by: Srinivas Rachakonda <srinivas.rachakonda@gmail.com>
Change-Id: I23c30a7841289c3869ffd6baacbe19eaa5679ebd

Set SIGUL_KEY to odl-release-2020

Issue-ID: IT-20466
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: Ice949232d2eaf194729eab0815ea1984b75ef58d

Update common-packer to latest v0.7.0

Change-Id: I6665eb5aaecd96e880d51dfeb809de7f5a1b245f
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Update lf-infra-docs-conf-release-announce

Add project-slug variable since the project name
for this job does not match the configuration in it.
This change corrects the information that is sent in
the announce email with the right URL.

Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Change-Id: Iea3a71a7bae73e5b320db501fcf9165e961d83ec

Update cloud image list docs

Job: builder-update-image-list/944
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>
Change-Id: Ie9a16ff1b760e1a72a127c842e05542524d0d69f

Update cloud image list docs

Job: builder-update-image-list/943
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>
Change-Id: I0ad390828a0fdca2a2af39241f4daac92d8012eb

Install Docker in regular builder

Considering that many projects are utilizing Docker now and the only
real difference between the "docker" template and the "builder"
template is whether or not they have docker installed. Let's just
consolidate the 2 image types into a single "builder" one and reduce
the number of special images we are managing.

This also configures the vm flavor packer uses to build to v2-highcpu-4
to make our packer builds faster. We used limit to the lowest size
to ensure that the smallest volume is used however considering we are
explicitly passing a vm_volume_size parameter now let's not limit
ourselves to the CPU size of our build system.

Change-Id: I116ab774b27ddedd5bf55746eb2cf067256797e0
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Update NETCONF job image

Change-Id: Ib4a531233ffec5ef51627112726730c90899415b
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Merge "Revert "Update builder image for netconf-userfeatures""

Revert "Update builder image for netconf-userfeatures"

This reverts commit 70f9ef370ad847817058f8c3f85a5c3b08faebc9.

Reason for revert: this breaks CSIT

Change-Id: Ibd0bf3ee49b5447db2b43614dc7b6a0ce8138acc
Signed-off-by: Jamo Luhrsen <jluhrsen@gmail.com>

Merge "Auto Update CSIT Jobs to run for silicon"

Merge "Auto Update CSIT Jobs to run for aluminium"

Merge "Auto Update CSIT Jobs to run for magnesium"

Merge "Auto Update CSIT Jobs to run for sodium"

Merge "Update cloud image list docs"

Update cloud image list docs

Job: builder-update-image-list/942
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>
Change-Id: I1371d02d81c36e9ec4e5f9053684f957da42d36a

Auto Update CSIT Jobs to run for sodium

Job: integration-update-csit-tests-sodium/652
Change-Id: I2b0196346693af112a9adf7c7c43caa620d579cc
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Auto Update CSIT Jobs to run for silicon

Job: integration-update-csit-tests-silicon/29
Change-Id: I8f6bdaba68dc0cd566e1018ca3fd3f380df6765d
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Auto Update CSIT Jobs to run for magnesium

Job: integration-update-csit-tests-magnesium/453
Change-Id: I81e5db98dab23484ee4e17066c7c4abb8c8b011f
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Auto Update CSIT Jobs to run for aluminium

Job: integration-update-csit-tests-aluminium/282
Change-Id: If3aef3562a51e09bb52f7a80440f43c33f9e4c0f
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>