Update to OVS v2.6.10 on Ubuntu 18.04

This fixes build errors with v2.6 on Ubuntu 18.04.

Change-Id: Ie544e340fbe074cbe3c12621c7bfeb4ef256e099
Signed-off-by: Anil Belur <[email protected]>

Purge Magnesium jobs from builder

With Silicon release, Magnesium is marked EOL.

Signed-off-by: Anil Belur <[email protected]>
Change-Id: I93a20d35f732806e3993befd126a03ce0ea1e6bb

Merge "Remove Ubuntu 16.04 packer build jobs"

Add new Ubuntu 18.04 OVS 2.8 image

Jenkins jobs that require to use the image must test
with the label: ubuntu1804-mininet-ovs-28-1c-4g

Signed-off-by: Anil Belur <[email protected]>
Change-Id: I5fa7207b1b680565b6c45c65a214647267db4d0d

Merge "Update cloud image list docs"

Update OVS to v2.8.11

This fixes build errors with v2.8.1 with Ubuntu 18.04.

Signed-off-by: Anil Belur <[email protected]>
Change-Id: Ia5e35e1e96e5c09ab5cd79cd2a4be3a4e5146011

Update cloud image list docs

Job: builder-update-image-list/1108
Signed-off-by: jenkins-releng <[email protected]>
Change-Id: I3e7cf17fb98b3662a67ab1dfb5e6a9606f042cde

Update common-packer to latest v0.7.7

Change-Id: I54039015c488c54af9c7d101e15fa3fcfc9962f5
Signed-off-by: Anil Belur <[email protected]>

Update cloud image Ubuntu18.04 mininet ovs

Job: builder-openstack-update-cloud-image/224
Change-Id: I67573bb868e2cc51988fe786efee9387ef019e1d
Signed-off-by: jenkins-releng <[email protected]>

Merge "Auto Update CSIT Jobs to run for phosphorus"

Auto Update CSIT Jobs to run for silicon

Job: integration-update-csit-tests-silicon/131
Change-Id: Id477eec3f726eb3ffedeb0544c98a347b427690c
Signed-off-by: jenkins-releng <[email protected]>

Auto Update CSIT Jobs to run for phosphorus

Job: integration-update-csit-tests-phosphorus/13
Change-Id: I77ef98a769abac983e2c5bb552041246de45ccf6
Signed-off-by: jenkins-releng <[email protected]>

Merge "Replace odl-restconf-noauth feature with odl-restconf for bgpclustering jobs"

Merge "Increase transportpce tox timeout to 240"

Remove Ubuntu 16.04 packer build jobs

Ubuntu 16.04 is EOL-ed from April, 2021 and building
newer images are no longer supported.

Ref: https://lists.opendaylight.org/g/integration-dev/message/14395
Signed-off-by: Anil Belur <[email protected]>
Change-Id: I5e3eeea412665140dbd4a11b8f0b3b85c7e99fcd

Replace odl-restconf-noauth feature with odl-restconf for bgpclustering jobs

The odl-restconf-noauth feature was removed in 2019, and karaf boot process
just ignores non-existing feature since that time. This change replaces
odl-restconf-noauth feature with a odl-restconf, which should provide
everything needed for test scenarios.

JIRA: CONTROLLER-1672
Change-Id: I415b26ecfcdd7e623196d66471ed12b32ca3668b
Signed-off-by: Oleksii Mozghovyi <[email protected]>

Increase transportpce tox timeout to 240

Many timeout failures observed in latest transtportpce changes.

Signed-off-by: Guillaume Lambert <[email protected]>
Change-Id: I806263515cd1880f8b73b09e9af1550a261a1089

Update global-jjb to the latest v0.62.0

- Pull in the fix pin git review to 1.78

Signed-off-by: Anil Belur <[email protected]>
Change-Id: I84fb11e53d671565771473580b3cef235557fc0c

Merge "Add controller-3.0.x jobs"

Merge "Add odlparent-8.1.x jobs"

Add controller-3.0.x jobs

controller is about to branch 3.0.x, add jobs to support that branch.

Change-Id: I5bd5f231fa2c1ef1170f6a55a45c68eacddbfb3d
Signed-off-by: Robert Varga <[email protected]>

Add odlparent-8.1.x jobs

odlparent is just about to branch 8.1.x, add jobs to support that
branch.

Change-Id: I969a70820045fd513a1e7a24de57bb8455231ea0
Signed-off-by: Robert Varga <[email protected]>

Add bgpcep release-merge job

BGPCEP has voted to transition to being an MRI project, make sure
we have the release job to drive that.

Change-Id: Iacdc64ff2f7a2513c97f736dd869be7c2a0a2472
Signed-off-by: Robert Varga <[email protected]>

Pin git review to 1.78

The latest version of module trys to look for git hook
recursively within the submodules.

Error:
    Entering 'global-jjb'
    cannot stat '.git/hooks/commit-msg': Not a directory
    fatal: run_command returned non-zero status for global-jjb

Remove workaround that has been resolved in v1.28 and use
lf-activate-venv to install git-review

Issue: RELENG-3435
Signed-off-by: Anil Belur <[email protected]>
Change-Id: I6839e2466174b3d27df21853bf960aa7c7711526
Signed-off-by: Anil Belur <[email protected]>

Update prettier pre-commit to ignore stage error

Set stages to 'commit' to overide the default_stages.

This fixes the issue seen while using git-commmit:
[error] No matching files. Patterns: .git/COMMIT_EDITMSG

Change-Id: Iaf2727bb436342f2ee64adfacfbdd09525901e60
Signed-off-by: Anil Belur <[email protected]>

Remove netconf->genius/netvirt job triggers

We are not using these tests, remove them.

Change-Id: I550e0f625a7ea7cb3328523ec32098701ad1f558
Signed-off-by: Robert Varga <[email protected]>

Merge "Fix reviewers mail in JJB"

Auto Update CSIT Jobs to run for aluminium

Job: integration-update-csit-tests-aluminium/2
Signed-off-by: jenkins-sandbox <[email protected]>
Change-Id: I5f1f4aba42c90b305c1edde5190da3085034e9ce

Fix reviewers mail in JJB

Change-Id: I86fa72394d688928022a926d5f9f68f5056d1ac7
Signed-off-by: Luis Gomez <[email protected]>

Merge "Update validate-ar jobs for silicon"

Merge "Branch cut for stable/silicon stream"

Update validate-ar jobs for silicon

Job: autorelease-update-validate-jobs-silicon/35
Signed-off-by: jenkins-releng <[email protected]>
Change-Id: I3e5b49d668d3be86e60df3015f2bde0abedfc879

Merge changes I4bb1c7db,Ief5d0401

* changes:
  Update shellcheck to the latest 2.1.5
  Update the docs with v3 flavors

Branch cut for stable/silicon stream

master is moved to next release (phosphorus).

Issue: https://jira.linuxfoundation.org/browse/IT-21581
Change-Id: Ic801cace3c3a06c0f27599be9a1931e6cdc92596
Signed-off-by: Anil Belur <[email protected]>

Merge "Switch NETCONF to an MRI project"

Merge "Remove netvirt-distcheck-silicon"

Merge "Update global-jjb to latets v0.61.0"

Merge "Add branch-cutting job for AR"

Remove netvirt-distcheck-silicon

NetVirt is not part of Silicon SimRel, there is no point to keep
its distcheck job around.

Change-Id: I282cd9924b1f9070982aaa11120ff1bb195b0658
Signed-off-by: Robert Varga <[email protected]>

Switch NETCONF to an MRI project

NETCONF is now MRI, remove its distcheck job and rename streams.

Change-Id: Ib2936c43733b990bb549260b196b1069a689ab90
Signed-off-by: Robert Varga <[email protected]>

Update global-jjb to latets v0.61.0

Change-Id: I23be54e595aee57bfc4017bd4e8d32882196a5a4
Signed-off-by: Anil Belur <[email protected]>

Add branch-cutting job for AR

The job was removed by mistake cleaning
up older release jobs in 63ce932398b0418bb9b.

Change-Id: I409a00b506c5559196e90661bebd4e17c2900ce4
Signed-off-by: Anil Belur <[email protected]>

Merge "Remove hard-coded email"

Update validate-ar jobs for silicon

Job: autorelease-update-validate-jobs-silicon/34
Signed-off-by: jenkins-releng <[email protected]>
Change-Id: I5458d32b991b35f8e229f0fddb40122a08d8513f

Remove hard-coded email

This will fix CSIT update jobs issue

Change-Id: I0b739e2a6d5c9c2502fe05ed09a24e3f57719ba2
Signed-off-by: Luis Gomez <[email protected]>

Update shellcheck to the latest 2.1.5

Signed-off-by: Anil Belur <[email protected]>
Change-Id: I4bb1c7dbc865f890c568581d7438c585d687008c

Update the docs with v3 flavors

Signed-off-by: Anil Belur <[email protected]>
Change-Id: Ief5d0401062c299cf1d6b2fbcbcdab1c8d79a490

Merge "Migrate jobs from odl-standard-* flavors to v3"

Migrate jobs from odl-highcpu-* flavors to v3

v3 flavors guarantees jobs spin on newer hardware that
are faster and cost-efficient than the v2 flavors.

Signed-off-by: Anil Belur <[email protected]>
Change-Id: I242a05cc8222b62ac46e7f22195d4767bed29865

Merge "Migrate jobs from v1-standard-* flavors to v3"

Merge "Migrate jobs from odl-standard-* flavors to v3"

Migrate jobs from odl-standard-* flavors to v3

v3 flavors guarantees jobs spin on newer hardware that
are faster and cost-efficient than the v2 flavors.

Signed-off-by: Anil Belur <[email protected]>
Change-Id: I1644cd43d97da5b292503546b9d577b2f4a52402

Migrate jobs from v1-standard-* flavors to v3

v3 flavors guarantees jobs spin on newer hardware that
are faster and cost-efficient than the v2 flavors.

Signed-off-by: Anil Belur <[email protected]>
Change-Id: Ie4b63bd1e8604c03a7fa5ac8f5bd0ce38127dcea

Migrate jobs from odl-standard-* flavors to v3

v3 flavors guarantees jobs spin on newer hardware that
are faster and cost-efficient than the v2 flavors.

Signed-off-by: Anil Belur <[email protected]>
Change-Id: I82c6dbe13a3e9c817ef9a9a4fe61f665a2800a4f

Migrate jobs from v1-standard-* flavors to v3

v3 flavors guarantees jobs spin on newer hardware that
are faster and cost-efficient than the v2 flavors.

Change-Id: I36aa9842413f9adaff23d6ab2383c0e79c4d4f37
Signed-off-by: Anil Belur <[email protected]>

Add jobs for mdsal-7.0.x

MD-SAL is going to branch soon, add a branch to support Silicon
release stream.

Change-Id: I1ef1517c239502b2eec2ccbb2318dd45873dfc7f
Signed-off-by: Robert Varga <[email protected]>

Switch Genius to self-managed mode

Remove glue jobs between integration/{distribution,test} which are
preconditioned on being in managed distribution.

Change-Id: Id8628eaff9c65ad12319205cb00ad8f45af9c769
Signed-off-by: Robert Varga <[email protected]>

Update validate-ar jobs for silicon

Job: autorelease-update-validate-jobs-silicon/30
Signed-off-by: jenkins-releng <[email protected]>
Change-Id: I22a1e9626350694a45ae5aa533206ebad1b9f589

Update validate-ar jobs for silicon

Job: autorelease-update-validate-jobs-silicon/29
Signed-off-by: jenkins-releng <[email protected]>
Change-Id: I84fc4bcbad810f7b2c6af409b55691e2914f6b43

Merge "Switch AAA to being MRI"

Merge "Run new MDSAL CSIT to the weekly MRI test"

Merge "Remove unused test variable."

Switch AAA to being MRI

AAA is now a MRI project:
- use 'master' instead of 'silicon' to keep job continuity
- remove infrautils-distribution-check-aluminium
- do not trigger distribution-merge in aluminium

Change-Id: I73188c26d4dcc62807d38eb945ddd38a1669ba32
Signed-off-by: Robert Varga <[email protected]>

Add AAA release job

AAA is becoming an MRI project, it already has a staged release,
now it needs a job to release.

Change-Id: I98a96147a75689125965a0f0772d4da2e0bcada0
Signed-off-by: Robert Varga <[email protected]>

Run new MDSAL CSIT to the weekly MRI test

Also change multipatch build order:
infrautils only needs to build if odlparent version changes.

Change-Id: Ie7b6cc68dc8ed3c362b85d25d508ac901581e115
Signed-off-by: Luis Gomez <[email protected]>

Pin pre-commit to v2.9.3 in tox.ini

A change in v2.10.0 of pre-commit introduces an incompatibility with
jumanjihouse/pre-commit-hooks, particularly the shellcheck hook. It
isn't clear whether this is intentional or not, but until either
pre-commit or the jumanjihouse hooks are updated, we need to pin to
the working version of pre-commit.

Change-Id: Ic32ee7ebfd3081f421bc2bde704b792bca31c934
Signed-off-by: Andrew Grimberg <[email protected]>

Update global-jjb to the latest v0.60.5

Signed-off-by: Anil Belur <[email protected]>
Change-Id: Iecd4696ce753d842299cf7c1a28a5a1852101e26

Update global-jjb to the latest v0.60.4

Signed-off-by: Anil Belur <[email protected]>
Change-Id: Ic94b7fe04b57eb586c553da9b8d53430e2cb8a1b

Merge "Add netty replicate system test job"

Set builder name and type to "openstack"

Based on the input provided on the Gihub packer issue
hard-coded for our parser to be able to decode the rest of the config
properly." This would require to hardcode the builder name and type
in the templates.

This change requires an update in global-jjb v0.60.3
and common-packer v0.7.4.

Change-Id: I9c9802356dce03a4b60e38b96d1f7e6b0e0813e5
Signed-off-by: Anil Belur <[email protected]>

Update global-jjb to the latest v0.60.2

Signed-off-by: Anil Belur <[email protected]>
Change-Id: Ie46fbdaa0f9f7d1d5a2a84ac85ce55a4285e87fb

Merge "Update global-jjb to latest v0.60.1"

Update global-jjb to latest v0.60.1

Signed-off-by: Anil Belur <[email protected]>
Change-Id: Id2272b6c444eafda12b2a5e5019f859f549d9c41

Update common-packer to v0.7.2

Signed-off-by: Anil Belur <[email protected]>
Change-Id: I0ccdbba4bbe8743d67f78889725d08ceb58f325c

Increase number of devices for aluminium NETCONF scale test

Do not waste cycles on small device count, let assume we have
1hr. max per run, then we can fit 11-12 runs into 12hr budget,
starting at 1k and increment by 500 and stop at 4k devices
should give us enought time to complete 7 test runs (1k, 1.5k,
2k, 2.5k, 3k, 3.5k, 4k).

Currently we're spending approximately tens of minutes per run:
2200 .. 09:49:35.932 - 10:06:42.953 ~ 17 min.
2400 .. 10:58:29.420 - 11:16:41.775 ~ 18 min.
2600 .. 12:28:04.384 - 13:49:35.439 ~ 22min.
2800 .. 14:15:24.558 - 14:46:23.139 ~ 31 min.

Change-Id: Iee9c46447440eef8f78e55abc36be5e3d839fc6d
Signed-off-by: Miroslav Miklus <[email protected]>

Merge "Pin python Requests library"

Merge "Update list for distribution test"

Update list for distribution test

Removing lispflowmapping as it has been failing for long time.

Change-Id: Idef0748e3a19219cdb6c5dc5cc076f100c9f3ec1
Signed-off-by: Luis Gomez <[email protected]>

Pin python Requests library

Since Requests library released 0.8.0, we are getting a bunch
of WARNs in our logs, this will avoid the issue for now.

Change-Id: I13c4e055e6abb626c7bcd8ae6dcd2981d4b7faa8
Signed-off-by: Luis Gomez <[email protected]>

Reduce number of robot instances

This patch reduces the number of robot instances that can run
in parallel and therefore it will help with the issue of cloud
quota exceeded.

Change-Id: Ia809ab07938eb8035648b3a00de9d6f670fe5aef
Signed-off-by: Luis Gomez <[email protected]>

Merge "Update global-jjb to the latest v0.59.0"

Add netty replicate system test job

Add new system job for runing MD-SAL netty-replicate end-to-end tests

Signed-off-by: Martin Balaz <[email protected]>
Change-Id: Ie72e274686ee70fa1f500979cb1f1a4c26c9ea18

Remove openstack AZ from templates

When the availability_zone(AZ) is set, this returns the following
error. The cloud provider has recommended unsetting the value.

Error:
Build 'openstack' errored: Error creating volume:
Bad request with:
[POST https://volume.public.mtl1.vexxhost.net/v3/
f5ab9a59d6c649bd8ed4af258c4ba755/volumes],
error message: {"badRequest": {"code": 400, "message":
"Availability zone 'ca-ymq-2' is invalid."}}

Issue: https://jira.linuxfoundation.org/browse/IT-21300
Change-Id: Iaf65138629aad54534c0e50608b48d25338fbfdf
Signed-off-by: Anil Belur <[email protected]>

Add missing '$' in JJB scripts

Change-Id: I316c09c120bef9fdd0f5ec9fc0302381ef72cf7f
Signed-off-by: Luis Gomez <[email protected]>

Add missing CSIT job after last branching

Change-Id: Ib35ef1cbbf31d41a5f026d311a236a6186a1a367
Signed-off-by: Luis Gomez <[email protected]>

Update common-packer to v0.7.1

This fixes an issue with the builds not being able to find the
ca-ymq-2 availability zone.

Issue: LF-Jira RELENG-3344
Change-Id: I0ece1cfb68cb2b8031ff288cf1eb7effbfd24f43
Signed-off-by: Eric Ball <[email protected]>

Fix CSIT silicon

Refreshing not existing bundles has impact in silicon.
Decanter has not worked in ODL for a while so this change
is harmless.

Change-Id: I6619e5cd55244d1a6be76b1d0f6dcec0a76c1434
Signed-off-by: Luis Gomez <[email protected]>

Merge "odlmicro Netconf Scale Jobs"

odlmicro Netconf Scale Jobs

Signed-off-by: Venkatrangan Govindarajan <[email protected]>
Change-Id: Ic84b231ac450ca7b0fc09acc0578796b5f372fcc

Increase transportpce tox timeout to 140

Many timeout failures whose origin could be issues during virtualenv
installation.

Signed-off-by: Gilles Thouenon <[email protected]>
Change-Id: I55ef7a2f74d88ade53a5c4155f290ecd717e6caa

Remove mdsal-v4.0.x jobs

Sodium is now desupported, remove the corresponding mdsal jobs.

Change-Id: I2bf7c2ed82b560f59cb8a605a8552903357506aa
Signed-off-by: Robert Varga <[email protected]>

Remove yangtools-v3.0.x jobs

Sodium is desupported now, remove the corresponding jobs.

Change-Id: Id8d0c8cc21a36bcb67a9505e00aa4e941f46b67e
Signed-off-by: Robert Varga <[email protected]>

Remove odlparent-5.0.x jobs

We are past Sodium support window, erase odlparent jobs used to
support it.

Change-Id: If9a36d0bd818edc0c805cfa7bba835b770a21ea9
Signed-off-by: Robert Varga <[email protected]>

Update global-jjb to the latest v0.59.0

Signed-off-by: Anil Belur <[email protected]>
Change-Id: Id353013872c0d528e5f04a90caceb2e1d9e45978

Remove unused test variable.

Change-Id: If49b562155343f37268af6a44dd3f85835444785
Signed-off-by: Luis Gomez <[email protected]>

Merge "Remove packaging jobs from builder"

Merge "Remove ansible from builder"

Merge "Change Netconf Testtool version"

Change Netconf Testtool version

Signed-off-by: Venkatrangan Govindarajan <[email protected]>
Change-Id: I3c05f7e3be6283799677bfeff3c79fd36eced3a1

Reduce the num of parallel robot instances to 20

Reduce the number of parallel instances to ensure that
the maxTotalcores quotas set on cloud provider does not exceed
the set limit.

Issue: IT-21093
Signed-off-by: Anil Belur <[email protected]>
Change-Id: I1c606230610362b95fc0b1085ec1d9cd66a81ca3