Add method to not trigger downstream ar-jobs

When we are triggering many autorelease jobs per day we do not wish to
trigger distribution-test jobs for every run otherwise it will spam the
Jenkins queue. This allows us to selectively disable triggering the jobs
when we manually build.

Change-Id: Ia345b3875bd29e5869bc09aa378314d542fef181
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add 4 node stack type for hwvtep suites

hwvtep suites need an odl node type, 1 larger openstack
node (control) type, 2 smaller openstack node (compute)
and 1 more node type for mininet systems

Change-Id: Ib8f255a23148b3d1ca15c5e29e6a49c998199d49
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Add verify jobs for ci-workshop

Change-Id: I28b775283ed81de72ea63ebd0acdd9849a74ad35
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Merge "Strip include-raw prefix for script files"

Merge "Fix puppet-opendaylight Vagrantfile link"

Merge "Strip include-raw prefix for script files"

Update validate autorelease projects for nitrogen

Change-Id: I42ece3da2e9765ee68fd4f03288dd59cc109cd34
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Fix puppet-opendaylight Vagrantfile link

Change-Id: I1c0be26d9a9d230530715cafbae28b3f7cba5e15
Signed-off-by: root <sanketh.uppalapati@research.iiit.ac.in>

Merge "Run Boron build 12 hrs off of usual UTC time"

Merge "Make ansible-odl jobs use the proposed code"

Make ansible-odl jobs use the proposed code

Change-Id: I07efef74c20b4db82f6c0a66480f55b0c807124d
Signed-off-by: root <sanketh.uppalapati@research.iiit.ac.in>
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>

Run Boron build 12 hrs off of usual UTC time

Ensure that we run at least 12 hours apart from the usual build time.
This is to ensure that Boron CSIT job runs do not overlap with the
currently in development build times Sunday nights.

Change-Id: Ib546ea2a26c6ca6f3920107b7ca2f341f494c7f6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update validate autorelease projects for nitrogen

Change-Id: I2cedf0aabd32f6e8a5091658a8f50f5925d9a5b5
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Merge "Revert openldap dependencies for CentOS and Ubuntu"

Update cloud image list docs

Change-Id: I697a7cc21452173f79a1f55b0c017bc6d75b1eb0
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Revert openldap dependencies for CentOS and Ubuntu

This reverts Icbbdaca341673fd1b65710b362a63c0b9f56feb6
since its no longer required by lftools.

Change-Id: I1202d6259dbf1f641f017c0f2b72dd49aa3d5a40
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Merge "Fix ubuntu image update failures."

Fix ubuntu image update failures.

public_cloud: E: Unable to fetch some archives, maybe run apt-get update
or try with --fix-missing?

Change-Id: I7e049a5e79372c3a4e81d0cada26dcfc40330ede
Jira: releng-368
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Merge "Strip include-raw prefix for script files"

Merge "Reduce maven heap for multipatch-test job"

Increase java-builder and mininet image timeout

Building in zrpcd repo changes causes the images to timeout

Change-Id: I4b40829cf3e9f75295451c02625a7d083d2360ea
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Reduce maven heap for multipatch-test job

Needed before Odlparent increases heap for SFT.

Change-Id: I9a31bac05724e778bc38d8df36ed8564abd84400
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Strip include-raw prefix for script files

Prefixing files with `include-raw-` makes the file name longer
and also not a standard to be followed.

Change-Id: I36abaf45fa811c4fb00fd21d3b0dd3ef2c5b37cc
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Strip include-raw prefix for script files

Prefixing the files with `include-raw-` make the file name longer
and also not a standard to be followed.

Change-Id: Iea81fae69a5c1733568151ba8b80ef7036ed5f80
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Strip include-raw prefix for script files

Prefixing the files with `include-raw-` make the file name longer
and also not a standard to be followed.

Change-Id: Id8898a6f6bfa595fd43d80e1f58625c55a1674dd
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Set autorelease choosing strategy to default

This job is not a Gerrit triggered job so choosing strategy gerrit is
incorrect and causes Jenkins to checkout the wrong branch. In case of
autorelease Carbon builds #416 - #419 it was checking out the master
branch.

Change-Id: I7a5874b461172313397db7c73948800842f9c65c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update validate autorelease projects for nitrogen

Change-Id: I4fe675c7611d0584cd1ecebcf3aab91a5add6b60
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Merge "Hard-code openjdk8 for validate job"

Hard-code openjdk8 for validate job

The JDK version does not really matter for validate-autorelease as the
correct JDK is configured by the project in their verify jobs. Typically
infra always wants to use the latest version anyway. This fixes the
warning in Jenkins that {jdk} is not found because
validate-autorelease's autogenerator job does not set a JDK.

Issue: RELENG-361
Change-Id: Idb71caf601d5f49a89afaf423573e78dff9ee72c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update SPDX License header to 2.0 format

As defined by https://spdx.org/using-spdx

Change-Id: Ic147d6d919e472a1f81b794bd9075a5c0c97fe72
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Rework autorelease generate-taglist and patch code"

Merge "Use lf-infra-parameters"

Merge "Move validate-autorelease to autorelease project"

Rework autorelease generate-taglist and patch code

Improve the way we generate patches.tar.gz to ensure taglist.log is
always generated along side it.

Jira: RELENG-155
Change-Id: If24e9341f0f69495e028be7a28a9d7fd69980242
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update validate autorelease projects for nitrogen

Change-Id: I677b58e3ae1ac60a21881685de1e4b01c8df642e
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Use lf-infra-parameters

RELEASE_BRANCH is actually just GERRIT_BRANCH so simplify scripts by
removing parameter duplication.

Change-Id: I93d7b0f221133e42788b2ff377319712dd945657
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Move validate-autorelease to autorelease project

Maintenance of this template is the responsibilitiy of the autorelease
project so move the template there.

Change-Id: I1540c160c0552c04f7a6f8080de4acd65da457bb
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

DO NOT create a tarball in the same directory

Creating a tarball in the same directory as the directory that you are
tarballing turns out to be a bad idea. This fixes the mess caused by
Ib7b68bfceca23c796885937f0d07bc520126aebb.

Change-Id: I4c3b4fd12710619084914d7ab24b4b8c02573fba
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Fix tar command failures

AR and validation jobs are failing on the below error:

tar: patches: file changed as we read it

Issue is because dir `.` changes as patches.tar.gz is created.

Change-Id: I4b939f5821e54bfd76fa4f2cafa2e64518101f91
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Revert "Use lf-infra-parameters"

This reverts commit d51dbb74ba2115f10dea28fe069dcecc6076107a.

With this change $BRANCH is not being set correctly which is
causing validate autorelease jobs to fail.

Change-Id: Ia6cada05f1ed9cf44451cf142271a7e822a7cc0b
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Change all the --{no,non}-verbose to -nv.

Some of the versions of wget use --no-verbose and others use
--non-verbose both all of them use -nv for the short form
so this should work on all versions of wget.

Change-Id: I7bee02f30291239b8ae0d6e965aeb309395b1825
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Merge "Switch to using global-jjb mvn macros"

Merge "Use lf-infra-parameters"

Merge "Refactor notify-build-failure script"

Merge "Archive patches by doing so in script"

Merge "Add 6Wind quagga to ubuntu16.04 and centos7 images"

Switch to using global-jjb mvn macros

Change-Id: I018f56c6cd43687b50734357b3fc5f6c58db319a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Refactor notify-build-failure script

Rename to a shorter name and add a docstring to explain what the script
does. Also use -nv for wget as it is a consistent parameter for wget
whereas certain versions use different long-form parameters.

Change-Id: I67a04f69145446d45dbb903b842f43f081fc97f7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Archive patches by doing so in script

Archive in script so that we do not need to pass archive-artifacts
parameters.

Change-Id: Ib7b68bfceca23c796885937f0d07bc520126aebb
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Use lf-infra-parameters

RELEASE_BRANCH is actually just BRANCH so simplify scripts by removing
parameter duplication.

Change-Id: If8677ce5bee0398ae04eb9b32580c59413c32e74
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update validate autorelease projects for nitrogen

Change-Id: I0c0d652d86b3399867ce3e25b7859c61fbf80a19
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Merge "Revert "Add method to not trigger downstream ar-jobs""

Revert "Add method to not trigger downstream ar-jobs"

This reverts commit d69988e8377ff4c48aed40fce140005abe4fd709.

Change-Id: Ie2f0a9e7e0247ba427fa8fd8f8bdd1213a921208
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add 6Wind quagga to ubuntu16.04 and centos7 images

Description :
6wind/zrpcd is opensource to handle the the quagga framework from
SDN controller and it will install dependency packages based on
OS flavors like CentOS7 and Ubuntu version 14.04.*,16.04.* &17.04 along
with quagga packages and default version will be v1=L3VPN and v2=evpn

Issue with the dev scripts (as noted in thread) is now resolved on
zrpcd repository. The changes on zrpcd repo is baselined to tested
version (20170731).

Ref:
https://lists.opendaylight.org/pipermail/dev/2017-May/003724.html

Change-Id: I5f4ad020ff85c75141ad7ee87a551bb2d588040b
Signed-off-by: maheshl <mahesh.loni@altencalsoftlabs.com>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

ar-jobs need to retain data for at least 30 days

Change-Id: I92c1e8b6f13246a2abaaa49453f44794b27c62b1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Fix packaging archive publisher missing

The publisher archive-artifacts was removed in patch
Ib640a3528fb64fbf666df8f026f4e2313f290472. We're trying to discourage
the use of archiving artifacts to Jenkins. This is a temporary solution
to fix the builder-merge job but long term we need to move the archives
to logs.opendaylight.org if it's small log like data or Nexus if it's
large RPM packages that need to be saved.

Change-Id: I7c2e2597d1d2e77322d0ff5922954ab43ed7d71d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Add method to not trigger downstream ar-jobs"

Merge "Add RPM upgrade test job"

Add method to not trigger downstream ar-jobs

When we are triggering many autorelease jobs per day we do not wish to
trigger distribution-test jobs for every run otherwise it will spam the
Jenkins queue. This allows us to selectively disable triggering the jobs
when we manually build.

Change-Id: I42aef04607a5133f45db85eb51b556dc0a7c7955
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add RPM upgrade test job

Also refactors other package test logic to break it into smaller chunks
that can be combined in various orders in various jobs for better reuse.

Change-Id: I4a4e3df6f63a219f8caa1ff0fe470cc307093f1e
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>

Use lf-infra-properties

Change-Id: I6bb7031b52b782187cfe06275c6cd314f5db7c89
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Refactor prepare-release.sh macro

Rename the script so that it has a better name. Also add a docstring to
the file to explain what it is for.

Change-Id: Id4d31e39f2d33b608ebb410648a53b49e7db9722
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Drop RELEASE_TAG from Nitrogen onwards

Change-Id: I5547e0c4cb77ee80e34cbfce8e848d384b3ccae9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Simplify autorelease to not use release tags

Release tags for carbon, nitrogen and future releases are set as
the stream and no longer uses the format `Carbon-SR1`. Only for boron
the same format is preserved if any hotfix has to be released.
Therefore, pass stream as the default release tag for all releases
except for boron. Also the scripts are modified to set the release tag
as $STREAM by default.

https://lists.opendaylight.org/pipermail/release/2017-July/011619.html
Jira: releng-323
Change-Id: I7ecc4d3962bab741bc31efa636beb986b4b15476
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Make distribution-check-{stream} faster

Contrary to {project}-distribution-check-{stream},
more steps can be skipped for Integration/Distribution patch checking.

Change-Id: Iebef37bf5551a2b0fd0796939517c2d9a82edf6a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Merge "Bug 8771: Allow multipatch use not released change"

Update validate autorelease projects for nitrogen

Change-Id: I15683e694f0b97165c7c1786e6e0b2140926e95d
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Update validate autorelease projects for nitrogen

Change-Id: I71bea301fefb4fdc69a46054fbc08a9c797509ae
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Update validate autorelease projects for nitrogen

Change-Id: Ieda710ea522c312a64e8c85364293616d897e9c6
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Bug 8771: Allow multipatch use not released change

Primary target is Nitrogen Odlparent.

Other projects only depend on the released version of Odlparent,
but the Odlparent repository contains snapshot versions only.

Suffixing 'r' now allows multipatch to drop "-SNAPSHOT"
within all pom.xml files in projects marked as such.

Also, filename of the bash script is shortened.

Change-Id: Id9e5b17db5d2a2b2d09ee0dd336295aa6f4b572b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Merge "Fix multipatch script to pass ShellCheck"

Merge "Fix deploy-controller-run to pass ShellCheck"

Merge "Fix start-cluster script to pass ShellCheck"

Merge "Remove ignore for files that pass ShellCheck"

Update validate autorelease projects for nitrogen

Change-Id: I6fb70f88f5fd7f4ea1f6c7f472ee64dded868f01
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Increase build timeout for devstack and jbuilder

Newton takes longer than 60 mins to build, which fails
the packer jobs. The java-builder is very close to the 45 minutes limit
so bump it to 60.

Change-Id: I9c19add622743faabc864c4f53c2a49b03941312
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix multipatch script to pass ShellCheck

Using exit 1 for cds for now but we should probably redesign this script
to use `set -e -o pipefail` in the long term.

Change-Id: I18899c80e548d4ecce701241e22aa563b83bae97
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Fix deploy-controller-run to pass ShellCheck

Change-Id: I559cdf096907b76cac3c44b5a42c75c6d3269216
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Fix start-cluster script to pass ShellCheck

Change-Id: Id4cd46631cc25644e349f7e8600a5e11ac753978
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Remove ignore for files that pass ShellCheck

Change-Id: I9daa01781ecd529debab811171a419ad5bac612a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Enable packer wget non-verbose mode

Also change all --no-verbose to -nv. Some versions of wget use
--no-verbose and others use --non-verbose both all of them use -nv for
the short form so this should work on all versions of wget.

Change-Id: I13a72ee5333739ca1f3a1e6f066cfb9bd3d11f35
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Cache NLTK data in build minions"

Add verify jobs for common-packer

Change-Id: I37bbb31dda8cabbd0c9fa0b830a6fa92ef740e4b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Migrate packer jobs to use global-jjb templates

Remove packer templates and builders from the releng/builder
and use the version of generic templates and builders
made available from submodule global-jjb.

Change-Id: Iecec660af86137d9fda7f1a384d831d09b6087e2
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Remove archive-artifacts publisher"

Merge "Update validate autorelease projects for nitrogen"

Fix Newton Jobs

Openstack client had a new release recently that had
support for tags. There seems to be some issue with
subnet command for Newton.

Change-Id: Ic6d98f7ca8b2a41e1454c7c142d95d4073d6f261
Signed-off-by: gvrangan <venkatrangang@hcl.com>

Cache NLTK data in build minions

Change-Id: I49d5470777b811e8d96bffcd14ecd0ca67697c42
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Move from NetVirt jobs to use ocata

Change-Id: Ibb9bbbdd655a5c23a8a1f8d9ab285cd7fe6ef09f
Signed-off-by: Sam Hague <shague@redhat.com>

Update validate autorelease projects for nitrogen

Change-Id: I0ae48817fb7ab98dfc280421aeb84e892d1188bd
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Migrate odlparent to using global-jjb CLM jobs

Change-Id: I0454ed7840f95dacaf4fff18e50221269daca8b7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update global-jjb to v0.5.5

Fixes issue with CLM jobs missing key variables when we tried upgrading
to v0.5.3 last time.

Change-Id: I30186bc13ad138265c0df911981fef6c13fed68c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Remove archive-artifacts publisher

The publisher is unused and keeping this causes confussion with the
archive-artifacts variable.

Change-Id: Ib640a3528fb64fbf666df8f026f4e2313f290472
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Update validate autorelease projects for nitrogen

Change-Id: I66255fb26e08fb6b8a279d7b6907e4e3c7b55e2c
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Restore nitrogen jobs to use int distro

Change-Id: I742617e048b358932a7cecb291498618d23b162f
Signed-off-by: Sam Hague <shague@redhat.com>

Merge "Revert "Update to global-jjb v0.5.2""

Revert "Update to global-jjb v0.5.2"

This reverts commit 21f26a2f6d9aacf4faf91cd7ffb906fb114ecaef.

Change-Id: I2adb1943b6a7023ffb66adfe35184e94bf3671ca
Signed-off-by: James Luhrsen <jluhrsen@redhat.com>

Merge "Use smaller vms for devstack jobs"

Update to global-jjb v0.5.2

- Pull in Add generic packer templates
- Pull in Cleanup Coala config
- Pull in Add Nexus IQ CLM scan job
- Pull in Add missing content/repositories path to URL
- Pull in Check for JIRA URLs on JIRA based projects
- Pull in Validate URLs using Jenkins env variable
- Pull in Add whitelist and admin-list params to gh trigger

Change-Id: Ie2d9e77ba2625fc0534254ea8ee4d5bc3bf46182
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Use smaller vms for devstack jobs

Change-Id: If50d7af2338b7a63bc0194b9d0a83b5128d36cc3
Signed-off-by: Sam Hague <shague@redhat.com>