Merge "Fix shellcheck SC1090 cannot follow source"

Fix shellcheck SC1090 cannot follow source

Change-Id: Idf0bce1211eca6529ffe1f27335ac895c91180ea
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Remove infrautils-validate-autorelease job

These jobs only work if infrautils are part of autorelease which it
currently isn't.

Change-Id: Id4a8283efe7231897f86bced857191f8d0596e04
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Update cloud image list docs"

Merge "Install git-review using pip install in virtialenv"

Update cloud image list docs

Change-Id: I9dacf89359f6a7750abb6a1b6ea7ed4279480e0c
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Merge "Remove dependencies by projects no longer active"

Merge "Bake fedora-packager into java-builder image"

Merge "Remove baked packages from spinup script"

Remove dependencies by projects no longer active

These projects are no longer active ODL projects so remove their
dependencies from our packer builds.

Change-Id: I30c7a6ceba3ca7fb2bd628713faa81ef44ceb513
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Bake fedora-packager into java-builder image

Make the image boot a little more quickly by baking it into
java-builder packer build.

Change-Id: Ia002c6327a676021198199ea054ff3f62abf2553
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Remove baked packages from spinup script

These packages are built as part of the packer build process so no need
to additionally install them during system spinup.

Change-Id: I8223279cd057124c66b3449ad92857ceb282eea1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update to latest java-builder

Change-Id: I7f784c47d38efd28e9949eac052e27d3590e3396
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Revert "Increase packer job timeout to 120 minutes""

Add verify jobs for global-jjb and lftools

Update global-jjb to latest master to pull in tox-verify job and add
verify jobs for lf-infra releng projects.

Change-Id: I47fa9d2edfde867da440eefcc39558bab34d2c7e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Fix shellcheck issue with implicent array concat

Change-Id: I6b16514a9eb5745d64041eb165a89705cb0d8f0d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Revert "Increase packer job timeout to 120 minutes"

Since we reverted https://git.opendaylight.org/gerrit/58436
90 minutes is more than enough to build our images.

This reverts commit 94fe23608b05f41be25f41ac15ed1e9e4b76ebe7.

Change-Id: I8a655c2da2e7caa4ed24147be23bdf6bc60d47bf
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Revert "Make packer jobs build sequentially""

Revert "Make packer jobs build sequentially"

This reverts commit 514da68ea959e926bafc996521a434af8fc9147a.

Change-Id: I1e1a62a7053350713b95e04cd7243c4c000ef7fd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Increase packer job timeout to 120 minutes

90 minutes wasn't enough to build java-builder in the public cloud when
the public cloud is running slow. Increase to 2 hrs.

Change-Id: Idbaa1a1c5225c94a9f3870d2f3965c3c79deb700
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Increase packer job timeout to 90 minutes"

Increase packer job timeout to 90 minutes

Packer takes long to build so split it into it's own project definition
so we can set reasonable build timeouts without increasing the other
builder jobs which only need 10 minutes to run.

Change-Id: I73efe2c583f4661b81233ac448e203788857822b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

No need to pin Cabal for Ubuntu

Ubuntu comes with a sufficiently new version of Cabal to install
ShellCheck so no need to downgrade it.

Change-Id: I7c13adc1cc1982cde6a72b98a845086de803aed4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update cloud image list docs

Change-Id: I8e2db643c88a6d7f54a0320db76fc51c4436f24d
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Build and install shellcheck from the Haskell repo

Pull shellcheck from Haskell repo so that we can pull in a newer version
than is available in CentOS 7 and Ubuntu Trusty repos.

Change-Id: I710c05dab4a088647426190a00d9cf7ab9b175b0
Co-Authored-By: Thanh Ha <thanh.ha@linuxfoundation.org>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Update cloud image list docs"

Merge "Add validate-autorelease job back for infrautils"

Merge "Update Pin RS centos7 image to working version"

Merge "DO NOT fail autorelease if file scripts fail"

Update Pin RS centos7 image to working version

This is an update to commmit 7bcb9c78fbfe76d90527d269bc1721d233800676
where other templates which use CentOS7 are changed.

Jira: releng-118
Change-Id: Ia99264894a95a423a9d15499e9928b3fa731f20c
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Install git-review using pip install in virtialenv

The version of git-review supports --reviewers option which is not
available with the version of the package on centos7 repositories.

Updated the change to handle long workspace names with pip
modules instead of pip, inspired by global-jjb change #5093

Change-Id: I598350d6778760ea320a1128db46da0f80c711db
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Merge "Update packer job to build devstack ocata image"

Add validate-autorelease job back for infrautils

Change-Id: Ic08aef29f19b8ac88eb3b0fa86d5bcd50d45ab61
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

DO NOT fail autorelease if file scripts fail

There are 2 scripts which create a file in int/dist which are sure to
fail if int/dist is not included in autorelease. We noticed this because
of Nitrogen work.

Change-Id: I7a7123c551b420f838b281c810dc1711ef5c90d2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update global-jjb to latest master

Change-Id: Ia25e85040eaaf06c2944d85d6d74ca8f44efbe28
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update cloud image list docs

Change-Id: I539db0aed37b9cc4c3bcfb16114bf612dd6187c0
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Update packer job to build devstack ocata image

Change-Id: Ifaba56767fb4c23988fbb21327b86feed65441f1
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Add devstack-ocata packer template

Change-Id: Ic63c14179ac13a59989ba892466eba5f232849d4
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Also install git-review on Ubuntu systems

Update to d036ff0f which forgot to also include Ubuntu systems.

Change-Id: I93babd64194c7640fbc5a05fb84699eabda0476d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Create a wrapper function for apt-get install

Make the loop reusable.

Change-Id: I1213d07acf19586c2f2775acce488acc39a282d2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Update Pin RS centos7 image to working version"

Update Pin RS centos7 image to working version

This is an update to commmit 7bcb9c78fbfe76d90527d269bc1721d233800676
where other templates which use java-builder are changed.

Jira: RELENG-118
Change-Id: Ida6bd041674b4767db5c2030288ef1b036958239
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Merge "Archive the docs html directory"

Remove validate-ar jobs for non-nitrogen projects

Per this thread:
https://lists.opendaylight.org/pipermail/tsc/2017-June/007428.html

Remove all projects except for aaa, controller, md-sal, netconf,
odlparent, and yangtools.

Change-Id: I88a748e47c36dfc543c33fbaf563e72531e5fa37
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Pin RS Public cloud images to known working

We're having issues with RS Public Cloud when building newer Cent OS
images. This patch pins the public cloud base image we build against to
the last known working one.

Jira: RELENG-118
Change-Id: Iad0ec2d3e312c22042c15973cab0eef58c61fe9c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Update default RPM snap build version to Nitrogen"

Archive the docs html directory

This patch using the new lf-infra-publisher ensures that docs only
archives the html directory rather than including the structure leading
to the directory.

Change-Id: Ie2ff63690203ea7023f2578d4f52719f9d386a52
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Remove opendaylight-shiplogs macro

We've migrated to using lf-infra-publish macro from global-jjb.

Change-Id: I5ec61c188d90bc9d220ace2296bcc57c1544cf2f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Migrate project jobs to use lf-infra-publish"

Merge "Migrate int/test jobs to use lf-infra-publish"

Merge "Migrate int/dist to use lf-infra-publish"

Merge "Migrate docs jobs to use lf-infra-publish"

Merge "Migrate autorelease jobs to lf-infra-publish"

Merge "Migrate releng job templates to lf-infra-publish"

Use -m pip from python instead of pip directly

When the workspace is too long, as can happen with long
job names, there is trouble running commands in the
virtualenv.

this is trying to find all the places this would be
needed, but specifically to address a few current
problems like [0] which sometimes completes but cannot
push logs because the job name is too long.

The idea came from shague [1] which came from
openstack [2].

[0] https://jenkins.opendaylight.org/releng/user/jluhrsen/my-views/view/netvirt%20csit/job/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-stateful-snat-conntrack-carbon/
[1] https://git.opendaylight.org/gerrit/#/c/51699
[2] https://review.openstack.org/#/c/399754

Change-Id: I9e99893d8de69ef0eb7b36309983cedc0befb549
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Remove auto job creation for Beryllium

now that Carbon is released, we are no longer dealing
with Beryllium

Change-Id: Iae74afd9742b03b9ba1e6907a8e3bfd335c4a00e
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Auto Update CSIT Jobs to run

Change-Id: I469ed201c7fccc20a93e39d9a8accdc4941e5bad
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Update default RPM snap build version to Nitrogen

Change-Id: I6b2a19faf31b4c103ce1f4b3956703d68fdff504
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>

Add a workaround for missing taglist.log

Since we fail the build now if any line in a script fails this is
causing validate-autorelease to fail unexpectedly. Temporarily put in
place a workaround on the problematic line so that it passes until we
put in a proper fix.

Change-Id: I31999f0f78d5ca360f20fa14536310924263c0a4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Add Boron branch and csit jobs for jsonrpc"

Add Boron branch and csit jobs for jsonrpc

Change-Id: I2d61fa52846e5ff2b0aa7471f5d39e1fa3d33b41
Signed-off-by: Sreekalyan Devaraj <kalyan.ds@gmail.com>

Migrate project jobs to use lf-infra-publish

This macro uses curl instead of Maven to push logs to Nexus and is a
little bit faster.

Change-Id: Ib46aa25e8f5122865fb9b99ff4b637246247d70b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Migrate int/test jobs to use lf-infra-publish

This macro uses curl instead of Maven to push logs to Nexus and uses
curl instead of Maven to push.

Change-Id: Ic7cf2417d6a2b58a919c3d1ebfc3b36a47c27153
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Migrate int/dist to use lf-infra-publish

This macro uses curl instead of Maven to push logs to Nexus and is a
little bit faster.

Change-Id: I3eee49fb282736329f9715dd9a41ec0b6fea13bd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Migrate docs jobs to use lf-infra-publish

This new macro uses curl instead of Maven to publish logs and is a
little bit quicker.

Change-Id: Id61e5fdbbfbe96a20044b65e3f1b1478d47d0a98
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Remove unsupported Beryllium jobs

Since Carbon has been officially released Beryllium is no longer
supported so remove the jobs.

Change-Id: Iaef265dc8dbc1bc7be87a0b0bed56bb84cf77c25
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Migrate autorelease jobs to lf-infra-publish

Use the lf-infra-publish macro from global-jjb to publish logs. This
macro use curl instead of Maven to push logs which is a little bit
faster.

Change-Id: Ib8238fdb8e8e493cf5a54513f90e1a2e0044bab6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Migrate csit templates to lf-infra-publish"

Better YAML formatting, remove ignore rule

Change-Id: Iaa314b155c1607affdfca9174d861d081dab5a26
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>

Merge "Move git-review into LFTOOLs comment block"

Merge "Add jobs for all pup-odl branches"

Move git-review into LFTOOLs comment block

Change-Id: Ie901a2d53489dab163e49952d9482313cf83bbdd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Migrate releng job templates to lf-infra-publish

Jira: RELENG-142
Change-Id: Ie2b84fcffb7027aec1baf80f5b78d1af0b7c3caa
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Migrate csit templates to lf-infra-publish

Pull in updated global-jjb which contains changes to allow archiving via
ARCHIVE_ARTIFACTS variable.

Jira: RELENG-140
Change-Id: I32cb19ecc962d1849ada527470c21a77782217c5
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Update cloud image list docs"

Merge "Fix version bump git-review publish code"

Merge "Fix cleanup stale stacks job"

Update cloud image list docs

Change-Id: I27c5ed107b45a59642c1fe2902d2087785fa46b6
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Fix cleanup stale stacks job

commit dcba567b0ce17e7cbb3c80b38c45ceb6e490e79d was rebased/merged
does not handle stack status correctly. This change should fix the
issue.

Change-Id: I244d2499eb0dabe2f196e401e4f94cc0869685a2
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Merge "Install git-review through yum repositories"

Merge "Improve multipatch patches-to-build param docs"

Install git-review through yum repositories

Installing through pip as root on the base image  is not
recommend practice since this could impact other deps.

Change-Id: I12f1a4aa1e129a65af43736879ac46f7fe7c3c81
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Add ansible-opendaylight test jobs

Change-Id: I911ff41623739782261aef909774f8f30e2732e9
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>

Add jobs for all pup-odl branches

Change-Id: I968fd0d8056f7273bd6fc58289f5cdf785be2c13
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>

Improve multipatch patches-to-build param docs

Change-Id: I6c805dd8ad3c05f1980e7f6a49efca21f3fc3e73
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>

Rollback the requests libarary

Change-Id: Ieedab3c5e024a3a8ace994ae22b25bf44e940746
Signed-off-by: Peter Gubka <pgubka@cisco.com>

Pin requests to <2.16

The new requests library pulls in a chardet dependency that is in
conflict with coala packages. Pin the version of requests to ensure
we're pulling in a supported version.

Change-Id: I9892a88d6d3cee6152d83b94feaef0e6a1e4998f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add xmlstarlet to base image

This tool is used by lftools to parse xml and is generally useful so
include it in base image.

Change-Id: I6df7061fb00c865d1ed421f3814e3d63643e591d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Add job to delete stale nodes older than 24H on RS"

Merge "Move GC logs from cluster csit jobs to archive"

Fix version bump git-review publish code

Change-Id: I9efe5744448813a495b03f8fbda300254d25d621
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add KARAF_VERSION to variables.prop file

- This way the variable can be passed to distribution test job.
- With this change autorelease can generate and trigger test for
either k3 or k4 distribution. With this change k3 is default.
- Ideally it should be possible to generate and trigger test for
both distributions k3 and k4 but the way the scripts are written
today in autorelease it seems like too much rework.

Change-Id: I7708c95e7ee889a1eae93f05003a630dac06ccc2
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Force deployment repository

Explicitly force the opendaylight.snapshot repository to ensure that we
push to the right repo even if a project pom does not define a
deployment repo.

Change-Id: I066870a9b0c2625ddb0284bc0404c9e922c13aac
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Daily build-rpm-snap job

Adds daily timed trigger to build-rpm-snap job. The resulting
rpms can be useful for downstream projects.

Change-Id: I2316e6817b9a04745efe095a6a5291f073a25bb2
Signed-off-by: Alok Anand <alok4nand@gmail.com>

Version bump should be performing a deploy

Change-Id: I39d95b3f417c72a574feb7bec7ccf0061daf1909
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Add version bump job"

Use stable/carbon instead of carbon for verify

Change-Id: Ibafd4801598182d4cbfe9c1f089ec7f9bfd1b747
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Add version bump job

Create a job that performs version bumping activities via Jenkins. This
job:

    1) Version Bumps by x.y.(z+1) on release branch
    2) Runs a Maven Build and deploys the bumped artifacts to Nexus
    3) Pushes the patches to Gerrit

This patch also archives relevant log information and creates
reproducible patches in case manual intervention is necessary.

Change-Id: Ic03787c6ced6796db067832b0a7c8218e457b216
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Remove table miss flow feature from test"

Pin coala to 0.11

coala-bears 0.11 just released 5 hrs from this patch author date. It
breaks the build because we were pinning coala. It seems coala and
coala-bears versions must match exactly so pin both versions for good
measure.

Change-Id: I06cf7dd2d0e84844563bc8d8b842be99f9a1f168
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>