Merge "Update branch cutting script"

Update branch cutting script

- Update the script for Oxygen branch cutting.
- Remove the tags which reference 'jdk' and 'jre'
- Add extra mvn opts for integration jobs

JIRA: RELENG-519
Change-Id: I9834098c4a9878248cc3417780f88a4877fb223e
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Create Fluorine jobs and bump Oxygen branch

Oxygen branch cutting to reflect new stable/oxygen branches and
move master to Fluorine.

JIRA: RELENG-794
Change-Id: I21831211ab5b3a1458354355c3cfbb88bb5bb3ec
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Merge "Revert "Add a swap file to build machines""

Merge "Prepare for git-commit-id plugin upgrade"

Merge "Don't allow retry to fail stacking"

Don't allow retry to fail stacking

Change-Id: I99dbd98638e43e974bbb4ecd13a3d09dee94fc2f
Signed-off-by: Sam Hague <shague@redhat.com>

Prepare for git-commit-id plugin upgrade

We have an upgrade to 2.2.4 upcoming, which will eliminate gitid.skip
property. Add its replacement, so we are ready for that change.

Change-Id: I85a16b588a5a7b8312059170171353f3f8eb7e5c
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Note hardcode validate-autorelease build node

Change-Id: I275b5d063d1013d563b430dd5bbc85062ad729d4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Configure build-node from project

Change-Id: I7b3c8f1842fccbe7c8be7460b029b1156af65905
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Update AR version bump jobs to 4c-16g"

Update AR version bump jobs to 4c-16g

The current version bump jobs are failing because they are
running out of disk space.

Change-Id: I960c173cec96a48430e24b8aea0e56488b06bc24
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Set build-timeout to 60 for lf-ansible-roles

Roles can take long to build if they need to compile something
so allow 60 minutes.

Change-Id: I01616e8c47c0b3fa2e6ab8c964b563e305e5246e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Remove tinyrpc 0.6 workaround"

Remove tinyrpc 0.6 workaround

tinyrpc 0.7 disappeared from PyPI.  The global requirements have
been bumped to 0.8 for it in upper-constraints.txt upstream so
the workaround is not necessary[0]

[0] https://github.com/openstack/requirements/commit/8c314d04

Change-Id: Ie5b421730f27e15c014874a37e14fa3ece905f9f
Signed-off-by: Mohammed Naser <mnaser@vexxhost.com>

Merge "Set default controller VM to 4CPU+4GB"

Revert "Add a swap file to build machines"

As reported by on the mailing list we would like to try backing this
out to see if it caused some instability in the system.

https://lists.opendaylight.org/pipermail/release/2018-February/014067.html

This reverts commit 09b4491f2b61256a75df2547ee400bb02e5d2a71.

Change-Id: Ifc28d2464b233c70b94b179d66a1fb3d49164288
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add dstat to compute nodes to monitor performance

dstat is currently installed on the controller nodes but not on the
compute nodes, this patch will add performance monitoring on the
compute nodes to troubleshoot performance issues.

Change-Id: I37df6efc559dfe377cf744e2aa6a8e13b2b396ff
Signed-off-by: Mohammed Naser <mnaser@vexxhost.com>

Update validate autorelease projects for oxygen

Change-Id: Ia5ae137a6c42a2fc44f1d012c921434ae53cd561
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Set default controller VM to 4CPU+4GB

Change-Id: I6d69829865d249265df5df486e20f291d176b59e
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Update validate autorelease projects for oxygen

Change-Id: I7b6d51bccfa5c6fe3163e45b37508011c9de2ac0
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Switch ansible jobs to ubuntu1604-docker

Also configure the Ansible job to be generically run for all git
repos in the ansible/roles/* path.

Change-Id: I32189ed529baa1cbb97c89ab1e670542f015678c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Use local-*.yaml style Common Packer CFG"

Merge "Additional L2GW CSIT cleanup"

Merge "Disable Karaf test that fails due to ODLPARENT-139"

Disable Karaf test that fails due to ODLPARENT-139

It's preventing new Oxygen snapshot builds from being pushed to Nexus,
which isn't good. The latest ones there also have this bug, so we're not
introducing anything new by pushing new ones.

Change-Id: I619f2f985f730f2af0a28a4c0eb3417fb37ca479
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>

Merge "Add a swap file to build machines"

Additional L2GW CSIT cleanup

Switch to use some of the newer VMs,
cleanup from comments from:

https://git.opendaylight.org/gerrit/#/c/68310/

Change-Id: I8e78e71ea6d17b86b17259ec9d5c3d3f2d6df346
Signed-off-by: Victor Pickard <vpickard@redhat.com>

Fix stacking in queens, cleanup TEP-IP cfg

Tinyrpc version 0.7 was removed from python repo
when 0.8 was released, and in devstack, lastest version
available is 0.6. Not sure why devstack doesn't see
version 0.8 as being available (like I can on my local
setup, something in python env, maybe python version?),
but anyway, installing 0.6 gets queens to stacking again.

Cleanup TEP-IP config that I added earlier for genius autotz.
Changed genius code to use local_ip instead of TEP-IP in genius,
so no longer need this config.

Change-Id: Ic95ae2cc4f5ab39d3084891d30b058fb4c54fe63
Signed-off-by: Victor Pickard <vpickard@redhat.com>

Merge "Fix genius CSIT jobs"

Update validate autorelease projects for oxygen

Change-Id: Ia1c96df4bf742450acc3ee3996fa0f7dd69e7ccb
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Use local-*.yaml style Common Packer CFG

New feature common-packer so that we do not have to maintain
modified template files and instead use local-*.yaml provisioners
for local config.

Change-Id: I57d291177015e68396343377cea3802f956776ad
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Pull in latest common-packer and lf-ansible

Necessary to pull in the Docker MTU fix causing OpenSUSE
containers to fail to run zypper commands.

Change-Id: I8aac010303621a13203aea7210403d902e8893b7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Clean L2GW CSIT, use same VMs as NetVirt"

Remove {project}-integration-{stream} jobs

When we hooked up the old merge jobs it reconnected these old
integration jobs that are not designed to work with the new
global-jjb build workflow. This caused these jobs to deploy
incomplete artifacts when this job should not be pushing
artifacts at all.

Issue: RT-52501
Change-Id: I3607b775316105be7380b97b825dd0faf15c168d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Re-enable orphaned nodes cleanup script"

Clean L2GW CSIT, use same VMs as NetVirt

Some general cleanup, and switch to using same VMs
as NetVirt.

Change-Id: If2c20d17a288f370627b73ccaaa04066fd9fa28c
Signed-off-by: Victor Pickard <vpickard@redhat.com>

Update cloud image list docs

Change-Id: I8933c6cd2129c9586fe1267910b90f2ef3724af2
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Update validate autorelease projects for oxygen

Change-Id: Icda86f3eb2353017b853eb414bc42433748d3284
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Remove ARCHIVE_ARTIFACTS overwrite

Change-Id: I294f5876af8ee542007dacf90c1550d00f4ce8fa
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Default archive-* for integration and merge jobs

Set the default archive-artifacts parameter for integration
and merge jobs. Copied from global-jjb.

Change-Id: If017ecc5ff0d57c891965ec0d33cbbf5d19f2ea1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Pin networking-l2gw client to specific version"

Merge "Add list of resources on stack creation failure"

Add memory to ovsdb build

Change-Id: I5a54b3b20228cfcb8ca00c3d54341a74da4d8789
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Add list of resources on stack creation failure

This will provide useful information on the physical resource IDs
to be able to trace things more accurately, as some failures
involve multiple services and having access to all the resource
IDs will help debugging issues.

Change-Id: I13eb0b2bacfdf5e662f3d468bd75ea7c49b7f2f5
Signed-off-by: Mohammed Naser <mnaser@vexxhost.com>

Re-enable orphaned nodes cleanup script

With lftools v0.12.0 now available we can switch this script
back on. Improve the script to remove servers only if they are
15 minutes old to give them time to connect to Jenkins.

Change-Id: Ia5792a937e41f4da73188b4b38f95028f689345c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Add memory to sdni build"

Add memory to sdni build

Change-Id: I2848e1085c873176eb40305b11a561a8e1bc4180
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Merge "Use 1g machines for the update-validate jobs"

Increase build timeout for ofp project

Change-Id: Ic3623889847a3f870e159790c620f2e8b241c32a
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Merge "Update validate autorelease projects for oxygen"

Use 1g machines for the update-validate jobs

We do not need 8g to run the update-validate job script.

Change-Id: Ia29a5e53046711402f184c77048b61e991121e20
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update validate autorelease projects for oxygen

Change-Id: Ic57802eba7a362910ece1682442144146cb29976
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Update validate autorelease projects for oxygen

Change-Id: If5e06448638649bcd6571be05f2ddcd9fbc21faa
Signed-off-by: jenkins-sandbox <jenkins-sandbox@opendaylight.org>

Pin networking-l2gw client to specific version

The Robot VM was installing latest, which actually
points to version:

    networking-l2gw-2016.1.0

But, the version we need is:
    networking-l2gw-11.0.0

In Pike and Queens CSIT, this resulted in neutron
l2gw commands not being available. This will
resolve that issue, still working other issues
for pike/queens.

Change-Id: I6214b799cfafcf3635579a5918d631dd56955a61
Signed-off-by: Victor Pickard <vpickard@redhat.com>

Use !include-raw for update-validate macro

JJB is fussy on !include-raw or !include-raw-escape. We
occassionally need to swap them to get it working.

Change-Id: I58d87a5a13026fceb0f8d1ba93ce3694c3e86595
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Add ansible role system-update job"

Merge "typo alphabatize -> alphabetize"

Add ansible role system-update job

Change-Id: Ib08a6d0fce44a48a483585123af35a1ad9ed74e0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

typo alphabatize -> alphabetize

Change-Id: If8b92797f6f715509e48e9bbd69a4a52493582c5
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Use ocata branch for ovsdb patch tests

Temporary until we get pike/queens stable enough
for csit, including l2gw.

Change-Id: Ifff0388c9d39fbb71c601f2e573cdf546dfd2dbf
Signed-off-by: Victor Pickard <vpickard@redhat.com>

Add license-checker tox job

Change-Id: I157b66f8a4b82f7072981c3146aa942ba1d64d11
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "remove keywords to reduce logs"

Merge "update tdd-wip to be gate"

Merge "Add global-vars-[releng|sandbox] cfg file"

update tdd-wip to be gate

Change-Id: Iee94869d1dc4a1e07404ee93a01cb6b24e9c0272
Signed-off-by: Sam Hague <shague@redhat.com>

Merge "Set default java-version for distro-check"

Add global-vars-[releng|sandbox] cfg file

New Global Jenkins configuration file used by new jenkins-cfg job
to manage Global environment variables. This patch requires
global-jjb v0.16.0.

Ignore jenkins-config ShellCheck as the files in there are not
actual shell scripts (in hindsight global-jjb should have gave
them a different extension).

Issue: https://jira.linuxfoundation.org/browse/RELENG-753
Change-Id: I7b5683a0ebc2f17ac5fbed86610b82e88253e374
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update global-jjb to v0.16.0

Change-Id: Ic1b535e89e4f2c18317fe9edf24f18b853f79112
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Enable distribution check job for jsonrpc"

Set default java-version for distro-check

Configure the job to use the lf standard variable 'java-version'
with default openjdk8.

Change-Id: I7dd268092e1950c2c64c6f99db91b10918b047af
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add a swap file to build machines

We have heard this a few times now and again on the TSC mailing list
https://lists.opendaylight.org/pipermail/tsc/2018-February/008824.html

It might be beneficial to have some kind of swap available on the
system. There is a pretty good writeup about swap here:
https://chrisdown.name/2018/01/02/in-defence-of-swap.html

Change-Id: Ifc9d57045b54e1b4f9943214e418b41fabf49d04
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Update builder minion labels"

Merge "Switch mdsal-distcheck-oxygen to mvn35"

Merge "Allow mvn-version to be overrided in distro-check"

Switch mdsal-distcheck-oxygen to mvn35

mvn35 does seem to help with the failures which we thing are caused
by metadata corruption. Testing mvn35 seems to fare better, let's
see if it helps long-term.

Change-Id: I167707e6979c47ea9de266106f985685f3465102
Signed-off-by: Robert Varga <robert.varga@pantheon.tech>

Update builder minion labels

Change-Id: I961900e9221a3f21cc6b6ca8492703b3d5f81745
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Fix genius CSIT jobs

1. Run tdd-wip only on oxygen
2. Split nitrogen+carbon to separate jobs
3. Use nitrogen/carbon for verify
Change-Id: Id8950408fef50444d35d10e43b0714217d3c3dbd
Signed-off-by: Vishal Thapar <vishal.thapar@ericsson.com>

Merge "Rename jdk to java-version"

Allow mvn-version to be overrided in distro-check

Defaults to mvn33 however allows projects to override the
mvn-version variable if they wish.

Change-Id: Ic0f6e6a4536593d27161d8bbc36ae01d64376898
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Enable distribution check job for jsonrpc

Add distribution check to the list of jobs

Change-Id: I99884668b0fa2f52cd994fabe7a8b14fdf94f614
Signed-off-by: Anton Ivanov <anton.ivanov@cambridgegreys.com>

Bgpcluster tests netconf feature removal

Remove netconf-clustered-topology from
bgpclustering-all tests.
Remove trailing commas.

Change-Id: Ie6e2c635f1edb0b9fbb904deeb9251c68e4e109d
Signed-off-by: Tomas Markovic <tomas.markovic@pantheon.tech>

Move bier, iotdm, nic to 8G build

These projects fail the merge in carbon.

Change-Id: Ic84827081b24070b3f0f8fd66150241b76a2bac6
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Rename jdk to java-version

jdk is a keyword that is used for configuring the jdk configuration
in a job. This means all templates are inheriting and trying to set
this jdk regardless of if they jdk: '{jdk}' value in their configs
and appears to override that value incorrectly with 'openjdk8'
including the single quotes. This explains why many jobs are
printing the message: No JDK named ‘openjdk8’ found

Change-Id: I9bdf92bb759aec10f97ef355d4b04618cd58d2c8
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

remove keywords to reduce logs

Change-Id: Icae92cc572fa2dbb36f3020e84c3a5657a0c1568
Signed-off-by: Sam Hague <shague@redhat.com>

Merge "Remove netconf-topology"

Merge "Add nofeature port checks to RpM tests"

Add nofeature port checks to RpM tests

Verify that expected ports are open after ODL is started with default
features, and that ports that are only expected after
odl-netvirt-openstack is installed are not open.

Change-Id: I236e976a79147cc2096505feea8d4d689d042e28
Fixes: INTPAK-17
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>

Fix branch for oxygen

We have not branched yet - it should be building off master

Change-Id: I75b19c42077c8f735a07be6a92cd60b64a92a601
Signed-off-by: Anton Ivanov <anton.ivanov@cambridgegreys.com>

Remove netconf-topology

Since Carbon, netconf-topology
is no longer used in bgp-ingest tests.

Change-Id: I1a1d3aba1050b540ad69036bd9f43d8a1b88b79a
Signed-off-by: Tomas Markovic <tomas.markovic@pantheon.tech>

Disable orphaned nodes script

Temporarily disable the orphaned nodes script until we have
a better solution in place. Refer to this Jira for more details:

https://jira.linuxfoundation.org/browse/RELENG-780

Change-Id: I50ca1219a6bd9a7a04632d8e5831a575789b3c1d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Add install-common-functions"

Add install-common-functions

Edit integration-templates.yaml so
there is install-common-functions before
integration-configure-clustering as that was
changed as well in patch /c/67796/

Change-Id: I74c7d430b969c2e34f3be2aea884b12313c840ce
Signed-off-by: Tomas Markovic <tomas.markovic@pantheon.tech>

Upgrade GBP jobs to 2c-8g VM

Change-Id: Ib08bbc24ff9a88df2b906c0236c3359677200e0d
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Remove unused integation4 templates yaml

- I don't think this is needed any longer and is just a relic
of our migration from karaf3 to karaf4

Change-Id: Ic41c18cca818ce26511d1138be57c8ffb1afc004
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Merge "Add xz option to use more threads"

Pass CONTROLLERMEM to set_java_vars

- some custom scriptplans call scripts that tweak the
  CONTROLLERMEM variable and we need to know that updated
  variable when running the set_java_vars function

Change-Id: Id0bfc69f4f652af3e5632c366942d131a97988b8
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Add xz option to use more threads

Change-Id: Ie6abd5ee4116a9a299ef741bf881fd85eb116b05
Signed-off-by: Sam Hague <shague@redhat.com>

Merge "Install mvn via lf-maven-install macro"

Install mvn via lf-maven-install macro

The macro is currently our standard way to get Maven onto a system.
Also add mvn-version variable to allow the template to be overrided
with a different version by the projects.

Change-Id: Icc0e945f344ddaddb9b2b865c7ed165fda6fe46d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>