Update automated project templates

Change-Id: I8f9f887abeec333dbabecdfc5735b3f90fdc9959
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Enable archive-builds on all releng templates

Change-Id: I1039f06f7d02e5a64c023c71af70e96201cdb3be
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Rework archives directory format

Change-Id: I9318ffa2a06b3a918263eb678a75ad700f7171f0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Remove Gerrit notification script

It seems ssh-agent is not passed to publishers so will have to rework
this code to run as a builder step in a later patch.

Change-Id: I856468e91087ce39ea24308ad864dd45c500fc85
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Enable archive-builds macro on all builder jobs

Change-Id: I524e09a09b8de138f2ee185bda41d91d91be7e42
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Cleanup workspace at end of build

Add to archive-build macro to cleanup workspace at end of build.

Change-Id: I387506eb526f4cc24eff08abdd1d4b0d47eb13dc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Remove systemctl calls

The systemctl restart docker hangs on the RPC and doesn't appear to be
necessary. Stopping firewalld is already handled by other scripts so
should already be disabled as well.

Change-Id: I778a5a33fa0653ab318cd61d1f200366b8437d24
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Use OpenStack cloud plugin to provision slaves

This requires jenkins-job-builder version 1.6.0 or above,
so requirements.txt is updated to 1.6.1 (current latest).

Change-Id: Ibe282bf3708532d137c18c302b2fc80d9d1d8742
Also-by: Jamo Luhrsen <jluhrsen@redhat.com>
Also-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update integration templates to copy ssh keys to slaves

We are automatically generating jenkins ssh keys at spinup. This patch
uses the generated keys and pushes them to slaves for robot tests to use
as authentication.

Change-Id: I847557cde565b54f2e5b4abf0f101384d0250c6b
Also-by: Jamo Luhrsen <jluhrsen@redhat.com>
Also-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Use predictable maven-settings naming scheme

With JJB 1.5.0 we can use predictable naming schemes for Maven settings
files. Also set settings-type as cfp.

Also regenerate all configuration files otherwise the update will put
jobs in a broken state on update.

Change-Id: I7050b8d8ac922c8a9ae3123a2c333c14e272b7b4
Also-by: Jamo Luhrsen <jluhrsen@redhat.com>
Also-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Add template for nodejs jobs"

Update automated project templates

Change-Id: Ic7dfdbd61c7b1e238cebd7d90b954f7aed81180c
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Unify maven goal options some more

* Make sure '-V -B' options are explicitly included in every maven goal
* Do not add them into MVN_GOALS

Change-Id: Ib3a54a482704f6a701bc94fe1ecba2f92619dfd8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Add automatic yes answer option

Change-Id: I2ac6f4ebe1b84d35ee084d065e38704ac9780c0f
Signed-off-by: Peter Gubka <pgubka@cisco.com>

Merge "Reorganize jobs for OF plugin swap"

Add template for nodejs jobs

Also add some documentation about the python and node verify jobs.

Change-Id: I92b1c6072b22402042dda04117b8931cab49e249
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Reorganize jobs for OF plugin swap

- In master add helium-redesign label for He plugin jobs.
- Also some jjb code cleanup.

Change-Id: I6404c2f802c57fdb76f23ea0cb0bd3e528514773
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Install netaddr package which is needed by some custom mininet topologies

Change-Id: Ie5891b37fde18ba66c730b78cebd26b54a67eab0
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Merge "Cleanup of SXP Jenkins Jobs"

adding odl-bgpcep-bmp feature into boot features

first bmp suite is added https://git.opendaylight.org/gerrit/#/c/40589/

Change-Id: Ib4f274216439c69244761077dda82bb7cc38031d
Signed-off-by: Peter Gubka <pgubka@cisco.com>

Merge "Changes to paramiko installation"

Update automated project templates

Change-Id: I458b2116c7a23201876955525c45ec39b4a43c54
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Set distribution-check build history as other jobs.

Change-Id: I64b3ce8b8337c56a0542375f7ae7062ecfc958d2
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Cleanup of SXP Jenkins Jobs

Removed Dependencies on TCPMD5 project, updated install-features
for CSIT with odl-sxp-controller instead of odl-sxp-all which are eqivalent.

Change-Id: Iba526a6e99eb3a9d71b9f1e80c2360bc8d1c798c
Signed-off-by: Martin Mihálek <mamihale@cisco.com>

Changes to paramiko installation

Forcing an older version of paramiko should not be needed anymore.
Also, installation of robotframework is not quiet anymore,
as it is useful to see version constrains the modules print on installation.
Every package install contains --upgrade to confirm we are using the latest version.
Comments improved.

Change-Id: I2fcb715dce29bd9b03e793f8fc0c478cc78a1520
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Merge "Add scalability jjb for ocpplugin"

Add macro to deploy archives to Nexus

Requires the Description Setter plugin:
https://wiki.jenkins-ci.org/display/JENKINS/Description+Setter+Plugin

Change-Id: Ibc3d4a74416995b699e420864626dabd8a3c0658
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Remove redundant feature from jjb file

odl-jolokia was added to the template, it is removed from
the netvirt 3node job.

Change-Id: I41eabf3f69b43efc2f18fbdb5e17eacefdbcd574
Signed-off-by: gvrangan <venkatrangang@hcl.com>

Add scalability jjb for ocpplugin

Change-Id: Ia516d501c5e4e9c210b3142e8300e50320b21d4a
Signed-off-by: jason <jason.cw.yuan@foxconn.com>

Merge "Update automated project templates"

Update automated project templates

Change-Id: If79cf91d2b976a8eafbfa1d98e5c89881bd017e4
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Merge "Do not spin up mininet slave for aaa jobs"

Do not spin up mininet slave for alto jobs

alto csit jobs do not appear to require mininet slaves so don't spin
them up during test.

Change-Id: I6760f4a5ad7ab7f4e8afd1ea9c0aa6c1f67d9859
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Do not spin up mininet slave for aaa jobs

It seems aaa csit jobs do not need mininet slaves so save resources by
not spinning any up.

Change-Id: Ibb8034a04e9271acd1b0b38564a6857f8b98b40d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Skip validate-autorelease on drafts and no-code-changes"

Merge "Set submodule timeout to 60 for autorelease jobs"

Set submodule timeout to 60 for autorelease jobs

Similar to 45b8cface05c3d2bd9fa8e4dc50181e05cc44113 we should bump
autorelease submodule timeout to 60 minutes in case of slow network.

Change-Id: I37dd00eea03624a0f19b49a587819e3cd5f9fee4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Adding CSIT Jobs for Natapp"

Skip validate-autorelease on drafts and no-code-changes

This is a spiritual successor of 39536 (the third point)
but this affects all projects, not just integration/distribution.

Change-Id: If15aeeb4168cef36381062923343ba1289bf0353
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Adding CSIT Jobs for Natapp

Change-Id: I6e5a28ed7787d33b7fe5e55dad36fdfc34f3a466
Signed-off-by: thomaslees <thomaslee.s@tcs.com>

Merge "add netvirt 3node tests back to distribution-test"

Merge "add ovsdb southbound back to distribution-test"

Revert "remove l2switch CSIT from Boron and Beryllium distribution-test"

This reverts commit 178586ae641debaa95bf6b2bcbda145309503d17.

Change-Id: I2cc3980f95d9f3733f713f5fa4baf244c8f41f0a
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Merge "Install openssl-devel on robot VM"

add netvirt 3node tests back to distribution-test

Change-Id: I5ae8e6ecc4ac0f4ea18e0b0ab56a134777fec7da
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

add ovsdb southbound back to distribution-test

Change-Id: I362305ab12e129a1cab77bc003938f8249b9d05d
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Update automated project templates

Change-Id: I59fc1a5ea85d1865a8bb86694c4f6574868c5a45
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Set submodule cloning timeout to 60 minutes

validate-autorelease seems to consistently take over 10 minutes to clone
lately due to the public cloud -> private cloud network. Let's bump the
timeout to 60 minutes to allow for spikes in clone time.

Also add missing credentials-id parameter.

Change-Id: Ie76805b67ea1fc69854761b7775c81a71278a5ec
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Enable batch mode for the remaining templates

Change-Id: Id5d060f3cc2f7a08d2fffaefebba0036f82d54d0
Signed-off-by: Stephen Kitt <skitt@redhat.com>

Merge "Add Job for bulkomatic cluster test"

Merge "Add usc tcp tests to integation test jobs"

Update automated project templates

Change-Id: Ie6fcf17c9728aa4efb050c5a1f3bf39ec12524ce
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Merge "coretutorials master should use JDK8"

coretutorials master should use JDK8

Boron requires JDK8, hence use that to validate.

Change-Id: I17ba09a15af1675626188958319eceae728ea318
Signed-off-by: Robert Varga <rovarga@cisco.com>

Revert 8G VM changes

It seems the amount of jobs that require 8G VMs is pretty significant
making the majority of VMs that spin up needing to be 8G anyway so we
don't really get much benefit of spinning up the smaller VM types.

The server side has been reverted to running 8G VMs by default for the
dynamic_verify and dynamic_merge labels.

Change-Id: I8c049f4ace9dbe824b1eb06d7b12fe30b8d4fb45
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update automated project templates

Change-Id: Iecc03367161980511c7688f85c47e71a031c41f5
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Merge "Switch validate-autorelease jobs to 8g VMs"

Switch validate-autorelease jobs to 8g VMs

Change-Id: I0f3a71b803acfd288152b3d0bb79cdbc80c963b1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update automated project templates

Change-Id: Idc2085cc659afaf29241a683c9c8c92000198db2
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Merge "Switch distribution job to 8g VMs"

Switch distribution job to 8g VMs

Change-Id: I32491ea7d6094d06e169503e803d1bc20cb9d9eb
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update automated project templates

Change-Id: I55ecd6799d170e67c99204101f81b672e3e2ff8c
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Switch distribution-check jobs to run on 8g VMs

Change-Id: I066ce0708ebf377cb0277ba022714d5ade07c5a3
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add usc tcp tests to integation test jobs

Change-Id: Icfa5869a828735680ab24fcf72cb707bc337c9d5
Signed-off-by: victorxu <s.xu@huawei.com>

Make opflex use 8g vms

opflex requires more memory than most odl builds. Configure them to use
a new label for 8g systems.

Change-Id: I687bee29791bb9a7adea5d69678607e62f8c100b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Disable query plugins info in example

Change-Id: I251a71e2a34e8ae7304eb927e0e071abe3e1a793
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Send ServerAlive messages from ssh clients

To hopefully fix our git timeouts from gerrit let's make sure that the
clients are sending ServerAlive requests.

Change-Id: Ib02de317d541bc815bfe8d3eb43019eb94a91b15
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Fix autorelease-distribute-taglist path

The distribution repository is under integration/.

Change-Id: I720532972e943addf54a8ad5e9b21479f193661c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Add Job for bulkomatic cluster test

Change-Id: I2b8f6b2d09676e6cc5ae41b933b5c227aa37520a
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Merge "Improvements to distribution verify/merge jobs"

Merge "Include taglist.log in integration/distribution karaf"

Merge "Provide maven settings for distribution related jobs"

Include taglist.log in integration/distribution karaf

https://lists.opendaylight.org/pipermail/dev/2016-June/002148.html

Change-Id: Iaf3623cd2eb01b47f6697df58893ecf02214529c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Merge "remove l2switch CSIT from Boron and Beryllium distribution-test"

Modify MTU in the openstack nodes to ssh to the created VM instance

Change-Id: Icdc151871d808fc40b71bff10092f092d0e1a122
Signed-off-by: gvrangan <venkatrangang@hcl.com>

Remove defense4all JJB

The defense4all project has been moved to an ARCHIVED status per the
2016-06-09 TSC meeting. As ARCHIVED means we do not need to keep Jenkins
jobs live this cleans up the job definitions.

See:
https://meetings.opendaylight.org/opendaylight-meeting/2016/tsc/opendaylight-meeting-tsc.2016-06-09-17.03.html
Section 15.e for the vote.

Change-Id: I5cde3048bb063c0ec52369502b2a65f850c9b025
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Update automated project templates

Change-Id: I884da520dce21cbabee9d1e6756082850ce0030a
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Merge "Revert submodule timeout back to default 10 minutes"

Revert submodule timeout back to default 10 minutes

We tried this to see if it helps with the validate-autorelease job
cloning issue but it seems to only have caused us to take 5 minutes
longer to fail the build.

Change-Id: Iae90d6e57710e2dfd66221ae3795cbe3ae08e6e0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update automated project templates

Change-Id: I74f6e44d7207eb9f2d7e881fc5c12bf8305cb06d
Signed-off-by: jenkins-releng <jenkins-releng@opendaylight.org>

Add honeycomb/vbd to autorelease check job

Change-Id: I98480041e2df78286a3f0d0a69abbecdbc13085d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

remove l2switch CSIT from Boron and Beryllium distribution-test

Change-Id: Ie7facf9a0fcb21a40c3c6a74f4b8b7d1d26c8ea2
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Wipe also non-ODL artifacts before building autorelease

When testing https://git.opendaylight.org/gerrit/#/c/35558/4
At first, my local tests were passing,
but they failed when I deleted one non-ODL artifact from my .m2 repo.

This Change will make sure ODL projects have all dependencies ready for packaging,
not relying on them just happen to lay in the local maven reporitory.

Change-Id: I58593bd99fd215feb295dbe9701bb2a50bf1f9f4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Merge "Add distribution-check in yangtools jenkins"

Update automated jobs

Change-Id: I493d8246278d81e2c7895788fa67a784716e0523
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Create bundles for autorelease post release tagging

Start treating all releases as possible release candadites which can be
released at any time the TSC approves a release. All autorelease jobs
will now contain an additional variable *next-release-tag* to signify
the next official release version.

See mailing list discussion thread here:
https://lists.opendaylight.org/pipermail/release/2016-April/006299.html

The release engineer can pull down the bundle files and run:

    git fetch /path/to/project.bundle
    git checkout FETCH_HEAD
    git tag -asm "OpenDaylight [release] release" release/[release]
    git push gerrit release/[release]

To push the build tags to Gerrit. This should cut back on the amount of
patches needing to be pushed to Gerrit for review by half and only the
x.y.z-SNAPSHOT patches need to be pushed.

Change-Id: I53bb95236e41c7e99a12c312e5158db51a9f4e67
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "move urllib3 and httplib2 upgrades to happen after devstack is done"

Make ovsdb-full-integration job build against gerrit-trigger patchset

Change-Id: I780e90ef434620417c67fc8403f99fdbc056461d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

move urllib3 and httplib2 upgrades to happen after devstack is done

Change-Id: I15e3629f2acb5b120792003ba5262000686d834a
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

add gerrit refspec to full-integration ovsdb job

Change-Id: Ie69f02d1632a59ff98d0d06c921685ae4bd0ab32
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Fix full-integration job to only run against ovsdb project

Change-Id: Ic3206a4fb8d824d8f2f2931059503a164619a68c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

add project and branch info to runit gerrit keyword

Change-Id: I0f83e68821d0485dba498a68d3cc2800546e1a71
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Merge "Add a trigger to run integration tests on OVSDB project."

Rearrange the user creation step for slaves

With the change from JClouds to the OpenStack slave plugin we need to
fully manage the creation of the Jenkins user. This modifies the timing
of when the user gets created to be the last step. This will hopefully
prevent us from having issues with the init scripts not having been
completed before a job starts on the system.

Secondly, we handle adding Jenkins to the docker group in a slightly
more sane manner but without breaking our current production setup that
executes some, but not all of these scripts and in a different order.

Change-Id: I8d88cd0d9de6b3defd6615faa474e4ce8d583ea4
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Fix autorelease settings-type for Maven

Change-Id: I6541414902914a01e12a6a6f15c8dc9cfaa4418a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Add Python temp files to .gitignore"

Improvements to distribution verify/merge jobs

+ Use the same maven goals as other projects.
+ Include stuff related to Java code and Maven sites.
+ Use new trigger which ignores drafts and no-code-changes.
+ Move lines for global settings before project settings.

Change-Id: I8aad82d1b7928c6890e1bfd7db373e8ed4edd79b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Provide maven settings for distribution related jobs

Change-Id: I6e2aaf4fac7f3f5f7077af460eaee7e5c3c2f91a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Install openssl-devel on robot VM

<openssl/opensslv.h> is needed to install cryptography==1.4 for:
cryptography>=1.1->paramiko>=1.8.0->robotframework-sshlibrary==2.1.2

Change-Id: I71d2adba36cc3bce68d9e29e6f74ad4ebdcb902b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Merge "Need more karaf logs history for distribution check jobs"