Remove deprecated bgp and pcep "all" features from userfeatures carbon jobs

Change-Id: If2fe7c17cef0dbb7952a53eedad75016d78e0508
Signed-off-by: Peter Gubka <pgubka@cisco.com>

Fix docs-rtd curly brace escape

Didn't realize in the previous patch
I0ed5176a3216b6a115bd2bae527df4bb5b1d2c45 that we needed to escape curly
braces but keep {rtdproject} as it's a JJB variable we're passing in.

Change-Id: I7357262e12219c642f29d507087e5ea1a45496a6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Make RTD docs job build correct branch

We can use version_slug post data to pass in the docs version to build
in ReadTheDocs.

Change-Id: I0ed5176a3216b6a115bd2bae527df4bb5b1d2c45
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Resouce optimize packer verify job to single instance"

Merge "Add jq to baseline"

Add --remove-source-files to rsync call

Autorelease is running out of space and part of the reason is that we're
duplicating artifacts while copying them around to produce the staging
repo. This is an attempt to save some space by removing some of our
duplication.

Change-Id: I71c02437bf027be765d41c90a4e161c79e97e719
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Add VLAN private network support to devstack"

Resouce optimize packer verify job to single instance

* Use single instance of the job for verifying changes
  instead of starting a job for each platform and template
  combination.
* Validate provision scripts bash syntax

Change-Id: I14eceb03130b2c40404bde049b292637d5d6653c
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Enable JJB weekly job

Long ago we disabled this job because we were having issues with the job
always timing out and failing. JJB has since introduced things like
parallel updates which should make this job more stable. It is good to
run something like this once a week to reset our jobs and ensure
there's no discrepency with what is in releng/builder vs the jobs in
production.

Change-Id: I11ca998c907a219c0be05d2473737a37ad6362d9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Allow stack 15 minutes to spawn before giving up

Change-Id: I09be14d48fd4c86773866786455638dbbeca5ceb
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Put link to current job into distribution"

Add jq to baseline

This package is useful on all vm types so install it everywhere.

Change-Id: I756000271ebbc9a2fe0856d421404c85006c004c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Put link to current job into distribution

This is to help with tracking which Changes were tested.

Change-Id: Ieee0fae05068384dcb88b8c73e4f82f1dabaa650
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Merge "OVS 2.5 image packer script is enhanced for openvswitch-vtep installation"

Add VLAN private network support to devstack

Add ML2_VLAN_RANGES configuration to devstack local.conf,
to support configuration of any VLAN networks using the
physical_network physnet1.

Change-Id: I03c637f529763e36046d45e26cd528d4b1d7776d
Signed-off-by: Alon Kochba <alonko@hpe.com>

Merge "Remove odl-netconf-connector-all feature from bgp userfeatures suite in carbon"

OVS 2.5 image packer script is enhanced for openvswitch-vtep installation

Change-Id: Ia622f9a00a24c3c3b31706d0dcc3440e408709cf
Signed-off-by: Dhevendran Kulandaivel <dhevendran.k@tcs.com>

Add git-review to centos systems

Change-Id: Ibd9a23c7064a3f5388553cb65cc483ca3c09ff4c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Remove git-review install from autorelease spinup script"

Remove git-review install from autorelease spinup script

Change-Id: I4d256cc26c84fbed7264011579fd3205da9d702c
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Merge "Remove jobs testing Beryllium and Boron branches of IoTDM project"

installing haveged to try and avoid low entropy causing ssh rejections

Change-Id: I44c9a67ac58c02cab301f8b826344cd289ee7647
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Remove jobs testing Beryllium and Boron branches of IoTDM project

Test suites for Carbon are backward incompatible and there is not enough
capacity to maintain older versions of test suites

Change-Id: Ie10741f1eae77c584ed9a897bbed10d13228b228
Signed-off-by: Tomas Janciga <tjanciga@cisco.com>

Merge "Add git-review to base system"

Remove the setting of ODL_VERSION from robot parameters

Change-Id: I54fae0f36f8d727867402eee24d54ab5e2e06274
Signed-off-by: lbuckuli <lbuckuli@cisco.com>
Signed-off-by: Peter Gubka <pgubka@cisco.com>

Merge "schedule transparent boron/carbon to run every 4 hours"

Remove odl-netconf-connector-all feature from bgp userfeatures suite in carbon

Change-Id: Iec4cb783386899bace50222486b8adce971dd857
Signed-off-by: Peter Gubka <pgubka@cisco.com>

Merge "Remove JClouds configuration"

schedule transparent boron/carbon to run every 4 hours

Change-Id: Ic41d3dc1a87bbe91da66008847e60ece3ae2935b
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Do not clone builder repo in Heat task

The releng spinup scripts already clone the builder repo to /builder on
the host system. Save us from wasting extra build resources by not
cloning the repo again.

Change-Id: I6790f4729148441b6b69706fc0ef854427e4077b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Enable Heat for csit-1node-periodic template"

Merge "let number of hypervisors be 1 in the case that it's a single node openstack deployment"

Merge "removing unused and old script"

removing unused and old script

Change-Id: I555a442a61a7c95220286b049e52fbacec2bf195
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Remove JClouds configuration

With the Heat migration complete we no longer need any of the JClouds
related configuration. Cleanup the obsolete config.

Change-Id: I12c55eabb7bc0a7c9e6820fb34c87760fc5e32c3
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Enable Heat for csit-1node-periodic template

Change-Id: I9c95849443816e10061dc0bf2dabedf910eede8c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Enable Heat for csit-1node and csit-verify-1node

1node-periodic will be complete in a separate patch.

Change-Id: I0729a1cd279d09a6f31593900a9c33e9f7cd1d4c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Fix netvirt csit-1node openstack jobs

Missed some job config during the openstack template migration for Heat.

Change-Id: Idb275a37ddde50fbe3f0801aa94ee96880887723
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

let number of hypervisors be 1 in the case that it's a single node openstack deployment

a recent patch [0] was merged to double check that devstack has brought up the correct
number of hypervisors in the multinode openstack deployments. this patch didn't take
in to account that some jobs (e.g., vtn's openstack job) is doing control and compute
in a single node. this should fix that.

Change-Id: Ib7fd8a8c1d854199c0b501d2f3f71104c1914d87
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Merge "Enable Heat for integration-csit-verify-1node-library job"

Merge "Remove old branches from yangtools csit"

Remove old branches from yangtools csit

There are no plans for backporting yang-system-test artifact to pre-carbon branches.

Change-Id: Ied82a25b7a1d4e362d66dd3477a5b5e343fadd37
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Make system detection script detect gbp for Heat

Our Heat script uses the gbp part of the image name such as "Ubuntu
14.04 - gbp - 20161031-0916" to detect which image spinup script to
initialize. This patch makes removes the os portion of the hostname as
it is not used in Heat instance names.

Change-Id: I36fd58271bd7a67721e65dbc4724e088c0f1f8bb
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Enable Heat for integration-csit-verify-1node-library job

Change-Id: I0c330fe29535c381d08dbb2c6d04463cc282db83
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Enable Heat for docker templates"

Merge "Enable Heat for openstack templates"

Add Gerrit Trigger for guava21 autorelease job

Change-Id: I1f90fddd7100d12ec0f3b5adb89150b7d6fb0814
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Use jenkins-$SILO as ssh user

Fixes the guava21 build in releng.

Change-Id: Ib1e3e97ff9b1243724472ed4377b4ac777dd9b92
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add autorelease-release job for testing guava21 changes

Change-Id: I8c5222bd41223a7cd9d49d7d508c4af2d3b476d3
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Enable Heat for docker templates

Change-Id: I34af08adfb501cdd7dbaee39d8f6bb8e415a0ac1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add git-review to autorelease spinup script

Temporary measure until Ie03aa8a6364076690e5963b422c17e4feb70a6e2 is
built and updated.

Change-Id: Ib742cf4bc7967bdeb55023e940e613c5485a8453
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add git-review to base system

Having git-review on the system is extremely useful for downloading
Gerrit changes easily using the Review ID.

Change-Id: Ie03aa8a6364076690e5963b422c17e4feb70a6e2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Fix validate-autorelease failure caused by 50171"

Fix validate-autorelease failure caused by 50171

Patch https://git.opendaylight.org/gerrit/50171 broke
validate-autorelease jobs because it modified a script that the job
needed and forgot to update with the new macro introduced.

Change-Id: I15a2e38735403197382554ec0a72c9fa902829a1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Filter out bad environment variables"

Filter out bad environment variables

Change-Id: Id0631226ac1ebd433ff72d079b598e43e1f4f660
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "add support for netvirt-cluster openflowplugin patch-test"

Merge "add nevirt tests for genius patch test"

Merge "Add yangtools system test job"

Enable Heat for openstack templates

Change-Id: I59a4597008a5918c33d36f7688c11d18c2b5fd7d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Enable Heat for {project}-csit-verify-3node-{functionality}"

Merge "Enable Heat for {project}-csit-3node-{functionality}-{install}-{stream}"

Comment on autorelease-generate-release-patches position

Change-Id: Iac10c0465a3183fc7f31aa371b34e39021efe2d5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Enable Heat for {project}-csit-verify-3node-{functionality}

Change-Id: I930f2f4af5cc322608692845b48a7c16ffd8e2f1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Enable Heat for {project}-csit-3node-{functionality}-{install}-{stream}

Change-Id: Id539d5bfb87965c667e54c070f516c816dd3f37d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Enable Heat for {project}-csit-3node-periodic-{functionality}-{install}-{stream}

Change-Id: I82bb89334bfd0fd552f68a8dff729e73505f997d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Add integration-infra-stack macro"

Add integration-infra-stack macro

This macro uses the opendaylight-infra-macro as well as includes the
integration-cleanup-workspace macro and shell script to generate the
stack environment file needed to spin up a Heat system.

Change-Id: Ica4f3a5600b56cf59daef4c79e10e0e6e16d8b12
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

add support for netvirt-cluster openflowplugin patch-test

Change-Id: I51a224d4faa9af92a4d9c1fc196a77c91fee8dd4
Signed-off-by: Ravit Peretz <ravit.peretz@hpe.com>

add nevirt tests for genius patch test

Change-Id: Ib08cfdbfe2d512e2fa00fcaf93b00b07bbb8cd74
Signed-off-by: Ravit Peretz <ravit.peretz@hpe.com>

split autorelease fix-relative-paths step

Currently autorelease-generate-release-patches step contains
both release tag patch generation and fix-relativepaths.sh
script which is missleading.
fix-relativepaths is needed for compilation and is not related
to the release tag patches generation.
Therefore, I separated them.

Change-Id: I68643052b512a566d776d6a4cc557a5c4a6eefcf
Signed-off-by: Ravit Peretz <ravit.peretz@hpe.com>

Merge "add core feature to ofp patch test"

Merge "Default generic mininet to mininet-ubuntu"

Default generic mininet to mininet-ubuntu

Mininet only runs on Ubuntu nodes now. This change is needed for Heat as
it does not currently provide a OS name in the node name to properly
detect the spinup script.

Change-Id: I3247b14d21a95ad8b55d04ac8eb361831c4929ab
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "pin jobs to specific devstack flavored vms based on openstack version"

add core feature to ofp patch test

There is an implicit "all" already built in [0] to our patch test
that will run *all* of the CSIT jobs in the .yaml and does not
need an "all" feature defined. I'm not sure how that {csit-list}
gets created, but it's how it's working in practice, and seems
handy.

So, if this is merged the new gerrit keyword would be test-openflowplugin-core
BUT the old test-openflowplugin-all would still give the same results for
now. However, this will let others (like in this patch [1]) be able to add
more interesting scenarios (e.g. test-openflowplugin-netvirt) and if that
comes along doing test-openflowplugin-all will now include those new ones.

[0] https://github.com/opendaylight/releng-builder/blob/master/jjb/integration/integration-templates.yaml#L1248
[1] https://git.opendaylight.org/gerrit/#/c/50033/

Change-Id: I537a835f0c88998ad73c32f624a32c2017baf90c
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

OpenStack Heat Orchestration Templates

Use HOT [0] to instantiate CSIT instances in the public cloud. The idea
here would be to store heat orchestration templates inside
releng/builder and then use them to spin up the full CSIT labs in the
public cloud via heat calls against the public cloud api.

CSIT jobs will need to be rewritten to have a builder step that
instantiates the CSIT lab similar to what JClouds provides today
followed by a publisher step to clear up the lab at the end of the
build.

Will spin up nodes using the naming format ($JOB_NAME is actually a sum
calculation (echo "$JOB_NAME" | sum | awk '{ print $1 }'):

    $JOB_NAME-$BUILD_NUMBER-{type}

Stack name will simply be $JOB_NAME-$BUILD_NUMBER.

This patch preserves the build conditions for JCLOUDS such that the
common scripts work whether the job is using JClouds or Heat. We will
want to remove the conditional statements once all ODL jobs have moved
over to using Heat.

[0] http://docs.openstack.org/developer/heat/template_guide/index.html

Change-Id: I5cd7fc407119681c48885140ffc8ee594f8cab0c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Reduce printing during wait in distribution check"

Add jq install to spinup scripts temporarily

Currently unable to rebuild CentOS 7 packer due to [0]. Temporarily use
spin up scripts to deploy jq until we're able to rebuild CentOS 7
successfully.

[0] https://bugs.centos.org/view.php?id=12598

Change-Id: Ib340eb37283e02f213e9771eac54bdfec80fb7ac
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Reduce printing during wait in distribution check

Change-Id: I3d49f238886c65819f012a77565b8a01f5f67437
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Add jq command into robot images

jq is a useful shell command to parse json data. We need this to help us
parse openstack commands used by opendaylight-infra to spin up systems using
Heat templates.

Change-Id: I5c5f0ae949c1ac65138379c29228962be985491c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Merge "install ovs2.5 in devstack images"

Merge "Add restconf feature to Armoury CSIT jobs"

install ovs2.5 in devstack images

Change-Id: I97f2b06cd33c42edd8495856077d4a4c1b90adb9
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Merge "Fix Spectrometer deploy job"

add nc tool to devstack images

Change-Id: I31ce6af92297d31b9bd52b947e7bb2b1716483a5
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Fix Spectrometer deploy job

The frontend is starting too quickly before the backend has time to
fully initialize causing the frontend to not successfully start. This
patch inserts a sleep to give the backend some time to update and
refresh the git repos before restarting the frontend.

Change-Id: I143f1f023d0db84a7d0c664dad6b3844343043b4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Merge "Add verification of number of hypervisors to netvirt loading"

Add yangtools system test job

Change-Id: I7b8461509fb6512a8484ecc3d7c5c1fb9ef2b593
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Merge "Update bgp ingest suite not to use netconf-connector in carbon"

Merge "Add vpp topic branch for basic verify and merge jobs"

Merge "Remove routermgr branch since no longer used"

Add vpp topic branch for basic verify and merge jobs

Change-Id: If9990919500fa4fe4a50d8f1f490f0873a91c116
Signed-off-by: Sam Hague <shague@redhat.com>

Merge "Update Jenkins jobs to build rpms using URL parsing"

Remove routermgr branch since no longer used

Change-Id: Iad3d22d4c36e7321c8d5f626b6d7603daa189c91
Signed-off-by: Sam Hague <shague@redhat.com>

pin jobs to specific devstack flavored vms based on openstack version

Change-Id: I1c44a6a9b0893c8f12856ee722f80a78f08a47e8
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Merge "Images with pre-loaded devstack pips and yums"

Update Jenkins jobs to build rpms using URL parsing

Update params of build-rpm and build-rpm-snap jobs to make use of
URL parsing instead of version parsing.

Change-Id: Idf95897157e589ef8afe90e6a62554cb8c193718
Signed-off-by: Alok Anand <alok4nand@gmail.com>

Merge "Create Jenkins job to test RPM"

Merge "Remove Mongo dependency from Spectrometer"