integration/test.git
6 years agoMove basic vpn suite to use Get VM IPs 83/65583/4
Sam Hague [Wed, 15 Nov 2017 23:23:03 +0000 (18:23 -0500)]
Move basic vpn suite to use Get VM IPs

Change-Id: Ic2bf29fa8c54c7362dbdb26fa12730fb69a9aec9
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoChange Get VM IPs [Documentation] for accuracy 39/65639/2
Jamo Luhrsen [Thu, 16 Nov 2017 20:15:21 +0000 (12:15 -0800)]
Change Get VM IPs [Documentation] for accuracy

Change-Id: I26a677fe93b806ced9bc13611a658f5a6d479402
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoMove elan suite to use Get VM IPs 13/65513/3
Sam Hague [Tue, 14 Nov 2017 22:26:03 +0000 (17:26 -0500)]
Move elan suite to use Get VM IPs

Change-Id: Idc1d35e7fba07ee44daf3114bc3b98b22dcde64a
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoUse Run Keywords for multiple keywords in teardown 91/65591/2
Jamo Luhrsen [Thu, 16 Nov 2017 00:02:06 +0000 (16:02 -0800)]
Use Run Keywords for multiple keywords in teardown

this was broken recently, when wanting to split out
the amount of data models we collect in our non-sfc
suite.

Change-Id: I5d4bf4751a27b00c01a7bd375c49013d66a6aebd
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoAdd parens around "${status}" - fix invalid syntax 24/65624/1
Jamo Luhrsen [Thu, 16 Nov 2017 16:21:23 +0000 (08:21 -0800)]
Add parens around "${status}" - fix invalid syntax

Change-Id: I7a34148a7a2ba8f6b308fa3226dceca3b80b7d92
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoHandle case when Get VM IP is status FAIL 29/65529/5
Jamo Luhrsen [Wed, 15 Nov 2017 05:24:46 +0000 (21:24 -0800)]
Handle case when Get VM IP is status FAIL

When a keyword is supposed to return some values (a list in
this case) but hits a failure before the [Return] statement,
we actually only get a status of FAIL and some error message.
Need to handle that.

Change-Id: Ic8e7f9bccfc81bb18f34ede28f4b50277d1c802e
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoRemove Lithium keyword from packetcable csit 89/65389/3
Jamo Luhrsen [Thu, 9 Nov 2017 20:29:07 +0000 (12:29 -0800)]
Remove Lithium keyword from packetcable csit

There is no more lithium to worry about, so no need to keep that
keyword

Change-Id: Ib6f811f13a94efd52a818bc1ec0a6c62edc560e2
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoRework variables to keep scope limited to keyword 91/65491/8
Jamo Luhrsen [Mon, 13 Nov 2017 19:08:19 +0000 (11:08 -0800)]
Rework variables to keep scope limited to keyword

- remove the need to share variables across keywords
- return console log so it can be printed just once after
  the collect ip WUKS is done polling

Change-Id: I10847f064ca38d6504e2715b51ad02792e0d3811
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoFix tox problem 92/65492/1
Sam Hague [Mon, 13 Nov 2017 21:41:52 +0000 (16:41 -0500)]
Fix tox problem

Change-Id: Ie473e848c60af10cac8e838e3d3e532ad376e4f3
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoReduce logging in collect ips 54/65454/16
Sam Hague [Sun, 12 Nov 2017 01:02:51 +0000 (20:02 -0500)]
Reduce logging in collect ips

Created a new VM Collect IP keyword that reduces the
amount of logging and works faster.

Problems in old keyword:
- logged the whole console multiple times, per vm check and per
operation
- ran Verify Active extra times
- different suites replicated using code

This patch:
- moves all the common wrapping code to a single keyword
- reduces the extra Active calls
- reduces the console to a single time per vm check
- removed console log on error since the log is always captured
during the attempt to get the addresses already

This looks to have reduced the time in half for retrieving the
addresses as well as reducing the multiple loggin of long
console logs.

Only converted the connectivity suite and left the old keyword
in place. The next patches will convert the other suites.

Change-Id: I042c137165eae95946fa5197fbb52b1b85312a00
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoFix for multiple keywords found in Utils.robot 73/65473/2
Tomas Cechvala [Mon, 13 Nov 2017 10:07:52 +0000 (11:07 +0100)]
Fix for multiple keywords found in Utils.robot

By specifying OperatingSystem library for 'Get file' call.

Change-Id: I0a4e8a362033b381cf88ac303b931880f419a3de
Signed-off-by: Tomas Cechvala <tcechval@cisco.com>
6 years agoReduce the number of polling iterations in WUKS 85/65385/2
Jamo Luhrsen [Thu, 9 Nov 2017 18:15:07 +0000 (10:15 -0800)]
Reduce the number of polling iterations in WUKS

This has the potential to reduce some logs that end up in
the output.xml. We do use --removewuks when we generate the
html reports, but that is post processing. All the iterations
are still being logged in output.xml. Hopefully this will
help reduce the final log size of output.xml

Change-Id: If84c43ac659750e53efe2b2c18c6e81bab801ad7
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoadd cleanup for con sg suites 90/65390/9
Sam Hague [Fri, 10 Nov 2017 02:24:59 +0000 (21:24 -0500)]
add cleanup for con sg suites

Change-Id: I7bfe76c89c6f4c90384fd9a5f8ab59a756d870c5
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoCleanup on neutron sg suite 46/65346/12
Sam Hague [Thu, 9 Nov 2017 01:08:43 +0000 (20:08 -0500)]
Cleanup on neutron sg suite

Change-Id: Ife25300241bb415fc881c14e3bfb8beb5d85f63b
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoReduce logging in vpnservice 44/65344/5
Sam Hague [Thu, 9 Nov 2017 00:41:23 +0000 (19:41 -0500)]
Reduce logging in vpnservice

Change-Id: Iebd3f178d9931a46e2df0af63cb5698f69a708ad
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoDon't process the prompt line 32/65332/3
Sam Hague [Wed, 8 Nov 2017 18:51:14 +0000 (13:51 -0500)]
Don't process the prompt line

The Write Commands Until Expected Prompt Keyword
executes a command and then reads output until it sees
the prompt. It then returns all that read output. This
output is then split into lines - which means you get
the prompt line also.

This patch instructs Split To Lines to ignore the last
line (-1).

Change-Id: Ifea842f5b0fa0c45818be4e9cbaa2f0b33774af6
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoDon't dump the err/warn/exception 29/65329/4
Sam Hague [Wed, 8 Nov 2017 17:13:22 +0000 (12:13 -0500)]
Don't dump the err/warn/exception

No need to collect this information as
it is also collected by the builder at the end of the test run.

Change-Id: I5c89cf7717f30ec72619bc2c05bc7e78b1e19bac
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoReduce logging in model dumps 28/65328/3
Sam Hague [Wed, 8 Nov 2017 17:06:34 +0000 (12:06 -0500)]
Reduce logging in model dumps

Change-Id: I19fa3df630344d3ed2990986bb6f1e5fac3df53e
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoReduce logging in SG suite 25/65325/2
Sam Hague [Wed, 8 Nov 2017 16:25:25 +0000 (11:25 -0500)]
Reduce logging in SG suite

Change-Id: I54d4f3382f2360cb7e7f96bb231f8c84a43a0b13
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoReduce logging in OpenStackOperations 24/65324/2
Sam Hague [Wed, 8 Nov 2017 15:59:22 +0000 (10:59 -0500)]
Reduce logging in OpenStackOperations

Change-Id: I07097ebe328c8823b841448ed3f25fa80ffcfd3e
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoRedirect ostestr stderr output to /dev/null 36/65236/1
Jamo Luhrsen [Tue, 7 Nov 2017 01:01:12 +0000 (17:01 -0800)]
Redirect ostestr stderr output to /dev/null

comments in the code, but for completeness here is the reason:
There are tons of deprecation error messages when we use
ostestr in our CSIT environment (openstack via devstack)
The robot log files are very large and one culprit is all
these deprecation warnings. If we redirect stderr to /dev/null
we should be able to ignore them. We will miss any other
errors, however.

Change-Id: Ic533493cf3f271e4004c0eaf9f0cb2d52e2be8c9
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoRemove extra Logging in VPNService suites 34/65234/2
Jamo Luhrsen [Tue, 7 Nov 2017 00:01:50 +0000 (16:01 -0800)]
Remove extra Logging in VPNService suites

this is an ongoing effort to reduce our log sizes,
specifically the output.xml file which can grow
very large and takes a lot of resources to parse.

Change-Id: I2f1b603f977d2804f8c992fe40ffcfb521de91a2
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoCollect debugs before tempest teardown 85/64585/25
Jamo Luhrsen [Fri, 20 Oct 2017 22:00:30 +0000 (15:00 -0700)]
Collect debugs before tempest teardown

- the tempest.api.network bucket is still run with ostestr so it
  can take advantage of the parallel execution and will not pause
  on teardown.

- all scenario tests are broken out to be run one at a time and
  will collect debugs on teardown.

Change-Id: I2e30d543c61ddbc726a7d409e2444dbd46ae488c
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoRemove logging of ${output} of tempest run 15/65115/1
Jamo Luhrsen [Fri, 3 Nov 2017 17:35:32 +0000 (10:35 -0700)]
Remove logging of ${output} of tempest run

The robot keyword to Read Until Prompt is also giving the
full output so it's unnecessary and duplicate to also Log
it. This will help reduce our log sizes

Change-Id: I2b8a7af7758b3358209b862d4ce6ded6cf1d6342
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoAdd verification for OPNFLWPLUG-930 12/65012/4
Luis Gomez [Thu, 2 Nov 2017 01:59:38 +0000 (18:59 -0700)]
Add verification for OPNFLWPLUG-930

Change-Id: Ib049ec910b839faf6226e4b7ff182b76c075922f
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
6 years agoAdd floating_network_name to tempest.conf 09/65009/1
Jamo Luhrsen [Wed, 1 Nov 2017 23:41:32 +0000 (16:41 -0700)]
Add floating_network_name to tempest.conf

in pike, the tempest tests need to know the name of the
external network to use for floating ips. This will
resolve one of the failures we have had since bringing
in the pike jobs

Change-Id: I7d8d84e95648ebbbf9fda2e368ce3b62382ebb5c
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoMigrate AAA CSIT to use Variables.robot from .py 78/64578/3
Jamo Luhrsen [Fri, 20 Oct 2017 18:18:28 +0000 (11:18 -0700)]
Migrate AAA CSIT to use Variables.robot from .py

Also removing unused, empty suite.

Change-Id: I1ad9c2951c73373dda4dc38f4bf77a33eba0822e
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoIPv6: get IPV6_ADDR_POOL values from Variables 36/60136/6
Valentina Krasnobaeva [Mon, 10 Jul 2017 14:01:58 +0000 (16:01 +0200)]
IPv6: get IPV6_ADDR_POOL values from Variables

Get values for NET1_IPV6_ADDR_POOL and NET2_IPV6_ADDR_POOL from
netvirt/Variables.robot, instead of declare them at the beginning.

Change-Id: Idac6f6df96e95e7193bb756c3d5f657dd8e74034
Signed-off-by: Valentina Krasnobaeva <valentina.krasnobaeva@6wind.com>
6 years agoCSIT: move NET1_IPV6_ADDR_POOL in Variables 94/60094/9
Valentina Krasnobaeva [Wed, 28 Jun 2017 16:15:52 +0000 (18:15 +0200)]
CSIT: move NET1_IPV6_ADDR_POOL in Variables

Change-Id: If49d1179cdab507c351cbfab39afd4732a1ed75e
Signed-off-by: Valentina Krasnobaeva <valentina.krasnobaeva@6wind.com>
6 years agoFix VTN Coordinator Oxygen Job Failure 63/64763/3
ananth [Fri, 27 Oct 2017 01:57:30 +0000 (21:57 -0400)]
Fix VTN Coordinator Oxygen Job Failure

VTN Coordinator Oxygen fails to install VTN Coordinator.
* Path added to the test file to be able to download and install
  VTN Coordinator.
* Patch also modifies the image path/name for Nitrogen/Carbon also.

Change-Id: I4882a1d6d7dfd837bf4e507b764802cfe6c54de4
Signed-off-by: ananth <ananth.y@hcl.com>
6 years agoRemove VPN service and BGP VPN service 69/64669/3
Victor Pickard [Tue, 24 Oct 2017 17:27:41 +0000 (13:27 -0400)]
Remove VPN service and BGP VPN service

VPN service suite is already being run in
netvirt job, so don't run it again in the
l2gw job.

A new job will be created for BGP VPN
test suite.

Change-Id: Ia84de3da41c8e9155b217aeccd032c719bc06d6c
Signed-off-by: Victor Pickard <vpickard@redhat.com>
6 years agoRemove unused BFD suite 95/64495/2
Jamo Luhrsen [Wed, 18 Oct 2017 21:46:52 +0000 (14:46 -0700)]
Remove unused BFD suite

this suite is not in use. Email discussion here:
https://lists.opendaylight.org/pipermail/genius-dev/2017-October/001929.html

Change-Id: Ibb121029e19a8ac5333895265217c742db69f613
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoIgnore pep8 E722 74/64774/3
Jamo Luhrsen [Thu, 26 Oct 2017 20:49:52 +0000 (13:49 -0700)]
Ignore pep8 E722

Existing code has started to fail on this error and causing
verify jobs to fail that have nothing to do with said existing
code. For now, we can ignore this to let work continue in
the int/test repo.

A jira ticket will be opened for someone to fix those related
erorrs (example below) and then remove this ignore = E722
statement.

Example:
./csit/libraries/AAAJsonUtils.py:208:13: E722 do not use bare except'
            except:
            ^
Change-Id: Iee989ea6f2bcc3149988eb2e430fc7246c2d97e2
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoAdd a snippet about using jjb-deploy keyword 21/64421/5
Jamo Luhrsen [Tue, 17 Oct 2017 19:08:22 +0000 (12:08 -0700)]
Add a snippet about using jjb-deploy keyword

Change-Id: Ia3c1a602a7c629943c906ca3bbb57152bd66e98c
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoRemove robot tags for skipping irrelevant things 50/64550/1
Jamo Luhrsen [Thu, 19 Oct 2017 23:53:47 +0000 (16:53 -0700)]
Remove robot tags for skipping irrelevant things

we used to skip things if the openstack was mitaka or
if odl sg mode was transparent or learn. All of those
things no longer exist in our CSIT, so no need to
have them

Change-Id: I9b51d1c1317ef4352fff897a5713d86edcc2e49c
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoFix script typo. Argument is not used. 38/64538/1
Luis Gomez [Thu, 19 Oct 2017 18:06:24 +0000 (11:06 -0700)]
Fix script typo. Argument is not used.

Change-Id: I5d8f9f0413d214ed3771ba833d67e7a82bea0442
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
6 years agoAdd AKKA debug in OF cluster test 09/64509/2
Luis Gomez [Thu, 19 Oct 2017 07:10:43 +0000 (00:10 -0700)]
Add AKKA debug in OF cluster test

Change-Id: I1c8657564785bcc3a156cd06d3167009f09eff2f
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
6 years agocommon tempest in DevstackUtils 04/63804/3
Sam Hague [Thu, 28 Sep 2017 21:12:22 +0000 (17:12 -0400)]
common tempest in DevstackUtils

Moved the tempest-specific functions from the test.robot
file over to the othr tempest functions in DevstackUtils.
This is in prep to add a single tempest test suite later.

Change-Id: I90041a5300b7749216eddd6cfa72166567bbbefc
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoRevert "Bug 9294:" 88/64488/1
Yrineu Rodrigues [Wed, 18 Oct 2017 19:38:19 +0000 (16:38 -0300)]
Revert "Bug 9294:"

This reverts commit 4c84f63737c9e2ff189a28d1f59b5a88b7a17059.

Change-Id: I735033c33ae8facca4c1f24969e2e2a630ab6c10
Signed-off-by: Yrineu Rodrigues <yrineu.rodrigues@serro.com>
6 years agoFix BGPCEP TCPMD5 tests 71/64471/4
Yrineu Rodrigues [Wed, 18 Oct 2017 18:06:48 +0000 (15:06 -0300)]
Fix BGPCEP TCPMD5 tests

Change-Id: Id21ec4fe2a4debf9b5d1ea2111e6126388a11869
Signed-off-by: Yrineu Rodrigues <yrineu.rodrigues@serro.com>
6 years agoBug 9294: 24/64424/2 release/carbon-sr2
Yrineu Rodrigues [Tue, 17 Oct 2017 21:45:24 +0000 (18:45 -0300)]
Bug 9294:
Well known mandatory attribute missing: ORIGIN

Change-Id: I4ca1a6ade0c46dd6ccdb499173aa8300490c9888
Signed-off-by: Yrineu Rodrigues <yrineu.rodrigues@serro.com>
6 years agoRemove Beryllium specific test code 12/64312/4
Jamo Luhrsen [Mon, 16 Oct 2017 17:22:23 +0000 (10:22 -0700)]
Remove Beryllium specific test code

specifically this commit is targeted at removing the compare
stream keyword calls that refer to Beryllium

also removed a few bits that referred to initializing variables
based on Lithium, which is also no longer relevant

Change-Id: I618e844c50ed6bf2e99ab454f1071f78669fa09e
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoClean up and rename OF CSIT jobs 26/64226/3
Luis Gomez [Fri, 13 Oct 2017 04:23:03 +0000 (21:23 -0700)]
Clean up and rename OF CSIT jobs

Change-Id: I395c68ee3cc8cb12a3f9f46953042bc5175000e4
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
6 years agoRemove all test references to boron 53/63953/4
Jamo Luhrsen [Wed, 4 Oct 2017 16:54:17 +0000 (09:54 -0700)]
Remove all test references to boron

There are still references to boron in some comments and
docs sections, but the intent here is to remove all test
code (lots of conditional stuff like IF boron do this or
that...).

Change-Id: Ib7aa9d755d7c2a28b0270e218dd5676f146a936a
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoAdd Oxygen keywords to CompareStream lib 48/63948/2
Jamo Luhrsen [Wed, 4 Oct 2017 16:32:27 +0000 (09:32 -0700)]
Add Oxygen keywords to CompareStream lib

Change-Id: Ide857b0638cd66d01da20e6a8f61000a8fa7d6f3
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoCleanup unsupported releases from CompareStream 47/63947/3
Jamo Luhrsen [Wed, 4 Oct 2017 16:23:43 +0000 (09:23 -0700)]
Cleanup unsupported releases from CompareStream

we no longer test against anything older than Carbon
so removing everything else

Change-Id: I625efca316356452423780db79baad8f3116a875
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoRemove idmlite CSIT job(s) 10/64210/2
Jamo Luhrsen [Thu, 12 Oct 2017 17:06:50 +0000 (10:06 -0700)]
Remove idmlite CSIT job(s)

per AAA PTL's wishes:
    https://lists.opendaylight.org/pipermail/release/2017-October/012653.html

Change-Id: I6b47381dff96efcc3325ecc3052a0bca6d25fae6
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoAlphabetize tempest tests to match subunit 78/64178/2
Sam Hague [Wed, 11 Oct 2017 20:37:12 +0000 (16:37 -0400)]
Alphabetize tempest tests to match subunit

Change-Id: Ib175d9a4aef8881dc40beb32ff2ff902a379f08d
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoAdd more printouts to debug cluster issues 83/64183/2
Luis Gomez [Thu, 12 Oct 2017 07:40:12 +0000 (00:40 -0700)]
Add more printouts to debug cluster issues

Netstat will run for all members after member is killed,
stopped or started.

Change-Id: Ie5247353e4922a1223f8da9b811b4963a0d8874e
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
6 years agoRemove skip_if_boron tag from ofp test cases 46/63946/3
Jamo Luhrsen [Wed, 4 Oct 2017 16:11:20 +0000 (09:11 -0700)]
Remove skip_if_boron tag from ofp test cases

boron is no longer being validated in CSIT

Change-Id: I38f91555b3bcae1af39243ea1fb5b8b4234e72cc
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoDelete tesplans specific to Boron 55/64155/1
Vratko Polak [Wed, 11 Oct 2017 10:42:32 +0000 (12:42 +0200)]
Delete tesplans specific to Boron

Change-Id: Idda6bd2163a8ca65c0a93b0459a318a35987f8a6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 years agoChange tab to spaces 29/64029/1
Jamo Luhrsen [Fri, 6 Oct 2017 18:33:58 +0000 (11:33 -0700)]
Change tab to spaces

Change-Id: Ic91aab1101d9518acdcf345971beba72e9907792
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoClean up openflow test plans 73/63973/2
Luis Gomez [Thu, 5 Oct 2017 02:13:49 +0000 (19:13 -0700)]
Clean up openflow test plans

FRS jobs are removed now but there are other test plans not used
in jenkins today.

Change-Id: I7c0281ccea9c7c4d614f3a548b8b28f2a98870ed
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
6 years agoAdd netstat check in Teardown 05/64005/1
Luis Gomez [Fri, 6 Oct 2017 01:18:09 +0000 (18:18 -0700)]
Add netstat check in Teardown

This KW should also execute when the Member start fails.

Change-Id: I82c527ffdd51958040dd502e46601a77568e57d7
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
6 years agoEnable printout to debug OF cluster issues 20/63520/8
Luis Gomez [Tue, 26 Sep 2017 07:05:31 +0000 (00:05 -0700)]
Enable printout to debug OF cluster issues

For now netstat will give some info on akka open ports
when cluster member is started.

Change-Id: Ib3fa1730436f4d5e888f8c183d9ffb080c737302
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
6 years agolispflowmapping: remove Boron references 31/63931/2
Lorand Jakab [Wed, 4 Oct 2017 06:28:18 +0000 (09:28 +0300)]
lispflowmapping: remove Boron references

Change-Id: Ie1d7aa1e2fab7393aa3598afe6a498351654311b
Signed-off-by: Lorand Jakab <lojakab@cisco.com>
6 years agoRevert Fix Recent Failurs in VTN Coordinator CSIT 30/63930/3
Y Ananth [Wed, 4 Oct 2017 05:46:22 +0000 (05:46 +0000)]
Revert Fix Recent Failurs in VTN Coordinator CSIT

This reverts commit f0bcc5d0d17b9f6d2335411b5ead9e1b378d6c7e.

Change-Id: I4861a1e8096fb4a3823fcc03c505564585962734
Signed-off-by: Y Ananth <ananth.y@hcl.com>
6 years agoFix the recent csit failure 93/63893/2
gvrangan [Mon, 2 Oct 2017 15:43:00 +0000 (21:13 +0530)]
Fix the recent csit failure

There was a failure caused by the patch
(https://git.opendaylight.org/gerrit/#/c/63858/)
The min and max arguments were modified but the
instance names was left unchanged. This caused some
failures in today's run. The failure was due to a
non-exsting instance name in the list. This patch removes
the instance that is not relevent anymore.

Change-Id: I2e06c2d0d8d7e16eb36119812f3ca5d106c83fb0
Signed-off-by: gvrangan <venkatrangang@hcl.com>
6 years agoUse openstack cli instead of nova console-log cli 53/60653/4
Jamo Luhrsen [Fri, 21 Jul 2017 18:42:15 +0000 (11:42 -0700)]
Use openstack cli instead of nova console-log cli

Change-Id: Ida40d777d99cd7fe1e38edaece1fc781814bccee
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoFix syntax ERROR in beir suite 52/63852/3
Jamo Luhrsen [Fri, 29 Sep 2017 18:15:56 +0000 (11:15 -0700)]
Fix syntax ERROR in beir suite

when using a .robot variables file we still need to referece
it as "Resource" not "Variables". example of the ERROR it
produces:

https://logs.opendaylight.org/releng/jenkins092/bier-csit-1node-basic-all-nitrogen/156/log.html.gz

- also removed the "Suite Teardown" from __init__.robot as
it's not defined anywhere.

Change-Id: I634865980ca1d468efc8e7b81e4f1d65af229a89
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoUpdate up tempest exclusion regexes 49/63849/3
Jamo Luhrsen [Fri, 29 Sep 2017 17:19:48 +0000 (10:19 -0700)]
Update up tempest exclusion regexes

Remove mitaka regex as we no longer have those jobs
Add ${master_exclusion_regexes) to account for Queens

Change-Id: I839474cfa261f385904535c4c4eaf2bb774b8abf
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoUse test domain for email address in CSIT 84/58984/3
Jamo Luhrsen [Wed, 14 Jun 2017 23:19:35 +0000 (16:19 -0700)]
Use test domain for email address in CSIT

as requested from:
  https://git.opendaylight.org/gerrit/#/c/55029/5/csit/suites/aaa/idmlite/010_CRUD_Rest_CommandsTests.robot

Change-Id: I87adf7d70b82a22349532ced98bb0c521ebb4ae5
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoModify min and max arguments for server create 58/63858/1
gvrangan [Fri, 29 Sep 2017 18:59:53 +0000 (00:29 +0530)]
Modify min and max arguments for server create

* Too many debug messages makes debugging difficult.
* This patch reduces min and max to 3, so that only 3
  instances are creaetd in parallel

Change-Id: Ibb48518e1f9901586f2f267690c205c73a6cb2d6
Signed-off-by: gvrangan <venkatrangang@hcl.com>
6 years agoUpdate yang-model-validator test suite 27/63527/4
Igor Foltin [Tue, 26 Sep 2017 15:15:59 +0000 (17:15 +0200)]
Update yang-model-validator test suite

Update this suite to reflect the changes that have been made
in the YANG Tools artifact yang-model-validator (previously known
as yang-system-test) since the test suite was first created.

The -p option previously denoted the directories with YANG files
that should be parsed as one big collection. However, the artifact
is meant to be used as a single YANG file validator similarly to
pyang. That is why the -p option is now used to specify directories
with YANG dependencies, i.e. YANG files which might be needed to
successfully validate the single YANG file specified as argument.

Therefore, adjust the suite to iterate through the set of YANG
files one by one while using the whole set of YANG models as
dependencies within the -p option.

Change-Id: I6225242bddf5dbf612a5e73153fe41c3ffa3f990
Signed-off-by: Igor Foltin <igor.foltin@pantheon.tech>
6 years agoTest for Bug #7596 36/62436/4
gvrangan [Wed, 30 Aug 2017 03:35:08 +0000 (09:05 +0530)]
Test for Bug #7596

Change-Id: Id603da780fe211659328a66f011e26a86eed7cdf
Signed-off-by: gvrangan <venkatrangang@hcl.com>
6 years agoFix openstack netvirt sfc suite 62/61962/6
Jamo Luhrsen [Thu, 17 Aug 2017 23:28:21 +0000 (16:28 -0700)]
Fix openstack netvirt sfc suite

typo in instance creation s/groups/group

migrate some neutron cli to the openstack cli

also, since I was here, I moved all of the cleanup steps
out of their own individual test cases and into a suite
teardown keyword. This lets robot run through every step
regardless if any previous step had failed. If left in a
test case, robot bails on the test case and wont run any
other steps in that test case if any single step fails.

Change-Id: Iea009efbe2c7633bc83898002b2a6decd08f24aa
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoSet DS tell-based protocol for cluster perf 92/63592/2
Luis Gomez [Wed, 27 Sep 2017 00:54:17 +0000 (17:54 -0700)]
Set DS tell-based protocol for cluster perf

As suggested this improves cluster performance in carbon.
See https://bugs.opendaylight.org/show_bug.cgi?id=6755

Change-Id: Ie3aee1fb2c65afcb87148d69de41239642a0cd1d
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
6 years agoRemove SNMP CSIT 28/63428/3 release/nitrogen
Jamo Luhrsen [Thu, 21 Sep 2017 23:43:43 +0000 (16:43 -0700)]
Remove SNMP CSIT

the job(s) for SNMP CSIT have never worked, and have been ignored
for several (if not all) releases. it's a waste of time and
resources to have them around.

see the status pages for Nitrogen, Carbon, Boron
and Beryllium for history:
  https://docs.google.com/spreadsheets/d/1MYyGLFWN2RzUkJl8XMzXQ-3zWuOrUCQpIS6ORbmf4_U/edit#gid=421626541
  https://docs.google.com/spreadsheets/d/1VcB12FBiFV4GAEHZSspHBNxKI_9XugJp-6Qbbw20Omk/edit#gid=1226505712
  https://docs.google.com/spreadsheets/d/1zImtd764e-hOgJAxoJKl85fxHCPu2agLfqsBtf13zQY/edit#gid=1037896712
  https://docs.google.com/spreadsheets/d/1hci5TMUPyB6PX8Al-fwfVqvs5SQVa2wZLja_7rKWN6o/edit#gid=843418255

partner JJB patch in releng/builder:
  https://git.opendaylight.org/gerrit/#/c/63427/

Change-Id: Ia2f042437dc6d64b9c03c144d026b75111ebf85d
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoAdd timeout/retry to L2GW CSIT TC05 95/63495/2
Victor Pickard [Mon, 25 Sep 2017 14:40:37 +0000 (10:40 -0400)]
Add timeout/retry to L2GW CSIT TC05

Add timeout and retry to Verify Ovs Tunnel in test case
TC05. This was failing in 3 node tests, as it takes a
little longer for config to be applied in in cluster.

Change-Id: If9c2aa798c5b879f426837b05066e21d4e2bd85d
Signed-off-by: Victor Pickard <vpickard@redhat.com>
6 years agoFix for Genius CSIT failure on Oxygen 97/63397/6
vidya sathyanarayanachar [Thu, 21 Sep 2017 17:41:20 +0000 (10:41 -0700)]
Fix for Genius CSIT failure on Oxygen

Description : This patch has keyword Get Tunnel modifed with
code to get tunnel interface name between dpns

Change-Id: I6bac03d6d3c244f4ef40b2d5ad1e8f0f046eeeaf
Signed-off-by: vidya sathyanarayanachar <s.vidya990@gmail.com>
6 years agoBug 8999: Add entity isolation netconf suite 65/62765/7
Vratko Polak [Mon, 25 Sep 2017 13:07:05 +0000 (15:07 +0200)]
Bug 8999: Add entity isolation netconf suite

Added a suite based on entity.robot which
will verify that a 3 node netconf cluster recovers after
isolation and rejoin of the entity owner.

Change-Id: I2a5510338dfa323c71d3ce4820036b4bfe0342a2
Signed-off-by: Richard Hill <rhill@frinx.io>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 years agoAdd a WUKS to netconf connector check 60/63460/2
Atul Gosain [Fri, 22 Sep 2017 16:30:02 +0000 (09:30 -0700)]
Add a WUKS to netconf connector check

The check for netconf connector is not able to finish in time,
though the subsequent test passed. Adding the check.

Change-Id: Ib6f0ece50643ebab7e8e32dc6023941ce6d2c4e2
Signed-off-by: Atul Gosain <atul.gosain@gmail.com>
6 years agoGet compute node hostname from hypervisor list 64/63364/6
Jamo Luhrsen [Wed, 20 Sep 2017 18:23:48 +0000 (11:23 -0700)]
Get compute node hostname from hypervisor list

Change-Id: I756e90602490f2c96d2eb41e8b4319c618cd7880
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoDefault BUNDLEFOLDER var to /opt/opendaylight 78/63378/3
Jamo Luhrsen [Wed, 20 Sep 2017 22:57:10 +0000 (15:57 -0700)]
Default BUNDLEFOLDER var to /opt/opendaylight

this currently will have zero effect on upstream ODL CSIT,
because we always pass this variable on the pybot command
line.

However, some other CSIT consumers (e.g. OPNFV) are seeing
lots of warnings [0] because they are not *always* passing
BUNDLEFOLDER in their robot argument list. This will remove
that error for them, while giving us a decent default of
/opt/opendaylight which is where the rpm package installs
to.

[0] https://git.opendaylight.org/gerrit/63293

Change-Id: Ie32d50cd8f42b05378949439b1b1976348032e59
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoConvert Sleep to WUKS in lispflowmapping CSIT 71/63271/2
Lorand Jakab [Tue, 19 Sep 2017 09:11:12 +0000 (12:11 +0300)]
Convert Sleep to WUKS in lispflowmapping CSIT

Part 2, 020_RPC_CRUD.robot

Change-Id: Ibdce362fbb6e87e0221878832be57474717e59e9
Signed-off-by: Lorand Jakab <lojakab@cisco.com>
6 years agoSupport https endpoints (Keystone and Neutron) 93/63293/8
Cédric Ollivier [Tue, 19 Sep 2017 18:41:41 +0000 (20:41 +0200)]
Support https endpoints (Keystone and Neutron)

It simply replaces http://${NEUTRON}:9696 by ${NEUTRONURL} and
http://${KEYSTONE}:5000 by ${KEYSTONEURL}.

It also switches to Variables.robot and defines
${NEUTRON_SUBNETS_API} in it.

Change-Id: I76702facfbfb068160933fbba4dbb5f2cbc41d15
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoStabilize OF split connection test 46/63346/1
Luis Gomez [Wed, 20 Sep 2017 16:01:33 +0000 (09:01 -0700)]
Stabilize OF split connection test

It is possible that during unstable scenario of 2 connection
fighting each other there is no flow being pushed.

Change-Id: I72d530905ebd53ab09dd2f2ad86038a408367c2c
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
6 years agoRename yang-system-test module 83/63283/3
Jakub Toth [Tue, 19 Sep 2017 13:27:26 +0000 (15:27 +0200)]
Rename yang-system-test module

 * rename yang-system-test module in Yangtools
   to odl-yang-validator

Change-Id: I67909babb2c61446327d7d7b1bae33f9029b4777
Signed-off-by: Jakub Toth <jakub.toth@pantheon.tech>
6 years agoConvert Sleep to WUKS in lispflowmapping CSIT 54/63254/2
Lorand Jakab [Mon, 18 Sep 2017 21:20:35 +0000 (00:20 +0300)]
Convert Sleep to WUKS in lispflowmapping CSIT

Part 1, 030_RPC_Datatypes.robot

Change-Id: I6885a831f40ee2b1ff555de0f67b456ca6e9650e
Signed-off-by: Lorand Jakab <lojakab@cisco.com>
6 years agoFix typo in OF test plan 57/63257/1
Luis Gomez [Tue, 19 Sep 2017 02:16:19 +0000 (19:16 -0700)]
Fix typo in OF test plan

Change-Id: Iaa4dc0f74289759453875c529af06809baf3a059
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
6 years agoAdd Carbon SR2 cluster test document. 54/56454/167
Vratko Polak [Mon, 18 Sep 2017 16:18:32 +0000 (18:18 +0200)]
Add Carbon SR2 cluster test document.

Include reports on previous releases as drafts.

Move ReST coala check to come before Python,
because the Python check takes longer to finish.

Change-Id: I84c34570c329f8793b76d07503db800999549da8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Peter Gubka <pgubka@cisco.com>
6 years agoRepair OF test 41/63241/2
Luis Gomez [Mon, 18 Sep 2017 18:35:45 +0000 (11:35 -0700)]
Repair OF test

- Specify bugs to be tested in OF suite.
- Change compare stream to At Most (more safe).
- Add oxygen stream in CompareStream library.

Change-Id: I12d1d616991f9aebb1e87c5840682d8adad50f57
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
6 years agoRemove NIC-console tests from CSIT 70/63170/1
Yrineu Rodrigues [Fri, 15 Sep 2017 11:01:51 +0000 (08:01 -0300)]
Remove NIC-console tests from CSIT

That feature was removed from NIC

Change-Id: Icfe5551302423748d5a93cdd34bb809bcdc86b8c
Signed-off-by: Yrineu Rodrigues <yrineu.rodrigues@serro.com>
6 years agoBug 7855: Update singleton rates 44/63044/3
Vratko Polak [Thu, 14 Sep 2017 10:23:24 +0000 (12:23 +0200)]
Bug 7855: Update singleton rates

As Bug 7855 is fixed, there is no reason to tolerate
rate of 5 on Carbon. But tests on -all- job
just after cluster reset are slower than
thecorresponding longevity job, so tolerate rate of 50 for now.

TODO added to set back to 100
when better ODL readiness detector is available.

Change-Id: I92561f617afd3bac037be236c9bad7dd90e48216
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 years agoFix lispflowmapping 3-node CSITs 85/62685/2
Lorand Jakab [Tue, 5 Sep 2017 11:02:05 +0000 (14:02 +0300)]
Fix lispflowmapping 3-node CSITs

Due to propagation delay in the cluster, datastore writes are not
immediately avalable and test fail because of that. Looking at recent
test failure logs delays as long as 300+ ms can be found. This patch
adds a 500 ms pause after each datastore write, to account for cluster
propagation delay.

Change-Id: I97389dfdd1bd61ce53e8bb53be5a380aacb04c07
Signed-off-by: Lorand Jakab <lojakab@cisco.com>
6 years agoUpdate Bier CSIT with template 29/61029/10
Quan Xiong [Wed, 2 Aug 2017 10:13:36 +0000 (18:13 +0800)]
Update Bier CSIT with template

Change-Id: I4e6914216482100a875b5676ef433d0c49774eb0
Signed-off-by: Quan Xiong <xiong.quan@zte.com.cn>
6 years agoCreate nano flavor for l2gw csit 15/63115/1
Victor Pickard [Wed, 13 Sep 2017 19:02:59 +0000 (15:02 -0400)]
Create nano flavor for l2gw csit

Devstack fails with tempest and l2gw-plugin on pike.
For now, just go ahead and create the nano flavor,
and do not enable the tempest service in the
l2gw csit test suite.

Change-Id: Ia81ab327ad79ac1e429655ac64723963de7f8f66
Signed-off-by: Victor Pickard <vpickard@redhat.com>
6 years agoIsolate OF bug 9145 14/63014/4
Luis Gomez [Tue, 12 Sep 2017 05:19:48 +0000 (22:19 -0700)]
Isolate OF bug 9145

- This new bug is impacting reconciliation suite so this change
will isolate the bug in its own test.

- Also remove unnecessary check in member isolation test.

Change-Id: I31ecc57126955b3704dd73de3ff1ca236997bcab
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
6 years agoBug 9044 workaround: Delete etc/host.key 35/63035/3
Vratko Polak [Tue, 12 Sep 2017 12:57:01 +0000 (14:57 +0200)]
Bug 9044 workaround: Delete etc/host.key

When testing locally with bin/client,
deleting etc/host.key file before starting ODL again
is enough to avoid Bug 9044 symptom.

Change-Id: I6993f543a710a88bbfdbb2a2c44fa97833229b8e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 years agoRemove references/test using odl-nic-console 09/63109/1
Jamo Luhrsen [Wed, 13 Sep 2017 16:50:35 +0000 (09:50 -0700)]
Remove references/test using odl-nic-console

Change-Id: I34dbcfd7a34c297992d92a99ba2349eb08356a5e
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoAdd Create Nano Flavor function 77/63077/2
Sam Hague [Wed, 13 Sep 2017 04:28:54 +0000 (00:28 -0400)]
Add Create Nano Flavor function

Change-Id: I0a683a660cf2839169cd953006e93ad923bde3a0
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoSXP: Randomize retry open timers 03/63103/2
Martin Dindoffer [Wed, 13 Sep 2017 15:13:16 +0000 (17:13 +0200)]
SXP: Randomize retry open timers

The SXP protocol does not cope well with nodes
running on the same IP. Nodes that try to connect
to each other at the same time will never do so.
Randomize the retry open timers to minimize such
false negatives to minimum.

Change-Id: I06c46bbfd3b93ee6f139619d8997b41e6f88922d
Signed-off-by: Martin Dindoffer <martin.dindoffer@pantheon.tech>
6 years agoAdd dump of op:opendaylight-inventory 05/63105/1
Sam Hague [Wed, 13 Sep 2017 16:08:32 +0000 (12:08 -0400)]
Add dump of op:opendaylight-inventory

Change-Id: Ie84c10b86ad16e61687097442ad128cafc680c43
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoSXP:Wait for conf->oper propagation in CRUD tests 36/62836/4
Martin Dindoffer [Thu, 7 Sep 2017 12:32:28 +0000 (14:32 +0200)]
SXP:Wait for conf->oper propagation in CRUD tests

Use WUKS to wait for async propagation from config
DS to operational before failing basic CRUD tests

Change-Id: Ie4fb5f6cccc05af4e51ba1f3cfba9f1dcd53352b
Signed-off-by: Martin Dindoffer <martin.dindoffer@pantheon.tech>
6 years agoTest Option for min max with server create 98/62398/5
gvrangan [Tue, 29 Aug 2017 23:58:18 +0000 (19:58 -0400)]
Test Option for min max with server create

This patch helps to test --min and --max option
with openstack server create. These options have been
observed to fail with 3node.

Change-Id: I9154a21b1eedbbbe886785959d1b86250d9c545c
Signed-off-by: gvrangan <venkatrangang@hcl.com>
6 years agoLISPflowmapping: $GERRIT_BRANCH -> $DISTROBRANCH 24/54124/4
Lorand Jakab [Tue, 5 Sep 2017 12:37:21 +0000 (15:37 +0300)]
LISPflowmapping: $GERRIT_BRANCH -> $DISTROBRANCH

See https://git.opendaylight.org/gerrit/#/c/53804/1/csit/suites/lispflowmapping/scripts/generate_bindings.sh

Change-Id: I672289c74041410bf1dc45560db2140da3880772
Signed-off-by: Lorand Jakab <lojakab@cisco.com>
6 years agoChange timeout ExaBgp 84/62884/8
Andrej Kilvady [Fri, 8 Sep 2017 08:41:52 +0000 (10:41 +0200)]
Change timeout ExaBgp

Timeout BGP Verify ExaBgp Still Connected
fail in test. Suite 050 Bgp Ha Karaf Isolation.

Change-Id: I831e139eb17ff1b157477717d6195c062bb50d5f
Signed-off-by: Andrej Kilvady <akilvady@cisco.com>
6 years agoUpdate to Keystone v3 for basic neutron tests 46/62846/5
Cédric Ollivier [Thu, 7 Sep 2017 13:36:37 +0000 (15:36 +0200)]
Update to Keystone v3 for basic neutron tests

Keystone v2 has been deprecated for a while.
For instance OPNFV Euphrates is based on OpenStack stable/ocata then
Keystone v3 is recommended (see FUNCTEST-862 [1]).

[1] https://jira.opnfv.org/browse/FUNCTEST-862

Change-Id: If8ed4645eba0b42e3e7518896aa24d3db4feef6d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoUpdate distribution version suite for Nitrogen 52/62852/1
Vratko Polak [Thu, 7 Sep 2017 16:10:10 +0000 (18:10 +0200)]
Update distribution version suite for Nitrogen

Change-Id: Id9b05c95e068fa17d668866e22fda09fa439b98e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 years agoFixes for daexim tests 96/62796/3
Sreekalyan Devaraj [Wed, 6 Sep 2017 18:34:04 +0000 (11:34 -0700)]
Fixes for daexim tests

    Fixed the backup json files
    Fixed Variables
    Replaced tabs with four spaces

Change-Id: I05db75ffd7cb473d095a863bbcdfbba2d9265b33
Signed-off-by: Sreekalyan Devaraj <kalyan.ds@gmail.com>