integration/test.git
5 years agoSXP: Introduce cluster-binding job 75/79575/3
Ivan Hrasko [Wed, 16 Jan 2019 13:33:20 +0000 (14:33 +0100)]
SXP: Introduce cluster-binding job

- move the last test file of clustering suite
to separate suite increases its possibility to pass

JIRA: SXP-150
Change-Id: I4003b919b837fbeb6b5fd12e9bc93b013d67e883
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoSXP: Improve reliability of clustering suite 42/79542/3
Ivan Hrasko [Mon, 14 Jan 2019 13:59:10 +0000 (14:59 +0100)]
SXP: Improve reliability of clustering suite

- increase retry timeouts

JIRA: SXP-150
Change-Id: Ib143df18b0e9badc587157e51c5618b0b8a95610
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoSXP: Improve reliability of basic suite 03/79503/6
Ivan Hrasko [Mon, 14 Jan 2019 09:15:55 +0000 (10:15 +0100)]
SXP: Improve reliability of basic suite

- check that node is started after add
- check that node is stopped after delete

- increase timeouts in all connection
related tests

JIRA: SXP-150
Change-Id: I440a90c7b471594642d843ed87a9b638743a6485
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoSXP: Enable DEBUG log level 35/79535/1
Ivan Hrasko [Tue, 15 Jan 2019 13:02:36 +0000 (14:02 +0100)]
SXP: Enable DEBUG log level

- enable debug log level on cluster tests start
and revert it back to info on teardown

Change-Id: I038ece42d86432c2b6a65588fb5277ed782dbf08
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoPass default values to service_list arg 22/79522/4
Jamo Luhrsen [Mon, 14 Jan 2019 17:45:30 +0000 (09:45 -0800)]
Pass default values to service_list arg

fixes bug that was introduced by:
https://git.opendaylight.org/gerrit/#/c/79385/

Change-Id: Ia8d19251d93e0cd4c3c05dfb4f315b2662599e27
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agoSXP: Increase number of retries 13/79413/6
Ivan Hrasko [Thu, 10 Jan 2019 13:11:19 +0000 (14:11 +0100)]
SXP: Increase number of retries

- increase number of retries to check bindings

JIRA: SXP-150
Change-Id: I6abd25c2ec5c3d54f3036a464851a18636817f0f
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoIntroduce @{EMPTY_LIST} variable 60/79460/3
Ivan Hrasko [Fri, 11 Jan 2019 09:28:13 +0000 (10:28 +0100)]
Introduce @{EMPTY_LIST} variable

- introduce @{EMPTY_LIST} variable to use
in KWs with list parameters

JIRA: SXP-150
Change-Id: I07a3b3c171370cea13d68fecf409e924a6826f1c
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoSXP: Check cluster is ready after (un-)isolation 55/79355/9
Ivan Hrasko [Wed, 9 Jan 2019 14:42:18 +0000 (15:42 +0100)]
SXP: Check cluster is ready after (un-)isolation

JIRA: SXP-150
Change-Id: I5e587775054a6da4ee392439727abdf0ab64d3e6
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoRename bfd suite teardown 00/79400/2
Faseela K [Thu, 10 Jan 2019 09:26:34 +0000 (14:56 +0530)]
Rename bfd suite teardown

Change-Id: I2c55a95c85a2fef04718013118e51498104101b6
Signed-off-by: Faseela K <faseela.k@ericsson.com>
5 years agoSXP: Verify that all bindings are present 97/79397/2
Ivan Hrasko [Thu, 10 Jan 2019 08:20:56 +0000 (09:20 +0100)]
SXP: Verify that all bindings are present

Change-Id: I152b6315302f8ccb975855645bbf93acb90c6133
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoSXP: Increase WUKS retry time 96/79396/2
Ivan Hrasko [Thu, 10 Jan 2019 08:16:06 +0000 (09:16 +0100)]
SXP: Increase WUKS retry time

Change-Id: I2d91227ed1c495d0c3423a84dbb5cb377538cf6a
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoGENIUS - Fix diagstatus check 99/79399/1
Faseela K [Thu, 10 Jan 2019 09:17:53 +0000 (14:47 +0530)]
GENIUS - Fix diagstatus check

Change-Id: Iaaf3308cef501e492efa3294e6a638c2d98597f6
Signed-off-by: Faseela K <faseela.k@ericsson.com>
5 years agoFix handling of list argument 85/79385/3
Jamo Luhrsen [Wed, 9 Jan 2019 23:56:13 +0000 (15:56 -0800)]
Fix handling of list argument

I've learned that you cannot assign default values to a list
argument (something to do with mutability), so removing
the default value in the argument line and handling the case
where the keyword is called without passing in a list for
that argument.

Change-Id: I2b37e0c7a9a7708a234562541439de8db37eda84
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agoPass service_list as actual list 80/79380/1
Jamo Luhrsen [Wed, 9 Jan 2019 19:02:59 +0000 (11:02 -0800)]
Pass service_list as actual list

this logic was broken by c/79243

Change-Id: I1ee01bdabd09759fd6ca101a8f8b4689e529cbd6
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agoSXP: Use not equal retry timer value 27/79227/4
Ivan Hrasko [Fri, 4 Jan 2019 11:26:54 +0000 (12:26 +0100)]
SXP: Use not equal retry timer value

- not equal retry timer value allows
to deal with VSS switchover

JIRA: SXP-147
Change-Id: I998f1f52f8dcc543b4e2e402c0cd3f2b58dbff59
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoVerify restconf is available on member startup 43/79243/6
Tom Pantelis [Fri, 4 Jan 2019 16:52:16 +0000 (11:52 -0500)]
Verify restconf is available on member startup

CSIT run
https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-neon/106/robot-plugin/log.html.gz
failed due to the restconf availability check returning 404.
This occurred at 17:16:24 however the karaf log shows that
the restconf bundle was still in the process of starting up
at that time (it was waiting for ia AAA dependency). The
bundle eventually completed startup at 17:17:19.

The restconf check is part of the
Get_Raft_Property_From_Shard_Member keyword. However it's
wrapped in the higher-level
Verify_Leader_Exists_For_Each_Shard keyword with a deadline
of 30 sec which is enough most of the time but needs a bigger
cushion. Unfortunately, since the restconf check is deeply
nested within a Wait Until Keyword Succeeds, we can't just
simply wrap it with it's own deadline as that may be longer
than the enclosing deadline. Instead, I added the restconf
check to the Start_Members_From_List_Or_All keyword which
already has a 5 min deadline. I left
Get_Raft_Property_From_Shard_Member as is lthough I really
don't think the restconf check belongs there.

Change-Id: I687a10cbc92d8190a2bcb9a5f4ac1837ba0459a8
Signed-off-by: Tom Pantelis <tompantelis@gmail.com>
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agocomplete project telemetry system test job 84/79084/14
wsx25289 [Fri, 28 Dec 2018 02:34:27 +0000 (21:34 -0500)]
complete project telemetry system test job

Change-Id: I1ce405ff31dee6a001dc4a83f5345d3df0473b7e
Signed-off-by: Wsx25289 <10200860@zte.com.cn>
5 years agoAdd Floating Ip testcases to SNAT suite. 37/78037/16
mpany [Thu, 22 Nov 2018 07:26:58 +0000 (12:56 +0530)]
Add Floating Ip testcases to SNAT suite.

Change-Id: I9483d953369951a1524e9bb5868c64fbcea699c9
Signed-off-by: mpany <madhusmita.p@altencalsoftlabs.com>
5 years agoAdd two new keywords to BGP library. 66/79166/6
mpany [Thu, 3 Jan 2019 07:43:56 +0000 (13:13 +0530)]
Add two new keywords to BGP library.

Change-Id: I989f4b735e01d9bef0e68f9016eb6082fb010bb9
Signed-off-by: mpany <madhusmita.p@altencalsoftlabs.com>
5 years agoSXP: Format connectivity tests 06/79306/3
Ivan Hrasko [Tue, 8 Jan 2019 12:27:20 +0000 (13:27 +0100)]
SXP: Format connectivity tests

Change-Id: I883cfeeaac3d597c14b531cd8b87faabfe5839d7
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoSXP: Use not random retry time 10/79310/1
Ivan Hrasko [Tue, 8 Jan 2019 13:10:45 +0000 (14:10 +0100)]
SXP: Use not random retry time

Change-Id: I07f7f866af4b0d374e74366e4ba7ce60cd70fd48
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoAdd openflow punt protection suite 65/77165/19
shahid_calsoft [Mon, 22 Oct 2018 07:57:17 +0000 (13:27 +0530)]
Add openflow punt protection suite

Change-Id: I226552cbe569032881d9a16dbd1b2d0234bbf370
Signed-off-by: shahid_calsoft <mohammad.shahid@altencalsoftlabs.com>
5 years agoIncrease timeout for member stop 46/79246/2
Tom Pantelis [Fri, 4 Jan 2019 23:21:30 +0000 (18:21 -0500)]
Increase timeout for member stop

We've been seeing intermittent failures when
stopping a member where it times out waiting
for the karaf process to disappear. Eg
https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-neon/107/robot-plugin/log.html.gz#s1-s17
In that case, it timed out at 08:45:10 - the
karaf log indicates it stopped somehwere between
08:45:11 and 8:45:32 when it was restarted. So
the 2 min deadline wasn't quite enough in this
case.

I think at least part of the problem is that
CSIT installs the "world" or at least all the
managed projects which adds to the startup and
shutdown time - coupled with random delays due to
workload in the CSIT env. In lieu of trimming down
the installed features, let's double the timeout
to 4 min to (hopefully) give plenty of cushion.

Change-Id: I1d3b85ec1600c26c6ee187ffc5036a513151f2c6
Signed-off-by: Tom Pantelis <tompantelis@gmail.com>
5 years agoUse proper syntax for list passing to *contain* kw 88/79288/1
Jamo Luhrsen [Mon, 7 Jan 2019 19:31:51 +0000 (11:31 -0800)]
Use proper syntax for list passing to *contain* kw

more details here:
https://git.opendaylight.org/gerrit/#/c/79287/1//COMMIT_MSG

Change-Id: I65f688ac32a568f7bfa9f318eb270fc6135911d5
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agoUse $ for list arg passed in to builtIn kw 87/79287/1
Jamo Luhrsen [Mon, 7 Jan 2019 19:27:48 +0000 (11:27 -0800)]
Use $ for list arg passed in to builtIn kw

If a list is passed in with the @ syntax, it's expanded first
the first two elements are used for the BuiltIn keyword. So
the result is not what we expect. I noticed it in this false
failure:

https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/netvirt-csit-1node-1cmb-0ctl-0cmp-openstack-queens-upstream-stateful-snat-conntrack-fluorine/154/robot-plugin/log_full.html.gz#s1-s11-k1-k2-k6-k5

it needs to come in with the $ syntax so the keyword can
use it internally to loop over, and compare to the 2nd
argument.

Change-Id: Iea8cda9f8f7357cac3399cf7756822cc743cc6cd
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agoSXP: Improve connectivity tests 73/79273/2
Ivan Hrasko [Mon, 7 Jan 2019 13:24:12 +0000 (14:24 +0100)]
SXP: Improve connectivity tests

- Add logging for tests with passwords
- Nodes are already cleaned in test:
remove unnecessary cleanings

Change-Id: Ia6c86eb7083101a59f6d9c742a9f629b93296054
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoRemove check for ownership change 59/79159/2
Tom Pantelis [Wed, 2 Jan 2019 19:06:32 +0000 (14:06 -0500)]
Remove check for ownership change

The "Partition And Heal" and "Global Rpc Freeze" expect the
owner not to change after rejoin but akka may report a spurious
unreachable member event that can cause an owner change after rejoin.

Change-Id: I586f0da98743bd02a5a02038a4b894b2e8929218
JIRA: CONTROLLER-1865
Signed-off-by: Tom Pantelis <tompantelis@gmail.com>
5 years agoAdd Subnet And Multicast Suite. 52/72152/70
anuj.l [Tue, 22 May 2018 17:32:16 +0000 (23:02 +0530)]
Add Subnet And Multicast Suite.

Change-Id: I20f0a24c16252e6f078a98c0c96eb1382faeaabf
Signed-off-by: anuj.l <anuj.l@altencalsoftlabs.com>
Signed-off-by: mpany <madhusmita.p@altencalsoftlabs.com>
5 years agoRevert "Fix wrong GERRIT_PROJECT" 70/79070/1
Sam Hague [Wed, 26 Dec 2018 22:16:37 +0000 (22:16 +0000)]
Revert "Fix wrong GERRIT_PROJECT"

This reverts commit 5856b0886f8024dd1b6cabdddfd1a68d73a42bd7.

Change-Id: Ia949c795feb0f6f9ee9b167c53d2091f200a5b0f
Signed-off-by: Sam Hague <shague@redhat.com>
5 years agoFix wrong GERRIT_PROJECT 68/79068/2
Sam Hague [Wed, 26 Dec 2018 14:47:10 +0000 (09:47 -0500)]
Fix wrong GERRIT_PROJECT

GERRIT_PROJECT is used in the csit job to clone
the integration/test project so it can not beĀ·
overwritten with the root tst-patch job.

Depends-on: I426b516d2b81f1f2a758552f3e97c16f08e46127
Change-Id: I7d6d5e3d3ffe76807692a7b9bdd52fbca8377fe5
Signed-off-by: Sam Hague <shague@redhat.com>
5 years agoAdd multiple bgp vpn suite. 98/72698/50
mpany [Tue, 5 Jun 2018 15:44:24 +0000 (21:14 +0530)]
Add multiple bgp vpn suite.

Change-Id: I3ce4c0dbe6eba7899c3cd90debec9b84d5178a85
Signed-off-by: mpany <madhusmita.p@altencalsoftlabs.com>
5 years agoFix refspec for coe test patch 77/78877/4
Sam Hague [Wed, 19 Dec 2018 18:46:49 +0000 (13:46 -0500)]
Fix refspec for coe test patch

Depends-on: I5c67e9cf8db8b3e0ffc7ef857bae946cd3d7f489
Change-Id: I587245e1b61a0fa800d79cb920cab35667b678c5
Signed-off-by: Sam Hague <shague@redhat.com>
5 years agopretty print git log output 75/78875/3
Sam Hague [Wed, 19 Dec 2018 15:43:27 +0000 (10:43 -0500)]
pretty print git log output

Change-Id: I01fd907056bea4a57211f94d6e808f115fde361f
Signed-off-by: Sam Hague <shague@redhat.com>
5 years agoRemove check for leadership change 48/78848/2
Jamo Luhrsen [Mon, 17 Dec 2018 22:58:20 +0000 (14:58 -0800)]
Remove check for leadership change

see [0] for more details, but the idea is that we
have some sporadic cases where the isolated node
will report a node unreachable while it's being
rejoined to the cluster which triggers a new leader
election. This unreachable node messages can be
expected if the timing of things is a certain way
so the new leader election is also expected. In
the spirit of creating stable CSIT results without
sporadic failures, we will remove this test case.

[0] https://jira.opendaylight.org/browse/CONTROLLER-1865

JIRA: CONTROLLER-1865
Change-Id: Ic5da2d0748915a36e11eaa841f4b2772ecf7540f
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agoGenius CSIT - Add AutoTunnels Suite 83/77783/38
srajappa [Wed, 14 Nov 2018 12:30:19 +0000 (18:00 +0530)]
Genius CSIT - Add AutoTunnels Suite

This change is to remove CLI based deletion of vteps and
add REST calls for all recent changes of auto tunnel.
Removed All openstack related commands and
added CLI based verification of tunnel state in ITM_Vtep_Auto_Tunnel

Test spec link for auto-tunnel:
https://docs.opendaylight.org/projects/genius/en/latest/specs/itm-tunnel-auto-config.html

ITM_Vtep_Auto_Tunnel suit contains below test scenario
verify default transport zone after enabling local ip in compute
verify tunnel status after renaming external id to TZA in compute
verify tunnel status under default transport zone after removing TZA

Change-Id: Idadf7038d6b412b358e822b57590b8319ecfbe56
Signed-off-by: srajappa <srajappa@outlook.com>
5 years agoAdd graceful-restart test suite 77/77177/33
tomas.markovic [Mon, 22 Oct 2018 13:28:35 +0000 (15:28 +0200)]
Add graceful-restart test suite

Change-Id: I370968d827149a59d0908ff0f184450c70426a9e
Signed-off-by: tomas.markovic <tomas.markovic@pantheon.tech>
5 years agoCOE : Pass proper GERRIT_REFSPEC 42/78842/4
Faseela K [Mon, 17 Dec 2018 15:52:32 +0000 (21:22 +0530)]
COE : Pass proper GERRIT_REFSPEC

Change-Id: Idf3c9ea9305e9abae99881c274a621ab3af51055
Signed-off-by: Faseela K <faseela.k@ericsson.com>
Signed-off-by: Karthika Panneer <r.p.karthika@ericsson.com>
5 years agoPrecise log statements for COE CSIT 55/78855/2
Karthika Panneer [Tue, 18 Dec 2018 10:22:41 +0000 (02:22 -0800)]
Precise log statements for COE CSIT

Change-Id: Ia579b0df72d05cc087e8398d4ab498d942466ebd
Signed-off-by: Karthika Panneer <r.p.karthika@ericsson.com>
5 years agoFix COE Model Dumps 54/78854/2
Faseela K [Tue, 18 Dec 2018 10:21:26 +0000 (15:51 +0530)]
Fix COE Model Dumps

coe_data_models was partial for the
second suite, as model derivation is done
in start suite, and that was run only for
the first suite.

Change-Id: I73c3143ded18f44bf6a10b69bc3b581410671e93
Signed-off-by: Faseela K <faseela.k@ericsson.com>
5 years agoBroken COE patch test 90/78790/2
Faseela K [Fri, 14 Dec 2018 09:59:17 +0000 (15:29 +0530)]
Broken COE patch test

If we run COE patch test from netvirt,
it is currently not working, as the refspec
is getting used for building golang binaries
from COE project.

Change-Id: If90519fb035d01b4c18d3a1abcc5f06e92e8074a
Signed-off-by: Faseela K <faseela.k@ericsson.com>
5 years agos/Testcases/Test Cases/ 27/78727/1
Jamo Luhrsen [Thu, 13 Dec 2018 03:07:04 +0000 (19:07 -0800)]
s/Testcases/Test Cases/

With the newer version of robotframework the use of a single
work Testcases produces this warning in the robot .html log

Error in file '<filename>: Section name 'Testcases' is deprecated.
Use 'Test Cases' instead.

This will clean that up

Change-Id: Ibd1542b31fe2573cd20931129f29f5c4b5cf0060
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agoFix change_counter 69/78669/2
Tomas Markovic [Wed, 12 Dec 2018 08:33:36 +0000 (09:33 +0100)]
Fix change_counter

Change-Id: I793d57c50e0742eba80dc1107f158458a19f8663
Signed-off-by: Tomas Markovic <tomas.markovic@pantheon.tech>
5 years agoSXP: Wait for bindings to be send/received 18/78618/1
Ivan Hrasko [Mon, 10 Dec 2018 11:17:44 +0000 (12:17 +0100)]
SXP: Wait for bindings to be send/received

Change-Id: Ide429e7a77fe89840a8b740b4640d61e428e58c0
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoSXP: Fix "Check Connections" KW usage 43/78543/1
Ivan Hrasko [Fri, 7 Dec 2018 15:01:00 +0000 (16:01 +0100)]
SXP: Fix "Check Connections" KW usage

Change-Id: Ib52a732dafbbdb66d6cf97b7be448454fc490728
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoSXP: Fix teardown in 040_Custom_Passwords 34/78534/2
Ivan Hrasko [Fri, 7 Dec 2018 08:24:59 +0000 (09:24 +0100)]
SXP: Fix teardown in 040_Custom_Passwords

- in setup only 3 nodes are created
- in teardown delete only 3 nodes (not 4)

Change-Id: I7a878dd1610c0470591e2ee8adbca8d174df6b9f
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoFix tidy for Coe 37/78537/1
Ivan Hrasko [Fri, 7 Dec 2018 09:52:30 +0000 (10:52 +0100)]
Fix tidy for Coe

Change-Id: I7a47e2e18e29f20906d3424a9c4a1b48d1b112c6
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoEnhance HA suite teardown 09/78509/2
Faseela K [Thu, 6 Dec 2018 17:18:05 +0000 (22:48 +0530)]
Enhance HA suite teardown

Change-Id: Icfb88c8b26983483dcaf4fa27b30faa58f56e4c7
Signed-off-by: Faseela K <faseela.k@ericsson.com>
5 years agoAdd ping retries and break on success 94/78394/12
Sam Hague [Mon, 3 Dec 2018 19:58:11 +0000 (14:58 -0500)]
Add ping retries and break on success

Change the ping command to take a retries value. This
allows the ping to be more independent of timing issues
with flow additions.

The cirros images and the SSHLibary have some weird quirks
that the patch had to workaround:

- The cirros images use a dash like shell and not bash. This
required catering the shell command to be posix compliant.
- The typical prompt of $ is in the shell command so it can't
be used to read until. This was changed to read until regexp
to look for the final rc=n from the command.
- The SSHLibrary Write keyword actually consumes and returns
the command itself, which was causing an early match. The regex
helped here also since the regex would only match on the rc=n -
so a number had to be in the output for it to match.

JIRA: NETVIRT-1399
Change-Id: I06d43fbd2ce7a0f32ccc60cdfd2783abaadd260b
Signed-off-by: Sam Hague <shague@redhat.com>
5 years agoSXP: Reorder cluster tests 76/78376/2
Ivan Hrasko [Mon, 3 Dec 2018 11:14:17 +0000 (12:14 +0100)]
SXP: Reorder cluster tests

- reorder cluster tests to minimize
impacts of frequent cluster owner isolation

JIRA: SXP-154
Change-Id: I3636167c55e13a20427ed0432dc667339af59d94
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoDisable prefix based sharding cluster suites 09/78309/2
Jamo Luhrsen [Fri, 30 Nov 2018 01:57:29 +0000 (17:57 -0800)]
Disable prefix based sharding cluster suites

The below comment block is also in the testplan file:

/ disabling all "prefix based" suites. This functionality was newly
/ introduced with these tests in 2017. The assumption is that
/ development stopped in that area, but may continue at a later
/ time. Still, the tests are failing and no resources to solve the
/ failures at this time. If/When this changes, we can uncomment
/ those suites. Note that every suite is commented out with it's
/ accompanying "restart_with_tell_based_true" setup suite.

Change-Id: If624bc303d1d12625c0f7f79f9590bc29caccaf2
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agoUse OS_CMP format for compute ips 67/77867/4
Jamo Luhrsen [Fri, 16 Nov 2018 06:29:45 +0000 (22:29 -0800)]
Use OS_CMP format for compute ips

The devstackutils library now will generate proper ips
for our OS_CMP1_IP and OS_CMP2_IP variables depending
on the deployment. In the case of an all-in-one deployment
the CMP1 and CMP2 ips are going to be the same. That
was done for all other suites back when we moved to this
method, but I think elan was missed somehow.

example of how it fails:
https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/netvirt-csit-1node-1cmb-0ctl-0cmp-openstack-queens-upstream-stateful-fluorine/116/robot-plugin/log_full.html.gz#s1-s11-k1-k2-k7-k1-k5-k3-k1

you can see that the ssh session had no destination ip
listed, because that variable used was not available

Change-Id: I3cb2f63828bad2ee1fd4f3a03ce08eab30159295
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agoUse openstack cli instead of neutron 38/78238/9
Jamo Luhrsen [Wed, 28 Nov 2018 01:23:03 +0000 (17:23 -0800)]
Use openstack cli instead of neutron

neutron cli is deprecated and we don't install that client
in our apex job (yet) and would prefer not to keep maintaining
the deprecated cli.

Change-Id: I119dd160b04fcd1570d48c5849a999b77bbe6d92
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agoAdd 10s polling to allow transactions to complete 90/78190/4
Jamo Luhrsen [Tue, 27 Nov 2018 05:54:16 +0000 (21:54 -0800)]
Add 10s polling to allow transactions to complete

In some cases the check to ensure that all cars/people
were populated in the config store happened just before
the last few were there. This could be because of
any number of reasons (slow external environment,
testing in the middle of a GC operation maybe, etc)
Adding a polling period will account for this and
not give a false failure.

Change-Id: Ic9c7456da37b5c2cca694b2affc77e048a2f7b31
JIRA:INTTEST-54
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agoStrict check on kubectl get nodes 01/78201/7
Karthika Panneer [Tue, 27 Nov 2018 10:27:15 +0000 (02:27 -0800)]
Strict check on kubectl get nodes

1.Replacing the existing check where
status 'Ready' is checked for all
lines to checking status for number
of nodes.
2.Removal of unused hard coded variables

Change-Id: If0b086a549932188bf2ad95cdf6a654087793375
Signed-off-by: Karthika Panneer <r.p.karthika@ericsson.com>
5 years agoUse openstack CLI for router delete 39/78239/6
Jamo Luhrsen [Wed, 28 Nov 2018 01:27:36 +0000 (17:27 -0800)]
Use openstack CLI for router delete

the neutron cli is deprecated and would live to stop
maintaining it. Also, the apex jobs that are coming
online don't have the neutron cli installed by default.

Change-Id: Ib3daf3ef79e6609cac30b4c54d7a93a9fc18a2c8
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agoCheck for 404 instead of empty list 28/78128/7
Vishal Thapar [Mon, 26 Nov 2018 08:04:09 +0000 (13:34 +0530)]
Check for 404 instead of empty list

As part of Neon platform upgrade, read on an empty
list now returns a null [404] instead of 200 with
emtpy list.

Refer: https://wiki.opendaylight.org/view/Neon_platform_upgrade#Datastore_lifecycle

Change-Id: I4762749ed8f54eb5a8fb78bbc11bba3ba4a3524e
Signed-off-by: Vishal Thapar <vthapar@redhat.com>
5 years agoUse gerrit patch for coe csit 70/78170/15
Sam Hague [Mon, 26 Nov 2018 20:17:14 +0000 (15:17 -0500)]
Use gerrit patch for coe csit

Change-Id: I93ee4bce847a86adaa89409b12dd8a3ae760dfc1
Signed-off-by: Sam Hague <shague@redhat.com>
5 years agoAllow coe to use single suite 78/78178/2
Sam Hague [Mon, 26 Nov 2018 21:34:09 +0000 (16:34 -0500)]
Allow coe to use single suite

Change-Id: I0dc13d02c3adc76aa7f4ab0e92cf9a4039274376
Signed-off-by: Sam Hague <shague@redhat.com>
5 years agoFix outputs in bgp-ha 97/78097/2
Tomas Markovic [Fri, 23 Nov 2018 14:25:11 +0000 (15:25 +0100)]
Fix outputs in bgp-ha

Change-Id: Iec24e3a285cf7af6008e7d2bb8949f16527a24ed
Signed-off-by: Tomas Markovic <tomas.markovic@pantheon.tech>
5 years agoDisable Tunnel Validation for SFC Jobs 70/77970/6
gvrangan [Tue, 20 Nov 2018 09:24:42 +0000 (18:24 +0900)]
Disable Tunnel Validation for SFC Jobs

- SFC uses the flow based tunnels
- odltools needs to be enhanced for
  validating of tunnels
- Until the enhancement is complete, this
  patch blocks the tunnel validation for
  SFC jobs.

Change-Id: Ie9542d6ea878d6ea5e4d5f9a8f120f9ab1d01acf
Signed-off-by: gvrangan <venkatrangang@hcl.com>
5 years agoFix ibgp peer lsp base64 encoding 80/78080/1
Tomas Markovic [Fri, 23 Nov 2018 08:16:32 +0000 (09:16 +0100)]
Fix ibgp peer lsp base64 encoding

Change-Id: I702c4a377c05103272b28108e7866463b360c21e
Signed-off-by: Tomas Markovic <tomas.markovic@pantheon.tech>
5 years agoFix empty uri for functional tests 15/77715/19
tomas.markovic [Tue, 13 Nov 2018 10:43:38 +0000 (11:43 +0100)]
Fix empty uri for functional tests

- fix as_path across functional tests

Change-Id: Ifb00546e0cd277ea18417f2e819778b294b6010c
Signed-off-by: tomas.markovic <tomas.markovic@pantheon.tech>
5 years agoAppend more BGP multipath testcases for ODL 57/77757/9
shahid_calsoft [Wed, 14 Nov 2018 06:36:06 +0000 (12:06 +0530)]
Append more BGP multipath testcases for ODL

Change-Id: Iff2bff7ae6a058f5a51de20350d1ae37cb8e950e
Signed-off-by: shahid_calsoft <mohammad.shahid@altencalsoftlabs.com>
5 years agoUse rate of 5 to avoid false failures 61/76361/5
Jamo Luhrsen [Fri, 21 Sep 2018 23:20:07 +0000 (16:20 -0700)]
Use rate of 5 to avoid false failures

See the comment in the file for more details

Change-Id: I4a54fbc693747aa0a6d49e56700a9e61b25fe99d
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agoFix bundle sync test 67/77967/4
Luis Gomez [Tue, 20 Nov 2018 06:48:20 +0000 (22:48 -0800)]
Fix bundle sync test

Just need some time to install group before flow.

Change-Id: If6fd9f6f1f9c34240974f7265bd0996d181bc7a0
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
5 years agoSXP: Increase node start timeout 72/77972/2
Ivan Hrasko [Tue, 20 Nov 2018 09:33:00 +0000 (10:33 +0100)]
SXP: Increase node start timeout

JIRA: SXP-154
Change-Id: I1863c887cb5955511efcd91fc85455351d64b1a6
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoSXP: Check cluster is in sync 37/77937/2
Ivan Hrasko [Mon, 19 Nov 2018 11:12:43 +0000 (12:12 +0100)]
SXP: Check cluster is in sync

- check that all cluster nodes are
in sync after leader isolation is
reverted

JIRA: SXP-154
Change-Id: I770c148d55c7b046eb72f85a13f8d4902854f6db
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoFix bgp_route_refresh line ending 45/77945/2
Tomas Markovic [Mon, 19 Nov 2018 13:16:03 +0000 (14:16 +0100)]
Fix bgp_route_refresh line ending

Karaf cli line ending is now updated even on oxygen.
Change test to reflect these changes.

Change-Id: Id80209750572e1f49649b53bd8b0b77d3b6ffee1
Signed-off-by: Tomas Markovic <tomas.markovic@pantheon.tech>
5 years agoLower Chasing_The_Leader rate threshold 49/77949/3
Tom Pantelis [Mon, 19 Nov 2018 16:27:46 +0000 (11:27 -0500)]
Lower Chasing_The_Leader rate threshold

With the rate threshold set at 50, this
test fails frequently. Not sure why that
threshold was picked but lowered it to 10.
Looking at past runs, the actual rate
fluctuates anywhere between 20-80, which is
indicative of the unpredictablity of load in
the CS environment as the related
production code is mostly network I/O bound.

Change-Id: Id579c9553e0e48c85c039de5fddb0d1e56a5f2e6
Signed-off-by: Tom Pantelis <tompantelis@gmail.com>
5 years agoFix Global Rpc Kill et al failures 52/77952/2
Tom Pantelis [Mon, 19 Nov 2018 17:27:17 +0000 (12:27 -0500)]
Fix Global Rpc Kill et al failures

Global Rpc (Kill|Freeze|Isolate) have been failing for quite some time
(in Neon and Fluorine) with a 500 response when executing RPC
 /restconf/operations/basic-rpc-test:basic-global. It's a no-input RPC
and the robot code passes an empty strng for the content-type and accept
parans to Post_To_Uri. In comparing with another RPC that has no input,
that code passes the ${HEADERS_XML} and ${ACCEPT_XML} constants so I did
the same in the Glocal Rpc tests. It seems something changed in Fluorine
where passng empty content-type/accept headers no longer works.

Change-Id: Iaa4e9ef9dddde8291d1cae7d09f878be0b781ae0
Signed-off-by: Tom Pantelis <tompantelis@gmail.com>
5 years agoSXP: wait for node start/stop 58/77858/5
Ivan Hrasko [Thu, 15 Nov 2018 16:17:03 +0000 (17:17 +0100)]
SXP: wait for node start/stop

Change-Id: I626c0bc4e08eb120a6e10d1677b620cfc53273c1
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoExclude test until OPNFLWPLUG-1052 is resolved 08/77908/1
Luis Gomez [Fri, 16 Nov 2018 19:16:35 +0000 (11:16 -0800)]
Exclude test until OPNFLWPLUG-1052 is resolved

Change-Id: I8b15ab0e578eab5a4670d6ca8c7a5c11e6541bc9
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
5 years agoWrap checks after deletes in a WUKS 69/77869/3
Jamo Luhrsen [Fri, 16 Nov 2018 06:40:35 +0000 (22:40 -0800)]
Wrap checks after deletes in a WUKS

Example here shows that a delete was done but the
uuid still showed up in the config store. In the
example below, you can see the openstack CLI to
delete the l2gw connection completed at timestamp
00:39. Looking in the 3 karaf logs (it's a cluster
job) you can see the delete made it by 00:41 or
00:42 depending on which log you check. So, polling
for up to 5 seconds should give a little time for
that to propagate.

example:
https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/builder-copy-sandbox-logs/508/jamo-netvirt-csit-hwvtep-3node-0cmb-1ctl-2cmp-openstack-queens-upstream-stateful-fluorine/14/robot-plugin/log_full.html.gz#s1-s1-s1-t20-k1-k4

Change-Id: I4e09db3a03a4851df14d47b5328abe7eba834052
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agoMake ${OS_NODE_CNT} a suite variable 66/77866/1
Jamo Luhrsen [Fri, 16 Nov 2018 06:10:41 +0000 (22:10 -0800)]
Make ${OS_NODE_CNT} a suite variable

Without making it a suite variable, it seems the changed
value is only local to that keyword, and outside of that
keyword it will remain the value as assigned in the
above *** Variables *** section, which is ${1}

example of the value getting changed to 3:
https://logs.opendaylight.org/sandbox/vex-yul-odl-jenkins-2/jamo-netvirt-csit-1node-0cmb-1ctl-2cmp-apex-queens-gate-snat-conntrack-oxygen/42/robot-plugin/log_full.html.gz#s1-k1-k1-k4-k2-k4

two keywords later in that same job, you can see
it's incorrectly back to 1:
https://logs.opendaylight.org/sandbox/vex-yul-odl-jenkins-2/jamo-netvirt-csit-1node-0cmb-1ctl-2cmp-apex-queens-gate-snat-conntrack-oxygen/42/robot-plugin/log_full.html.gz#s1-k1-k1-k4-k2-k6-k2

Change-Id: I6e8cc9eb73acc8efef8a61342546d2de1205e4bb
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agoReplace BR1 and BR2 with br-int in Genius-CSIT 64/77764/9
Karthika Panneer [Wed, 14 Nov 2018 07:24:16 +0000 (23:24 -0800)]
Replace BR1 and BR2 with br-int in Genius-CSIT

Change-Id: Id9d6cbbb5013460c5d7572a3a34238005a7213b9
Signed-off-by: Karthika Panneer <r.p.karthika@ericsson.com>
5 years agoFix flowspec empty uri 13/77713/9
tomas.markovic [Tue, 13 Nov 2018 10:13:57 +0000 (11:13 +0100)]
Fix flowspec empty uri

In neon, family ribs, are not initialized
until we fill them, and therefore we have
to check whether they are empty differently

Change-Id: I12815bc3383e10942873a496bb7a71608d01410e
Signed-off-by: tomas.markovic <tomas.markovic@pantheon.tech>
5 years agoFix dpkg frontend locking 91/77791/3
shahid_calsoft [Wed, 14 Nov 2018 13:44:14 +0000 (19:14 +0530)]
Fix dpkg frontend locking

Getting following error while installing debian packages in CSIT
dpkg: error: dpkg status database is locked by another process
due to this locking failure dcgw script could not install all
required Quagga debian packges in tools system hence suite failed
refer following fix for the same
https://bugs.launchpad.net/ubuntu/+source/dpkg/+bug/1796081

Change-Id: I498520b1fbc1068a2f9ad9d54cab1e9217a0977e
Signed-off-by: shahid_calsoft <mohammad.shahid@altencalsoftlabs.com>
5 years agoRemove vtep-auto-tunnels from tdd-wip 77/77777/1
Faseela K [Wed, 14 Nov 2018 11:32:15 +0000 (17:02 +0530)]
Remove vtep-auto-tunnels from tdd-wip

This script is broken, and cannot even run
from genius patch test. Shankar needs
to update the test suite as per comments
on https://git.opendaylight.org/gerrit/#/c/73225/
and then add the suite to main test plan.

Change-Id: I035509f6c1d3e8e1da27802d0c6a9d313aaf7bdf
Signed-off-by: Faseela K <faseela.k@ericsson.com>
5 years agoSXP: Wait for RPC registration 23/77723/7
Ivan Hrasko [Tue, 13 Nov 2018 13:55:57 +0000 (14:55 +0100)]
SXP: Wait for RPC registration

- SXP has RPC services registered on owner
node only, after owner change it can take
some time for them to be registered on new
owner

Change-Id: I28316461d38bd1bfc78a3851794017aa3f36372c
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoSXP: Fix WUKS KW usage 70/77770/5
Ivan Hrasko [Wed, 14 Nov 2018 09:21:32 +0000 (10:21 +0100)]
SXP: Fix WUKS KW usage

- BuiltIn.Wait Until Keyword Seceeds KW is used in wrong
way in some places

- the first argument should be number of retries
- the second argument should be retry interval
- it has no sense to retry 1x

Change-Id: I326b4fbb7bab42e844642c5765ecf078c03f00c1
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoSXP: Run binding origins test on Fluorine 06/77706/4
Ivan Hrasko [Tue, 13 Nov 2018 08:11:45 +0000 (09:11 +0100)]
SXP: Run binding origins test on Fluorine

- binding origins test can be run on Fluorine
and later streams only

Change-Id: I97a14461e16ad7daa5bf5533621793f3a1d74bc6
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoFix cluster suites after latest updates 43/77743/5
Luis Gomez [Tue, 13 Nov 2018 23:47:42 +0000 (15:47 -0800)]
Fix cluster suites after latest updates

- For OFP inventory returns empty when no switch is connected.
- For Netconf there is a change in the singleton entity ID.

Change-Id: I57780e099f1c59b23d89007c47f5855f1a45ff18
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
5 years agoFix bgp l2vpn evpn test 48/77548/9
tomas.markovic [Tue, 6 Nov 2018 14:59:28 +0000 (15:59 +0100)]
Fix bgp l2vpn evpn test

Change-Id: I53d392ff8302473f4e9d0aa5239d3085fb177c30
Signed-off-by: tomas.markovic <tomas.markovic@pantheon.tech>
5 years agoFix route-key argument in ibgp test 07/77707/2
tomas.markovic [Tue, 13 Nov 2018 09:19:11 +0000 (10:19 +0100)]
Fix route-key argument in ibgp test

The route-key on neon is now in proper base64
enconding so we can change test to reflect this.

Change-Id: I892daed80b4ca30b2bbf8f5048a04889d3535f9b
Signed-off-by: tomas.markovic <tomas.markovic@pantheon.tech>
5 years agoLog output from ovs commands for easier debugging 20/77420/2
Jamo Luhrsen [Thu, 1 Nov 2018 17:43:59 +0000 (10:43 -0700)]
Log output from ovs commands for easier debugging

Change-Id: I0c53fbad88d981a53d00cc4b4ab84a05a723a38b
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agoRemove Create Resources from first test case 18/77418/2
Jamo Luhrsen [Thu, 1 Nov 2018 17:35:15 +0000 (10:35 -0700)]
Remove Create Resources from first test case

[0] refactored some test code to unify some suite
setups, which moved "Create Resources" to the suite
setup. Doing it again in the first test case results
in a failure, since openstack create commands are
failing trying to create a duplicate

[0] https://git.opendaylight.org/gerrit/#/c/74698/7/csit/suites/netvirt/upgrade/upgrade.robot

Change-Id: I99c8393a010ad2ec22f7a8ca89e6d2dca783ecf9
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
5 years agoFix bgp_app_peer test 38/77538/5
tomas.markovic [Tue, 6 Nov 2018 13:34:24 +0000 (14:34 +0100)]
Fix bgp_app_peer test

Refactor test

In result we also fix bgp_app_peer.py
script, which should increase health
of most of the performance tests.

Change-Id: I831540c6e09287ec7642de7adfc98d74e8f2b087
Signed-off-by: tomas.markovic <tomas.markovic@pantheon.tech>
5 years agoAdd BGP multipath support suite for ODL 27/72227/33
shahid_calsoft [Thu, 24 May 2018 10:59:18 +0000 (16:29 +0530)]
Add BGP multipath support suite for ODL

Change-Id: Ic25735ae34630679cfc71150fd592b162f0c2348
Signed-off-by: shahid_calsoft <mohammad.shahid@altencalsoftlabs.com>
5 years agoAdd DC gateway configplan 57/59457/41
maheshl [Fri, 23 Jun 2017 10:36:49 +0000 (16:06 +0530)]
Add DC gateway configplan

Change-Id: I16130e39a7ecb536cf1dc025335c413f7c49fe09
Signed-off-by: shahid_calsoft <mohammad.shahid@altencalsoftlabs.com>
Signed-off-by: mpany <madhusmita.p@altencalsoftlabs.com>
5 years agoFix bgpcep flowspec test 19/77619/2
tomas.markovic [Thu, 8 Nov 2018 13:11:37 +0000 (14:11 +0100)]
Fix bgpcep flowspec test

Change-Id: I2a9bd47810842b5a39e917bcabf6afe3feb291e0
Signed-off-by: tomas.markovic <tomas.markovic@pantheon.tech>
5 years agoDont check tunnels on single node 33/77633/1
Sam Hague [Thu, 8 Nov 2018 20:21:00 +0000 (15:21 -0500)]
Dont check tunnels on single node

Change-Id: I96d1e415342899f3743be700ea1c64117ff35066
Signed-off-by: Sam Hague <shague@redhat.com>
5 years agoFix bgp multipath test 21/77621/2
tomas.markovic [Thu, 8 Nov 2018 13:30:12 +0000 (14:30 +0100)]
Fix bgp multipath test

Change-Id: Ia346e8007ab69a1b6df4eb281b2d16feecdc1f1e
Signed-off-by: tomas.markovic <tomas.markovic@pantheon.tech>
5 years agoFix bgpcep lsp test 20/77620/2
tomas.markovic [Thu, 8 Nov 2018 13:21:51 +0000 (14:21 +0100)]
Fix bgpcep lsp test

Change-Id: I9b6ec9e8c5063ae95ba55d357e8a7bc90da631a2
Signed-off-by: tomas.markovic <tomas.markovic@pantheon.tech>
5 years agoFix bgpcep tcpmd5user test 03/77603/3
tomas.markovic [Thu, 8 Nov 2018 08:09:00 +0000 (09:09 +0100)]
Fix bgpcep tcpmd5user test

Remove irrelevant tc's

Change-Id: Id30777f7eff69376d87230c56fc644e9096abd14
Signed-off-by: tomas.markovic <tomas.markovic@pantheon.tech>
5 years agoFix bgp route refresh test 76/77576/6
tomas.markovic [Wed, 7 Nov 2018 10:48:30 +0000 (11:48 +0100)]
Fix bgp route refresh test

Change-Id: I0485816fc7b37938674e96047eb0510e00448bc0
Signed-off-by: tomas.markovic <tomas.markovic@pantheon.tech>
5 years agoSXP: Add RPC redirecting tests 56/77256/16
Ivan Hrasko [Wed, 24 Oct 2018 14:27:30 +0000 (16:27 +0200)]
SXP: Add RPC redirecting tests

Change-Id: Iad37cee3c72b4add1c477c3fe7149e8781fa6e2d
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoAdd False check to validation 98/77598/2
Sam Hague [Thu, 8 Nov 2018 02:33:17 +0000 (21:33 -0500)]
Add False check to validation

Change-Id: Ia60933fd2c8938a28ad8b68bba0558e7036a373b
Signed-off-by: Sam Hague <shague@redhat.com>
5 years agoSXP: Use ip instead of arp 78/77278/8
Ivan Hrasko [Thu, 25 Oct 2018 14:09:10 +0000 (16:09 +0200)]
SXP: Use ip instead of arp

Change-Id: I5aa16e324589c3136d1d2eecb57748abce3d5963
Signed-off-by: Ivan Hrasko <ihrasko@cisco.com>
5 years agoUse defined tools ips 64/77564/1
Sam Hague [Tue, 6 Nov 2018 19:04:35 +0000 (14:04 -0500)]
Use defined tools ips

Change-Id: Iefafd774674805f3684a871be81ace45502b43c4
Signed-off-by: Sam Hague <shague@redhat.com>
5 years agoFix bgp default policies test 40/77540/2
tomas.markovic [Tue, 6 Nov 2018 13:57:48 +0000 (14:57 +0100)]
Fix bgp default policies test

Change-Id: I378ba8ba4d56a217cd43b555e3976d9183aa47ca
Signed-off-by: tomas.markovic <tomas.markovic@pantheon.tech>