integration/test.git
7 years agoAdd scalability test for OCPPLUGIN 88/39588/6
jason [Mon, 30 May 2016 09:05:51 +0000 (17:05 +0800)]
Add scalability test for OCPPLUGIN

Change-Id: Icde7d8a2a56765cb5e13ebef1e2195b4e440a30a
Signed-off-by: jason <jason.cw.yuan@foxconn.com>
7 years agofixing play.py and data change counter 90/40290/4
Peter Gubka [Tue, 14 Jun 2016 10:31:15 +0000 (12:31 +0200)]
fixing play.py and data change counter

-LOCAL_PREF is added into play.py to be sent
-new xml and uri file added for data change counter usage in boron
 as new schema is present in boron

Change-Id: I6b3179c4cdc82e97e0de557f2a484ee537527d12
Signed-off-by: Peter Gubka <pgubka@cisco.com>
7 years agoRemoved duplicate code for entity ownership 39/39639/28
Ernest Deák [Mon, 30 May 2016 12:32:36 +0000 (14:32 +0200)]
Removed duplicate code for entity ownership

Duplicate code removed related to entity ownership in
entity.robot

Change-Id: Ic3a2da3a1efc06e317204be2d2ab65db9107e96b
Signed-off-by: Ernest Deák <erdeak@cisco.com>
7 years agoAdd support for netconf entities 82/37982/6
Jozef Behran [Thu, 21 Apr 2016 16:12:57 +0000 (18:12 +0200)]
Add support for netconf entities

Change-Id: I6ec8a9fd629c893ae6c5f63cd4b3089584e167db
Signed-off-by: Jozef Behran <jbehran@cisco.com>
7 years agoAdd entity ownership handling test 70/37870/29
Jozef Behran [Fri, 22 Apr 2016 11:21:16 +0000 (13:21 +0200)]
Add entity ownership handling test

Change-Id: I7103363012caf770c20d3e6e7af5ab4fcac9a861
Signed-off-by: Jozef Behran <jbehran@cisco.com>
7 years agoInstalls pyangbind into the Robot test VM image. 99/38699/2
Ashish [Thu, 12 May 2016 03:02:08 +0000 (08:32 +0530)]
Installs pyangbind into the Robot test VM image.

Pyangbind generates high level python class
bindings for the given yang models. This commit
installs the plugin.

This plugin can be used to generate python bindings
which uses the libraries from the plugin. We can use
these bindings to generate the desired JSON with
default or variable data.

Change-Id: I2f980264ef42495abcb9592e57e6b381f38266bb
Signed-off-by: Ashish <ashishk.iiit@gmail.com>
7 years agoStabilize ovsdb-csit-3node-clustering-only-<stream> job 46/39646/5
priya.ramasubbu [Tue, 31 May 2016 14:43:09 +0000 (20:13 +0530)]
Stabilize ovsdb-csit-3node-clustering-only-<stream> job

Change-Id: If826d8e6a62d954cc51b813552108833606f7972
Signed-off-by: priya.ramasubbu <priya.ramasubbu@hcl.com>
7 years agofix ovsdb clustering failures 85/40185/7
Jamo Luhrsen [Fri, 10 Jun 2016 20:19:54 +0000 (13:19 -0700)]
fix ovsdb clustering failures

- use more specific URIs for neutron northbound
- use POST instead of PUT
- cleaned up URI variables for suite that is not used in
  production, but brings it up to standard variable use

Change-Id: If750dae2f8b3041e08fdbf5664ff258ae3b82d18
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
use more specific URIs for neutron northbound

Change-Id: Iafe6e6829dd809655a0c714d098aadc8e7fac555
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
7 years agoAdding Natapp System-Test into Integration 97/39597/2
Thomas Lee S [Mon, 30 May 2016 11:13:54 +0000 (16:43 +0530)]
Adding Natapp System-Test into Integration

Change-Id: I79cbd113a5062ab7d7f5aad0d0309ba872e629f1
Signed-off-by: Thomas Lee S <thomaslee.s@tcs.com>
7 years agomove node URI/data syntax around and remove hard coded ip 55/40255/3
Jamo Luhrsen [Mon, 13 Jun 2016 20:43:59 +0000 (13:43 -0700)]
move node URI/data syntax around and remove hard coded ip

-  a hard coded ip had crept in with an early patch.  that is now back to
   a variable format

-  some places (like URIs for REST) need %2F in place of actual "/" character
   so reworked the tests to use that as needed

-  moved uuid discovery to the test case that needs it, instead of suite setup
   since it was getting reset as part of normal test flow and was invalid

Change-Id: I5fe95e10052e1a9c6e3565dd453b9441a0153bf2
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
7 years agoSxp Topology tests update of Most Recent Rule test 98/38098/7
Martin Mihálek [Tue, 26 Apr 2016 08:20:35 +0000 (10:20 +0200)]
Sxp Topology tests update of Most Recent Rule test
to check state via Wait Until Keyword

Change-Id: Ib14354508b1d8abd513a6d33b3df91dabd014b6b
Signed-off-by: Martin Mihálek <mamihale@cisco.com>
7 years agoincrease wait time from 3 to 5 when ovs connects to ovsdb sb 49/40249/1
Jamo Luhrsen [Mon, 13 Jun 2016 17:15:49 +0000 (10:15 -0700)]
increase wait time from 3 to 5 when ovs connects to ovsdb sb

Change-Id: Ib5bfe69c28e2e23d2b70ec6a2f622044ea699d52
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
7 years agoAdded test suite for verification of data consistency in config DS and 57/39357/8
Sanjib Mohapatra [Tue, 24 May 2016 13:55:45 +0000 (19:25 +0530)]
Added test suite for verification of data consistency in config DS and
switch under various HA scenarios

        Description: In a 3 node cluster initial inventory shard status is
        verified and following tests are performed.

        - Start mininet with single switch and using Bulkomatic API pushed 1000 flows to config datastore

        - Verify data consistency across all cluster nodes via Bulkomatic API also in the connected switch

        - Kill all cluster nodes and then stop switch

        - Restart cluster connect and reconnect the switch to follower node1

        - Verify data recovery across all cluster nodes also in the connected switch

        - Stop the switch and delete 1000 flows via Bulkomatic API from follower node1

        - Similarly test cases added for leader restart and followe restart scenarios

        - Added library file and new json files

        - As per code review comment moved common variables to
          BulkomaticKeywords.robot library file

Change-Id: I1457a23d6f44d3793ecc63ab79c5a391718b7e89
Signed-off-by: Sanjib Mohapatra <sanjib.mohapatra@ericsson.com>
7 years agoIncreasing time delay for feature installation 99/40099/2
Ruchita [Thu, 9 Jun 2016 09:29:27 +0000 (14:59 +0530)]
Increasing time delay for feature installation

Change-Id: Iac719cae522d57986c0f055fb7551b887372551e
Signed-off-by: Ruchita <ruchita.khanna@tcs.com>
7 years agoSmall Fixes to the Openstack Keywords 20/39820/7
gvrangan [Fri, 3 Jun 2016 07:05:17 +0000 (07:05 +0000)]
Small Fixes to the Openstack Keywords

a. Add more timeout for delete and other
   operations that were failing in sandbox
b. Make the flavor as nano for VM instances
   as it could speed up the building

Change-Id: I6309528e972ce11f9d1eb5811d0208f5a9a78722
Signed-off-by: gvrangan <venkatrangang@hcl.com>
7 years agoupdating expected results for boron stream 11/40011/2
Peter Gubka [Wed, 8 Jun 2016 09:38:24 +0000 (11:38 +0200)]
updating expected results for boron stream

minor updates in .robot files due to api change for variables

Change-Id: Id8b7a9f5f3825de85ca25ba75ea53ad8eec95559
Signed-off-by: Peter Gubka <pgubka@cisco.com>
7 years agoEnhanced debugging logs in GBP CSIT 29/39829/9
Tomas Cechvala [Fri, 3 Jun 2016 10:30:12 +0000 (12:30 +0200)]
Enhanced debugging logs in GBP CSIT

 - fixed periodic curl
 - added logging for easier debugging

Change-Id: Ib00a74cec8b4abcb2f7d872e48d2cd46707544fb
Signed-off-by: Tomas Cechvala <tcechval@cisco.com>
7 years agoAdding ElasticsearchAppenderClass & longevitytests 59/38559/19
Kumar Rishabh [Mon, 9 May 2016 07:07:25 +0000 (12:37 +0530)]
Adding ElasticsearchAppenderClass & longevitytests

This adds ElasticsearchAppender Class which can query for harvested
MBeans in an Elasticsearch Node to which karaf-decanter dumps the data.
The current MBeans that can be currently queried for are:
    java.lang:type=GarbageCollector
    java.lang:type=Threading
    java.lang:type=ClassLoading
    java.lang:type=Memory
    java.lang:type=OperatingSystem

This also adds a method plot_points which draws graph using mathplotlib
for the above metrices
    Usage example is defined in the file.

This also adds long duration robot tests for the above class in the
folder longevity. A sample run would look something similar to

robot -v PORT:9200 -v IP:10.2.4.204 -v DURATION:20 -v STEP:1 010_Check_JVM_Resource.robot
where elasticsearch node is running on 10.2.4.204:9200 and each of the
tests is to be run for a duration of 20 seconds.
Also adds a test to plot_points where the graph is plotted using the
points from the starting of the elasticsearch node to the current time.

Change-Id: I4acb3cef32213e91cbaadb40c0c21deef8f4c060
Signed-off-by: Kumar Rishabh <shailrishabh@gmail.com>
7 years agoSuite for testing Distribution version reporting 37/39837/3
Vratko Polak [Fri, 3 Jun 2016 13:25:57 +0000 (15:25 +0200)]
Suite for testing Distribution version reporting

Change-Id: I5c9f963c1c0fd6327f9ed47c4e91f5ac8d20460b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
7 years agoFix Robot file formatting in recent merges 41/39841/1
Vratko Polak [Fri, 3 Jun 2016 13:26:33 +0000 (15:26 +0200)]
Fix Robot file formatting in recent merges

Change-Id: I8c46806517b674864c698ee31bee386545826b10
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
7 years agoadd ability for cbench to be run locally to the system executing robot framework 10/39810/2
Jamo Luhrsen [Thu, 2 Jun 2016 23:56:44 +0000 (16:56 -0700)]
add ability for cbench to be run locally to the system executing robot framework

Change-Id: I0efb64c93ff5ffc43bd456d1e66064a2cd01bb04
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
7 years agofixing paths of resources to prevent ERROR message in test report 11/39811/1
Jamo Luhrsen [Fri, 3 Jun 2016 00:05:02 +0000 (17:05 -0700)]
fixing paths of resources to prevent ERROR message in test report

Change-Id: Ic31ff4fd7ca746e8b5295d1e7b6c9508a3999da7
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
7 years agoAdd a fix to update java version for VTN Coordinator Boron 85/39685/1
Karthik.S [Wed, 1 Jun 2016 12:28:14 +0000 (17:58 +0530)]
Add a fix to update java version for VTN Coordinator Boron

* Enabled VTN coordinator for Boron, test are failing due to java version.
  So, added a line in VtnCoKeyword.robot file to update java-1.8.0-openjdk-devel

Change-Id: I43c069460f852d33369fbe874ad65e65e8a97103
Signed-off-by: Karthik.S <siva-karthik@hcl.com>
7 years agoSort OpenFlow Cluster Test Plan 81/39681/1
Luis Gomez [Wed, 1 Jun 2016 03:38:04 +0000 (20:38 -0700)]
Sort OpenFlow Cluster Test Plan

Change-Id: If5a3bae0baf20c2b57ccce48490fc37e75418c1b
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
7 years agoAkka 1node: Add WUKS to data verification 36/39636/2
Vratko Polak [Tue, 31 May 2016 10:04:41 +0000 (12:04 +0200)]
Akka 1node: Add WUKS to data verification

This is to allow -all- jobs to get out of status 503.

Change-Id: Ice1695d9f70d2cb249d3f86372e5e7947af5349a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
7 years agoStabilize aaa test 47/39547/4
Luis Gomez [Fri, 27 May 2016 22:06:27 +0000 (15:06 -0700)]
Stabilize aaa test

- Add test case known bug.
- add retry in next test case.

Change-Id: Ia58da2fd6e6b90c13ab8ffd0d1bbe7dcedd4570e
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
7 years agoStabilize l2switch test: Remove unstable Loop remover test 46/39546/1
Luis Gomez [Fri, 27 May 2016 21:35:17 +0000 (14:35 -0700)]
Stabilize l2switch test: Remove unstable Loop remover test

Loop remover feature remove port test fails sporadically in CI.
This failure is not reproducible outside CI so it looks like an env issue.

Change-Id: Iedb13b8ae1534ef1576f02a4c8ee731cf25b3b44
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
7 years agoTo Fixed The Failure Scenarios for Southbound_Cluster. 58/39458/2
Poornachandrarao [Thu, 26 May 2016 15:43:56 +0000 (11:43 -0400)]
To Fixed The Failure Scenarios for Southbound_Cluster.

Change-Id: Iaed86ed075a3a8aa56923db951e09a16b788059e
Signed-off-by: Poornachandrarao <poornachandrarao.b@hcl.com>
7 years agoInitial ocpplugin system test. 59/38959/6
jason [Tue, 17 May 2016 08:33:42 +0000 (16:33 +0800)]
Initial ocpplugin system test.

Change-Id: Ie2fdb0c68da9a0c5e49b77221fb82c818af00098
Signed-off-by: jason <jason.cw.yuan@foxconn.com>
7 years agoImprove variable names and comments in akka upgrade suite 72/39472/2
Vratko Polak [Thu, 26 May 2016 09:53:23 +0000 (11:53 +0200)]
Improve variable names and comments in akka upgrade suite

Change-Id: Id4fb4f5fba7c2317b190289babe67f486c9bb720
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
7 years agoRemove tempest from ovsdb 37/39437/3
Sam Hague [Wed, 25 May 2016 18:40:10 +0000 (14:40 -0400)]
Remove tempest from ovsdb

Change-Id: I03787bd6887818f6eb89f0b93ff54f47fc049de5
Signed-off-by: Sam Hague <shague@redhat.com>
7 years agomove netvirt clustering to netvirt 35/39435/3
Sam Hague [Wed, 25 May 2016 18:36:22 +0000 (14:36 -0400)]
move netvirt clustering to netvirt

Change-Id: Icbe1aafdc7a48f627cf84a01a262c4abef6455c6
Signed-off-by: Sam Hague <shague@redhat.com>
7 years agomove openstack to netvirt 34/39434/5
Sam Hague [Wed, 25 May 2016 18:33:57 +0000 (14:33 -0400)]
move openstack to netvirt

Change-Id: Ic66a3bf26653868d16ab75dafb2fdbb61b71682b
Signed-off-by: Sam Hague <shague@redhat.com>
7 years agomove devstack tempest to netvirt 33/39433/3
Sam Hague [Wed, 25 May 2016 18:25:24 +0000 (14:25 -0400)]
move devstack tempest to netvirt

Change-Id: I33cfa33ba441e5071cb1c40257d9b0d4f4ddecb0
Signed-off-by: Sam Hague <shague@redhat.com>
7 years agoAdd suite for akka persistence when upgrading ODL 50/37150/40
Vratko Polak [Mon, 23 May 2016 17:21:14 +0000 (19:21 +0200)]
Add suite for akka persistence when upgrading ODL

+ Add a testplan file.
+ Include a utility for rapid PATCH requests for replacing cars.
+ Change ClusterManagement to work with single node
+ Change ClusterManagement to support alternative installation directories.
+ SSHKeywords.Execute_Command_Passes is now much more customizable.
+ SSHKeywords.Execute_Command_Should_Pass as its wrapper with different defaults.

Change-Id: If4f6751a16534295eed9662015f06d5f4287308b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
7 years agoAdd CSIT for VTN Manager flowfilter functionality 93/39093/3
Karthik.S [Thu, 19 May 2016 12:55:59 +0000 (18:25 +0530)]
Add CSIT for VTN Manager flowfilter functionality

* Added vlan test cases for vbrif flowfilter keytype to verify vlan-pcp
  in flowentry installed.
* Added new function "Add a vlan portmap" in VtnMaKeyword library file.
* Added new test file 010__vtn_vbridge_interface_vlanmap.robot for OF10
  and OF13.

Change-Id: If91f821a8337de1a2c8f0c07752a20ae0a570211
Signed-off-by: Karthik.S <siva-karthik@hcl.com>
7 years agoFix print statements for pep8 49/39349/2
Thanh Ha [Tue, 24 May 2016 13:24:51 +0000 (09:24 -0400)]
Fix print statements for pep8

"print (" -> "print(" to remove space between print function and
parenthesis.

Change-Id: Idab18bed943ab9f4f4896cedb99d219ad893e939
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoEnable tempest tests for netvirt 43/39343/2
Sam Hague [Tue, 24 May 2016 12:41:38 +0000 (08:41 -0400)]
Enable tempest tests for netvirt

Change-Id: I20a624a2dae1d0d38c1e68e42ef1ec1dc9943af0
Signed-off-by: Sam Hague <shague@redhat.com>
7 years agoFix spurious failures on small BGP batches 15/39315/3
Jozef Behran [Tue, 24 May 2016 09:32:43 +0000 (11:32 +0200)]
Fix spurious failures on small BGP batches

The suites manypeers_changecount.robot and
manypeers_prefixcount.robot are failing if too small amount
of prefixes is being specified because the timeout
calculations are not taking static overhead into account.
This static overhead is too high for small amounts of
prefixes, leading to spurious failures due to a timeout.

Change-Id: Ib46f4dc099bb1c55d95422f6ecee4ee8b8e45bf3
Signed-off-by: Jozef Behran <jbehran@cisco.com>
7 years agoTidied new and updated suites 72/39172/2
Jozef Behran [Fri, 20 May 2016 11:29:49 +0000 (13:29 +0200)]
Tidied new and updated suites

Change-Id: I28164bd4bbe73cee68c02c487a955de5bbc46479
Signed-off-by: Jozef Behran <jbehran@cisco.com>
7 years agoadding de-configuration part 94/38994/2
Peter Gubka [Tue, 17 May 2016 17:04:30 +0000 (19:04 +0200)]
adding de-configuration part

Change-Id: I3b428045dced84bd14197acd48c65e70b94692dc
Signed-off-by: Peter Gubka <pgubka@cisco.com>
7 years agoFix CSIT Tests as per the recent changes in Keywords 64/38964/8
priya.ramasubbu [Tue, 17 May 2016 15:13:58 +0000 (20:43 +0530)]
Fix CSIT Tests as per the recent changes in Keywords

  * Fix the Openstack Tests
  * Fixed the  tests added to Tempest suite as well
  * Removed the Ping All as it is not necessary now

Change-Id: I11c56586f11d29c5ebaa94686b86a01f02b5a920
Signed-off-by: priya.ramasubbu <priya.ramasubbu@hcl.com>
7 years agoBGP 10 peers: Lower scale in order to fit in memory. 71/38971/1
Vratko Polak [Tue, 17 May 2016 13:26:55 +0000 (15:26 +0200)]
BGP 10 peers: Lower scale in order to fit in memory.

With Route Reflector client peers, all data sent to them
is is AdjRibsOut, which contains copies for each peer.
That means there was 9M more prefixes stored in datastore,
which is too much for the heap to handle.

This sets scale to 100k prefixes, which should fit in memory safely;
unless there is large amount of transient data during processing.

Change-Id: I11c1a3d4fa966aee56145949520918c4307d8335
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
7 years agoMore readable log message for ExecuteCommandOnRemoteSystem 67/38967/1
Jozef Behran [Tue, 17 May 2016 12:26:50 +0000 (14:26 +0200)]
More readable log message for ExecuteCommandOnRemoteSystem

The original logging command produced a message like
"Attempting to execute sudo /sbin/iptables -I OUTPUT -p all
--source 10.30.32.162 --destination 10.30.32.204 -j DROP on
10.30.32.162 by jenkins with any and >" which is pretty
confusing as it is not clear what part is the command to be
execute, what part is the remote system to be executed and
so on.

The new format is something like 'Attempting to execute
command "sudo /sbin/iptables -I OUTPUT -p all --source
10.30.32.162 --destination 10.30.32.204 -j DROP" on remote
system "10.30.32.162" by user "jenkins" with keyfile "any"
and prompt ">"' which is far more readable as now the
message described each of the items it contains and also
uses quotes to make it explicit where the items start and
end in the message.

Change-Id: I886059bd7bae6ebde866977a49b4bf6eb63354d1
Signed-off-by: Jozef Behran <jbehran@cisco.com>
7 years ago3node Tests for the Openstack Integration 53/38053/48
priya.ramasubbu [Mon, 25 Apr 2016 15:47:31 +0000 (21:17 +0530)]
3node Tests for the Openstack Integration

     * Add failover test cases for L2/L3
     * Fixed some Keywords which were causing socket closed
     * Add dumpflows and other debugs
     * Verify created and deleted routers with northbound calls

Change-Id: I1ab0f88e322e44ca9928d7feea33b732599168bc
Signed-off-by: priya.ramasubbu <priya.ramasubbu@hcl.com>
7 years agoAdd sleep 1 to prevent mininet packet storms in l2switch test 23/38823/2
Luis Gomez [Thu, 12 May 2016 19:50:15 +0000 (12:50 -0700)]
Add sleep 1 to prevent mininet packet storms in l2switch test

Forgot to add packet-storm prevent sleep in 2 test cases.

Change-Id: I86ed4fa4fa1d19f5c63606d9463b29bbd516700b
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
7 years agoentity ownership tests using ofp 53/37253/37
Peter Gubka [Thu, 7 Apr 2016 12:15:57 +0000 (14:15 +0200)]
entity ownership tests using ofp

Change-Id: I5ec48364df3b15895178ce00b553f649ae1acabc
Signed-off-by: Peter Gubka <pgubka@cisco.com>
7 years agoBGP 3-node clustering performance 17/32817/54
Radovan Sajben [Fri, 15 Jan 2016 12:07:22 +0000 (13:07 +0100)]
BGP 3-node clustering performance

- 1M prefix scaling & performance test suite

Change-Id: I2aeb28873a830d1e8565e9141f1331d7f71387b8
Signed-off-by: Radovan Sajben <rsajben@cisco.com>
Signed-off-by: Peter Gubka <pgubka@cisco.com>
7 years agoAdd new CSIT test cases in VTN Manager 03/38503/5
Karthik.S [Fri, 6 May 2016 15:15:08 +0000 (20:45 +0530)]
Add new CSIT test cases in VTN Manager

   * Added new testcase to test and verify vlanpcp with flowfilter functionality.
   * Added test cases in 010__vtn_vlanmap.robot in VTN_Mgr_OF10 and VTN_Mgr_OF13
   * Added verification output in VtnMaKeywords.robot library file.

Change-Id: Ie28fc3f59cdd50329985afef082024d54bcac1bc
Signed-off-by: Karthik.S <siva-karthik@hcl.com>
7 years agoupdating flowspec suite to accept path-id 0 in json response 20/38620/1
Peter Gubka [Tue, 10 May 2016 09:48:00 +0000 (11:48 +0200)]
updating flowspec suite to accept path-id 0 in json response

suite must defferentiate between boron and beryllium because
the beryllium one miss this field

Change-Id: If26cd1b9a6b0bc5ca39ee1b7800006056d93e220
Signed-off-by: Peter Gubka <pgubka@cisco.com>
7 years agoFix car-people performance test 53/38553/2
Luis Gomez [Mon, 9 May 2016 00:07:42 +0000 (17:07 -0700)]
Fix car-people performance test

Modify python script to register people rpc.
Add WUKS for Purchase verify.
Remove Netconf check.

Change-Id: I7e3408999e4a97895d658a531cb06a640cc6ec0e
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
7 years agoFix SFC tests for service chains, sched types and paths 72/38572/2
Miguel Angel Munoz Gonzalez [Mon, 9 May 2016 12:43:47 +0000 (14:43 +0200)]
Fix SFC tests for service chains, sched types and paths

Proper selection of variables has to be done according to each release.
There are specific directories containing different variables per release.

Some other minor fixes to reflect changes in the model have been included.

Change-Id: Ie2813a7ea2ebda720364c21789820f9ecd5c5ee0
Signed-off-by: Miguel Angel Munoz Gonzalez <miguel.angel.munoz.gonzalez@ericsson.com>
7 years agol2switch suite stabilization 14/38214/5
Luis Gomez [Fri, 29 Apr 2016 02:21:59 +0000 (19:21 -0700)]
l2switch suite stabilization

Add 1 sec sleep to avoid packet storm in the loop test.
Remove bad checking in loop test, a port down can show discard.
Add WUKS for all ping tests.

Change-Id: I5879bb2a89a9cee0cd38d61ba1263c45d7e5b1cf
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
7 years agoFix version dir variables for service nodes and SFFs suites 18/38518/2
Miguel Angel Munoz Gonzalez [Fri, 6 May 2016 15:39:48 +0000 (17:39 +0200)]
Fix version dir variables for service nodes and SFFs suites

Service Nodes and Service Function Forwarders test
are using wrong references to directories. They should
include the name of the release they refer to.

Aside, there are minor checks wrong, based on old models.

Change-Id: If04e8b5d1e050471f0b4385d3679fb23eccc594b
Signed-off-by: Miguel Angel Munoz Gonzalez <miguel.angel.munoz.gonzalez@ericsson.com>
8 years agoFix test cases variables for 'Rendered Service Path' test suite 56/38356/5
Miguel Angel Munoz Gonzalez [Tue, 3 May 2016 10:16:00 +0000 (12:16 +0200)]
Fix test cases variables for 'Rendered Service Path' test suite

Variables used in mentioned robot test suite should be properly initialized according to version.

There are also some minor fixes on several values used to check results, such as json paths and service funcion names

Change-Id: Ie4c49e31d258c5ed82c1368b15e26d3edd2f478e
Signed-off-by: Miguel Angel Munoz Gonzalez <miguel.angel.munoz.gonzalez@ericsson.com>
8 years agoFix for VTN Manager CSIT Job Failures 93/38493/2
Karthik.S [Fri, 6 May 2016 12:57:57 +0000 (18:27 +0530)]
Fix for VTN Manager CSIT Job Failures

   * Temporory fix to install vlan package in Mininet
   * Will be reverted once the Infra moves to Private Cloud

Change-Id: I881c00522c2f5a6da499926c6dd317ef57ec6f09
Signed-off-by: Karthik.S <siva-karthik@hcl.com>
8 years agoAdd clustered CRUD with outages 35/37335/38
Jozef Behran [Fri, 8 Apr 2016 13:11:43 +0000 (15:11 +0200)]
Add clustered CRUD with outages

This test suite focuses on the outages.

Change-Id: I0ccc563d596559d1f2478c195325c9001dbc274a
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoImprovements in Peter's flow scripts 52/38352/6
Luis Gomez [Wed, 4 May 2016 00:20:23 +0000 (17:20 -0700)]
Improvements in Peter's flow scripts

Add support for multiple fpr in onos script.
Add new script for odl test.

Change-Id: I477e0441a4a6a66fcbf747c6d463ed6f0494575c
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
Signed-off-by: Peter Gubka <pgubka@cisco.com>
8 years agoAdd CSIT for VTN Manager flowfilter OUT direction 52/38052/6
Karthik.S [Mon, 25 Apr 2016 15:25:01 +0000 (20:55 +0530)]
Add CSIT for VTN Manager flowfilter OUT direction

 * Added new test files 010__vtn_manager_flowfilter_out.robot for OF10 and OF13
    for direction "OUT" of flowfilter functionalities.
 * Added test cases for dscp, inet src and inet dst attributes

Change-Id: Ib51e76a26393f63096da8b646e0e397c5154c92d
Signed-off-by: Karthik.S <siva-karthik@hcl.com>
8 years agoLISP: Fix plots to show all graphs 66/38366/2
Lorand Jakab [Wed, 4 May 2016 11:12:39 +0000 (14:12 +0300)]
LISP: Fix plots to show all graphs

The CSV file contained two columns with identical headings, so only the
last one showed up in the plots.

Change-Id: I9c796a216907bf2be62c4845db44815f4bc2ffd5
Signed-off-by: Lorand Jakab <lojakab@cisco.com>
8 years agoBug 5245 Fix - Inconsistent behaviour for sudo ovs-vsctl show 02/37802/4
priya.ramasubbu [Tue, 19 Apr 2016 16:58:39 +0000 (22:28 +0530)]
Bug 5245 Fix - Inconsistent behaviour for sudo ovs-vsctl show

Change-Id: I8e1fc782c9ac2a68fb4ab08d5aba73b5eb8edc67
Signed-off-by: priya.ramasubbu <priya.ramasubbu@hcl.com>
8 years agoTidy new and updated Robot files 30/38330/2
Jozef Behran [Tue, 3 May 2016 12:46:41 +0000 (14:46 +0200)]
Tidy new and updated Robot files

Change-Id: I22639a5fdf68779405d29dc8ac89e93939082acd
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoBGP: Increase data change counter readiness timeout 05/37805/4
Vratko Polak [Tue, 19 Apr 2016 16:45:46 +0000 (18:45 +0200)]
BGP: Increase data change counter readiness timeout

In -all- jobs, it may take around 90 seconds after ipv4 topology is ready
till 50-topology-data-change-counter.xml is applied.

This Change increases the timeout from 60 seconds to 180 seconds.

Change-Id: I5e8915a08c6f99b7f89235309628b3f51d5abee8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 years agoLISP: Add authenticated MReg perf test 24/38024/2
Lorand Jakab [Fri, 22 Apr 2016 14:28:02 +0000 (17:28 +0300)]
LISP: Add authenticated MReg perf test

In addition to the unauthenticated Map-Register test, add an
authenticated Map-Register test, which is a more real-world scenario,
and it also shows if authentication has a significant impact on
performance.

While at it, do some refactoring to make the code more readable and
reusable.

Change-Id: I9cc9cdcd0ca0ae6777fea66a3686997f5dca07bc
Signed-off-by: Lorand Jakab <lojakab@cisco.com>
8 years agoAdd link to bug 5832 07/38307/2
Jozef Behran [Tue, 3 May 2016 08:37:22 +0000 (10:37 +0200)]
Add link to bug 5832

Change-Id: I639397f049f4085131746bec82dedf6042c44953
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoConvert netconf readiness suite to the new bug link reporting 06/38306/1
Jozef Behran [Tue, 3 May 2016 08:28:47 +0000 (10:28 +0200)]
Convert netconf readiness suite to the new bug link reporting

The netconf readiness suite now uses the "Show Bugs If Test
Failed" keyword from SetupUtils to report bugs found  The
reason for this change is that the suite started to find
more bugs and the SetupUtils keyword has support for this
increased bug variety (one test case can encounter different
bugs at different test runs).

Change-Id: Ifc624a0dcaf28d862c478f84348a3c38b4c2e0b0
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoFix active SSH connection restoration 20/37820/3
Jozef Behran [Tue, 19 Apr 2016 14:33:59 +0000 (16:33 +0200)]
Fix active SSH connection restoration

Use a keyword teardown instead of a plain command to restore
the active SSH connection state. This prevents these keywords
from clobbering the active SSH connection when one of the
SSH commands fails.

Change-Id: I8001a4e4242df24c267e003dcdf7f24e7d6b4728
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoMake ClusterManagement keywords preserve active SSH connection 93/37793/5
Jozef Behran [Tue, 19 Apr 2016 10:19:30 +0000 (12:19 +0200)]
Make ClusterManagement keywords preserve active SSH connection

The question in the documentation of ClusterManagement was
answered as "yes otherwise these keywords will need
boilerplate code around it to be used properly". Especially
when the fix itself turns out to be a two-liner.

Change-Id: I2b70d0a3147ee5aa2205fbd08eb363262c608d1c
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoTidied new and updated suites 36/38136/2
Jozef Behran [Wed, 27 Apr 2016 12:43:55 +0000 (14:43 +0200)]
Tidied new and updated suites

Change-Id: I08a2702e5455ab85d744c1c540f51c0820df56af
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoUpdated the versions of TSDR tools to use the new versions 66/38166/6
Chaudhry Usama [Wed, 27 Apr 2016 17:52:05 +0000 (10:52 -0700)]
Updated the versions of TSDR tools to use the new versions

Change-Id: I67f4722b84d691a03965f3619ae77151a4a9da27
Signed-off-by: Chaudhry Usama <chaudhryusama@gmail.com>
8 years agoUse proper variable dirs according to each release 34/38034/3
Miguel Angel Munoz Gonzalez [Fri, 22 Apr 2016 18:18:38 +0000 (20:18 +0200)]
Use proper variable dirs according to each release

Different releases should use different robot variables for test cases
Suite setup should initialize correctly this variables with a proper procedure

Note also that some checkpoints were using incorrect tags to validate tests.

Change-Id: Ie4df39a474781d56a0eaa9821ef2d82cd8cb24b5
Signed-off-by: Miguel Angel Munoz Gonzalez <miguel.angel.munoz.gonzalez@ericsson.com>
8 years agoFix for VTN Coordinator CSIT Failures 13/38213/5
gvrangan [Fri, 29 Apr 2016 00:25:41 +0000 (00:25 +0000)]
Fix for VTN Coordinator CSIT Failures

The failure is due to recent version of postgresql93-odbc package.
This patch reverts to the earlier version of the package. We will analyze
the behavior with the latest version from now.

Change-Id: I37bb9fc3957dfb474f57149a96f59db13e12f411
Signed-off-by: gvrangan <venkatrangang@hcl.com>
8 years agotopoprocessing - fix for bug 5448 68/37168/5
Michal [Tue, 5 Apr 2016 13:49:57 +0000 (15:49 +0200)]
topoprocessing - fix for bug 5448

Change-Id: I95574e11c6fc27281c9186d9bcd305b7fcf4a47d
Signed-off-by: Michal Vrsansky <michal.vrsansky@pantheon.sk>
8 years agoFix controller cluster test 91/38091/16
Luis Gomez [Tue, 26 Apr 2016 03:15:11 +0000 (20:15 -0700)]
Fix controller cluster test

Fix typo, start id should be 1.
Add Verify (time) before killing instance.
Refactor BuyCar (routed RPC) test: do not stop people register instance.

Change-Id: I9cd66c7a95b149c4db7d2e74b0cb7d77f0fa5caf
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
8 years agoremove response body from json template used for POST 25/38125/2
Jamo Luhrsen [Tue, 26 Apr 2016 20:41:38 +0000 (13:41 -0700)]
remove response body from json template used for POST

- this was not a problem until recently, although it shouldn't
have ever been there.  Looks like the new requestsLibrary version
that came on 4/21 now uses this invalid data in it's POST which
ODL rightly rejects

Change-Id: If9bd6820a9f4345980b100e9bb1da6d102ef63f5
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
8 years agowrite tempest output to file to use as job artifact 90/38090/3
Jamo Luhrsen [Tue, 26 Apr 2016 00:58:21 +0000 (17:58 -0700)]
write tempest output to file to use as job artifact

Change-Id: Ifc350f89af870ed7c730616c5963ea50dc04763d
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
8 years agouse yang+json headers for vtn REST sessions 88/38088/1
Jamo Luhrsen [Tue, 26 Apr 2016 00:31:02 +0000 (17:31 -0700)]
use yang+json headers for vtn REST sessions

Change-Id: Ie9105de1ae64b1fb2d2e49683da6dc10dfc03bbc
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
8 years agoConnectivity Tests for the Openstack Jobs 48/37848/21
gvrangan [Tue, 19 Apr 2016 23:58:16 +0000 (23:58 +0000)]
Connectivity Tests for the Openstack Jobs

* Simple Connectivity Tests for netvirt 1-node and 3-node
* simple connectivity test for VTN

Change-Id: I4e1cd76fb51955b740b3c4d809b357448ba450f7
Signed-off-by: gvrangan <venkatrangang@hcl.com>
8 years agoUpdated SXP CSIT with new feature PeerSequence filter, 87/37787/6
Martin Mihálek [Tue, 19 Apr 2016 08:16:04 +0000 (10:16 +0200)]
Updated SXP CSIT with new feature PeerSequence filter,
added Berrilium test plan which skips test with this feature.
Changed position of Topology setup in filtering tests,
to cover more scenarios.

Change-Id: I378e14c17023a32e7da6cc10d0374161c25c072d
Signed-off-by: Martin Mihálek <mamihale@cisco.com>
8 years agoTell GetControllerSyncStatus to not spit out warnings 85/37985/1
Jozef Behran [Thu, 21 Apr 2016 16:48:16 +0000 (18:48 +0200)]
Tell GetControllerSyncStatus to not spit out warnings

The GetControllerSyncStatus keyword generates a lot of noise
warnings when used on a controller that is down. Tell it to
stop that behavior.

Change-Id: I950fa148cad9f88a5cb46841087eb7db356ccc9f
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoFix for VTN CSIT Job Failures 36/37636/5
gvrangan [Thu, 14 Apr 2016 22:46:36 +0000 (22:46 +0000)]
Fix for VTN CSIT Job Failures

* Temporory fix to install vlan package in Mininet
* Will be reverted once the Infra moves to Private Cloud

Change-Id: Ie1d46d92f0bd3566bf21f19949712e5d8bbbc308
Signed-off-by: gvrangan <venkatrangang@hcl.com>
8 years agouse 4.2 for beryllium snapshot release in networking-odl tempest test 45/37845/2
Jamo Luhrsen [Tue, 19 Apr 2016 22:43:39 +0000 (15:43 -0700)]
use 4.2 for beryllium snapshot release in networking-odl tempest test

Change-Id: I470aae30455182cc31ede8756958d5adab503acb
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
8 years agoOpenstack Verify Connectivity from instances 55/37255/10
priya.ramasubbu [Thu, 7 Apr 2016 17:44:48 +0000 (23:14 +0530)]
Openstack Verify Connectivity from instances

    * Ping from dhcp NS to instance
    * Ping from instance to instance
    * Ping from instance to dhcp server
    * Ping from instance to metadata server

Change-Id: Ia725a1f9d1159df9db50f791e5c7b9ae1276f93a
Signed-off-by: priya.ramasubbu <priya.ramasubbu@hcl.com>
8 years agoSet car-people shards in scriptplan so they can be deployed per job 55/37755/5
Luis [Mon, 18 Apr 2016 21:23:29 +0000 (14:23 -0700)]
Set car-people shards in scriptplan so they can be deployed per job

Change-Id: I7f86804c13193240badc676fbc473d6b4a59d93a
Signed-off-by: Luis <ecelgp@gmail.com>
8 years agoAdd suite setup for TCP and UDP suite tests 20/35120/7
victorxu [Fri, 19 Feb 2016 22:53:31 +0000 (14:53 -0800)]
Add suite setup for TCP and UDP suite tests

1. Need to move suite setup (download usc test tools) from root folder USC to subfolders TCP and Udp
2. Replace static callhome IP with ${ODL_SYSTEM_IP}
3. Add csit/testplans/usc-tcp.txt
4. Change the keyword to download USC Tools

Change-Id: I5b8b195f5274eb48d434351ce5f7657868e0091e
Signed-off-by: victorxu <s.xu@huawei.com>
8 years agoAdd clustering performance test suite 71/37171/15
Jozef Behran [Wed, 6 Apr 2016 08:09:11 +0000 (10:09 +0200)]
Add clustering performance test suite

This is a suite which deploys a device and puts some data
into it and then issues requests to update the data. The
difference is that the device is configured and the data
is added using one node and the data modification requests
are issued on another node of the cluster, forcing the
cluster to do clustering communication.

Change-Id: I902d2b9aa924de7e1f9fd891600387f769b91013
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoAdd convenience keywords to ClusterManagement 70/37470/6
Jozef Behran [Tue, 12 Apr 2016 08:08:07 +0000 (10:08 +0200)]
Add convenience keywords to ClusterManagement

The convenience keywords allow starting or stopping a cluster
node using just one line. A few test suites were updated to
utilize the new keywords.

Change-Id: Id6b457e1f649ff979e868d723d5527f3e425a073
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoLISP: Add xTR-ID support in Map-Register perf tests 75/37675/2
Lorand Jakab [Fri, 15 Apr 2016 14:53:33 +0000 (17:53 +0300)]
LISP: Add xTR-ID support in Map-Register perf tests

Change-Id: I5d7573e83f8abc5d2cbdbc722417f68d5784d86d
Signed-off-by: Lorand Jakab <lojakab@cisco.com>
8 years agoadd ability to poll on Operational store. 42/37642/3
Jamo Luhrsen [Fri, 15 Apr 2016 06:40:53 +0000 (23:40 -0700)]
add ability to poll on Operational store.

default still remains Config store, but "-d Operational"
will change to poll on the Operational store.

Change-Id: I384104473db384577452fdeafc7c764d329cd6b8
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
8 years agoFix spurious warnings after a peer is killed 96/37496/7
Jozef Behran [Tue, 12 Apr 2016 18:30:47 +0000 (20:30 +0200)]
Fix spurious warnings after a peer is killed

When a peer is killed and is later restarted, then any
attempt to query anything from it using restconf will lead
to a bunch of warnings about a dead connection. After digging
in the RequestsLibrary source I realized that the proper cure
is to tell the RequestsLibrary.Create_Session to not make any
retries if the first connection attempt fails.

Change-Id: Ic0586a280d2d9bda675771182f66374c4c6cd982
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoAdded test suites for cluster HA data recovery leader follower failover 02/37502/2
Sanjib Mohapatra [Tue, 12 Apr 2016 15:16:32 +0000 (20:46 +0530)]
Added test suites for cluster HA data recovery leader follower failover

    Description: In a 3 node cluster initial inventory shard status is
    verified and following tests are performed.

    - Mininet switch is connected to a follower node and flow is added via
      another follower node. Disconnect the switch and restarts the Leader.
      Connect the switch again once Cluster is formed and verify flow is
      installed in the switch again

    - Disconnect the switch and restarts one of the follower node. Connect
      the switch and verify the flow is installed in the switch again.

    - Disconnect the switch and restarts the Cluster. Connect the switch
      again when Cluster is formed and verify the flow is installed
      successfully.

Change-Id: Ibd01664bc355a41bc95794930b1e40f3468ce858
Signed-off-by: Sanjib Mohapatra <sanjib.mohapatra@ericsson.com>
8 years agoReplaced NetconfViaRestconf.robot with TemplatedRequests.robot 79/37279/7
Jozef Behran [Thu, 7 Apr 2016 13:49:20 +0000 (15:49 +0200)]
Replaced NetconfViaRestconf.robot with TemplatedRequests.robot

NetconfViaRestconf.robot is not compatible with
ClusterManagement.robot and is obsoleted by
TemplatedRequests.robot. The incompatibility problem prevents
easy construction of test suites testing scenarios with node
outages so this outdated piece of code had to be replaced
with the newer (and compatible) piece of code. The change is
quite involved because TemplatedRequests.robot has quite
different API.

Change-Id: Iaa791eab06d1eaaf4d1904f248c57f67a30afc61
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoTidied updated test suites 83/37483/2
Jozef Behran [Tue, 12 Apr 2016 08:40:39 +0000 (10:40 +0200)]
Tidied updated test suites

Change-Id: I03ce220e896169f145674943e2e4f6fe430bf6da
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoTopoprocessing - test correction according to patch 36891 92/37192/2
Samuel Kontriš [Wed, 6 Apr 2016 13:45:20 +0000 (15:45 +0200)]
Topoprocessing - test correction according to patch 36891

Patch 36891 is bugfix for bug 5458

Change-Id: Id859b7afa1ee0c4cf3e502524df6d97064ecd1d1
Signed-off-by: Samuel Kontriš <samuel.kontris@pantheon.tech>
8 years agoAdd csit test cases for centinel features. 40/36940/5
Ruchita [Thu, 31 Mar 2016 09:22:29 +0000 (14:52 +0530)]
Add csit test cases for centinel features.

Change-Id: I65d4ea2efbeea3ba1aaa9d7044b4b1005675d5bc
Signed-off-by: Ruchita <ruchita.khanna@tcs.com>
8 years agoBug 5560: Fix bits ordering issue in BGP flowspec tests 96/37196/6
Vratko Polak [Fri, 8 Apr 2016 12:20:44 +0000 (14:20 +0200)]
Bug 5560: Fix bits ordering issue in BGP flowspec tests

This includes change to norm.json.py Library to optionally
perform sorting withing string values if key is present in given list.

Also, ordering and syntax inside Verify Flowspec Data is improved.

Change-Id: I12d2493233d557772f8beec6e11743a4d6941c97
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 years agoenable auth in rest calls, and fix one error message 04/37304/4
Jamo Luhrsen [Fri, 8 Apr 2016 04:29:14 +0000 (21:29 -0700)]
enable auth in rest calls, and fix one error message

Change-Id: Iddd0dfb7ec44a89c00f3f481a5576459b113077e
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
8 years agoAdd ability to use JAVA_HOME to find java 78/37278/6
Jozef Behran [Thu, 7 Apr 2016 11:22:59 +0000 (13:22 +0200)]
Add ability to use JAVA_HOME to find java

If no JDK_VERSION is specified and invoking "java" on the
commandline does not work at all ("java: command not found"),
the code uses the value of the JAVA_HOME as the root of the
JDK to be used as a last resort.

Change-Id: Ieb647003dc7fe4790b747191371ae240fec40d1b
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoFix malformed BASH command in ComposeDilemmaFilePath 70/37170/2
Jozef Behran [Tue, 5 Apr 2016 12:58:54 +0000 (14:58 +0200)]
Fix malformed BASH command in ComposeDilemmaFilePath

A misplaced ampersand caused the command to always return 0
(success), even when the path queried did not exists and the
command was thus supposed to return nonzero (a failure).

Change-Id: If59501fa7d79fc60f0f63fde02095a1c87b19e59
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoprepend ovsdb to connection-info for NB connection request 16/37216/1
Jamo Luhrsen [Wed, 6 Apr 2016 21:03:34 +0000 (14:03 -0700)]
prepend ovsdb to connection-info for NB connection request

for the case when hwvtep features are loaded along side of
ovsdb, the connection-info data is taken from the same base
model, so there is a conflict resulting in an ERROR when
trying to initiate a connection with just "connection-info".
we need to make it more specific, like "ovsdb:connection-info"

Change-Id: I5729a9c1d91507dd3dd6e2cfb8591e916aa6fa88
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>