Fix VTN Coordinator and Manager CSIT for Beryllium

  * Modify VTN Coordinator keyword file to download VTN Co distribution
  * Modify VTN Manager keyword file to fix verification of dscp actions
    for beryllium

Change-Id: I524a0ef94ac6437b4b9524b39a94860b87e5163a
Signed-off-by: Karthik.S <siva-karthik@hcl.com>

NexusKeywords: splitting commands to get downlaoded sw version

Change-Id: Id14c89991856acbc16e4db63009c3db8e23df8e6
Signed-off-by: Peter Gubka <pgubka@cisco.com>

remove Flows_OF13 as it's no longer used

Change-Id: Ide234c3085b9dd28d579949d0973b71ed856b5e5
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Test cases are added for L3VPN Network Assocition and Dissociation use cases

Change-Id: I7c4651536f3201272475f47ebcc07b6d844f00ed
Signed-off-by: smsreddy <madhu.sama@tcs.com>

Add missing comments to csit/variables/Variables.robot

Change-Id: I348dade2fd56d323388b0b3206c3a2da301b03be
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Address Start_Suite KW 1

- Move test using Start_Mininet to Start_Mininet_Single_controller.
- Once this is merged we can move test using Start_suite to
Start_Mininet and delete Start_Suite.
- Finally we can try to move Start_Mininet to
Start_Mininet_Single_controller but this change can take longer.

Change-Id: I311fa5cea75870d86b074bde751503fff7507d0e
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Push upstream reachability tests

They simply get the complete lists of neutron resources (networks,
subnets and ports). They highlight issues to reach ODL urls without
interpreting the other test results.

This is the last robot file currently hosted by OPNFV. It follows the
previous commits [1] and [2].

[1] https://git.opendaylight.org/gerrit/#/c/40948/
[2] https://git.opendaylight.org/gerrit/#/c/46749/

Change-Id: I45f69fca9fdb17eaedcebc368c58051639a0480d
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>

dsbenchmark.py: removing space after comma while creating csv file

Change-Id: Ib4c94f4fb3217d88e8f05944025a03728dbb8d54
Signed-off-by: Peter Gubka <pgubka@cisco.com>

Stabilize l2switch loop remover test

Add extra check for expected flows and remove sleep.
Remove unstable test until someone can fix this.

Change-Id: Ieb83bfddfb92118e1289c1615aea901594734207
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

source karafkeywords library from suite so karaf logging works

Change-Id: Ib2c47a5297628b7cb8ecfad6c39446faf4a8ea0a
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Avoid inactivity in dsbenchmark suite

Change-Id: I5c5317454d90816ff29b1913c2dea93a63154f2e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Improve bug 6917 reproduction

Bug 6917 can be reproduced by either:

- Adding+deleting same big flow in ~10 sec duration cycle.
- Adding multiple big flows at ~10 sec duration cycle.

Change-Id: I0b4a4796f8f65f0739f7aba9646e0ab04d2d77b2
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

fixing bgp-tcpmd5-LiBe suite after HsfJson lib removal

Change-Id: I2c97a71163ce50bb8b74ff19bd4ad922cfafdf3d
Signed-off-by: Peter Gubka <pgubka@cisco.com>

change get_field to awk command to make tests less reliant on devstack

Change-Id: I51d6417b38433f69a932ec96ec9e72391dad6cc8
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Delete VTN Lithium Tests

The Lithium jobs are not active anymore.
These tests can be removed.

Change-Id: I2de6947d560b1ae86860e0ec811c9fccf6489e55
Signed-off-by: gvrangan <venkatrangang@hcl.com>

creating Normalize_Jsons_With_Bits_And_Compare to TemplatedRequests

implementing https://trello.com/c/SavMOS52/332-int-test-create-a-new-kw-in-templatedrequests-for-comparison

Change-Id: I7ecd79b2c5e2763067d2fc3c1138e3b3b5268fe7
Signed-off-by: Peter Gubka <pgubka@cisco.com>

Fix small typo in test plan referencing sfc test suite

Reference to 080__simple_clustering.robot is not correct
and this causes failures in sfc jobs

Change-Id: I3ced14adf536c61c4cba22d4101551380b6be087
Signed-off-by: Miguel Angel Munoz Gonzalez <miguel.angel.munoz.gonzalez@ericsson.com>

add VTN_INVENTORY_NODE_API variable

a recent VTN test patch [0] introduced this new variable to Variables.py
and this will keep Variables.robot in sync with that as we are hoping
to eventually start only using Variables.robot

[0] https://git.opendaylight.org/gerrit/#/c/45617/

Change-Id: I4d051689ed4dad108a794db51090c330dea790aa
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

remove argument that is no longer needed in flow verify keyword

Change-Id: I9c1e5b9fd79067d8d30f794d2987cac1b04fe3f2
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Refactor flow service test

Adjust flows and suites for OVS 2.5
Remove redundant Flows OF13 suite
Remove CPqD group/meter suites
Add suite for reconciliation
Add suite for bug 6917
Clean up Utils.robot

Change-Id: I3a09691e8fb92986761be4dbcb96163730aa6d2c
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Add a suite for checking distribution size

Change-Id: I663497e33c6e7457d2204f3d6116f90ea25ebbda
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Add keyword to debug VTN CSIT failed test cases

Change-Id: I6d93c5df3daa996ab4df955e516ad26284e91411
Signed-off-by: Karthik.S <siva-karthik@hcl.com>

Convert suites from ODL_VERSION to CompareStream

Change-Id: I4ec6174a8890caab96de22598c1f9a6388ffc50b
Signed-off-by: lbuckuli <lbuckuli@cisco.com>

Edited suites to use norm_json.py instead of HsfJson

Change-Id: I3cf78a44420f6e7e18b90ae4c87cc352a327f334
Signed-off-by: lbuckuli <lbuckuli@cisco.com>
Signed-off-by: Shrutika Ingole <Shrutika.Ingole@pantheon.tech>

Revert "Added command to activate virtualenv for csit jobs in"

Since https://git.opendaylight.org/gerrit/#/c/46124/ was merged, this
shouldn't be necessary anymore.

This reverts commit ae9f1acf3843d0a49a69fa1f14e4d10293a0fe0d.

Change-Id: I439ec8eba3979eee5b8277bd3b5e07d4c6c04948
Signed-off-by: Lorand Jakab <lojakab@cisco.com>

Fix VTN Coordinator Boron Tests

The download URL needed to be fixed.

Change-Id: Ic7499439182e6dd77fd2162ecc969e114845fde7
Signed-off-by: gvrangan <venkatrangang@hcl.com>

ITM Testcases to Create, Delete and Get Tunnels

Change-Id: I42852903471c3d9c43aba1c435bae549a3901d85
Signed-off-by: Abbas Pareedkunju <abbas.pareedkunju@tcs.com>

Improving TemplatedRequests to support stream specific template

Change-Id: I1ceca336796924b995cda9bad1e6e6727be25993
Signed-off-by: lbuckuli <lbuckuli@cisco.com>

fixing typos in bgp evpn suite

Change-Id: I57cb6b2d1039cd687204bc0551384531dc1aa101
Signed-off-by: Peter Gubka <pgubka@cisco.com>

CompareStream correction.

Change-Id: I8bbb63b94b4c5819e56918087d98e08260c1c199
Signed-off-by: lbuckuli <lbuckuli@cisco.com>

Push upstream several robot files

These tests hosted by OPNFV functest delete all the neutron resources
created by 010__networks.robot, 020__subnets.robot and
030__ports.robot.

It completes the previous commit "Apply modifications done in OPNFV
functest project" [1]

[1] https://git.opendaylight.org/gerrit/#/c/40948/

Change-Id: I823ab95277e2110b9b5d59f31f164a6257c4c808
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>

Move KW from KarafKeywords.robot to Utils.robot

The KW is not using Karaf console.
Some suites are failing because they cannot find the KW [0]

[0] https://logs.opendaylight.org/releng/jenkins092/
openflowplugin-csit-1node-periodic-link-scalability
-daily-only-beryllium/479/archives/log.html.gz

Change-Id: Ia9d6743825d92b6a2a27f477640dcb64660397ce
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Increase installation wait times in netconf stress HA job

Change-Id: Ia2345b82f25645ab574a9009da9246296a5ba5ae
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Remove test plans for non-default OpenFlow plugin in all branches

This is to be merged after https://git.opendaylight.org/gerrit/#/c/46695/

Change-Id: I4e8898207016d86929c651445b582254ce4f19c7
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Add more memory to perf cluster test

Change-Id: I450046daef7a292b38406104c135e5bced083226
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Remove ClusterKeywords library

Nobody is using it anymore.

Change-Id: Ic2fac8b7422e64925243b65750e211f7739c4042
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Fix Openflowplugin 1 node longevity test failure

    * Refactor scalability library keyword to fix minor errors

Change-Id: I1a508aa8f5b47686687ab6c673c4a511f1103248
Signed-off-by: priya.ramasubbu <priya.ramasubbu@hcl.com>

recreating the former test suite for BE stream

the change 45165 fixed the problem for boron stream. But the Be stream
does not pay attention on the presence of mandatory arguments and the updated
test suite with 2 testcases TC1_ and TC2_ is not relevant for Be stream.
Therefor the odl test suite with just one test case is recreated for Be.

Change-Id: I59abf8404684ef3c2bc3ecb30d518a34de97d237
Signed-off-by: Peter Gubka <pgubka@cisco.com>

updating key string for entity ownership parser

the name was changed and the suites started failing

Change-Id: I9644cb300c1fb79342b8d47ab37f2e7085e93c3e
Signed-off-by: Peter Gubka <pgubka@cisco.com>

Add variable for adjusting timeout

We need this to run the suite locally.

Change-Id: I11ea9e94467508485d3a9503c23c691b8126230e
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

renaming keyword

there is a conflicting kw in TemplatedRequests

Change-Id: Iddca8211125fcb298f862c8da80863e9483f8be8
Signed-off-by: Peter Gubka <pgubka@cisco.com>

fixing bmp expected results in beryllium

Change-Id: I32bd1d06be53b22a575ac581ebff499ec186012b
Signed-off-by: Peter Gubka <pgubka@cisco.com>

Add useful links to Int/Test RTD index page

Change-Id: I60dcfffb3332fad6f65f60e7b7acd8ee36b639d2
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>

Introduce Variables.robot

- Variables.py still present.
+ All variables copied to Variables.robot
+ Added descriptions, TODOs and FIXMEs.
- Lot of FIXMEs require moving some variables to more specific Resources.

Change-Id: Id4ec41aa68fff01d637893438c914d59e54318a2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Test cases for creating and deleting multiple L3VPNs are added

Change-Id: Iabbd46049a63cf4543924f3388981f6b320224c6
Signed-off-by: Dhevendran Kulandaivel <dhevendran.k@tcs.com>

removing sorting bits for carbon stream

this change is based on https://trello.com/c/OVemHGUi/336-int-test-do-not-sort-bits-in-carbon

Change-Id: I1c47fa34f5bb9e23754b6f23bafeb4204609e739
Signed-off-by: Peter Gubka <pgubka@cisco.com>

fixing expected route key identifier

Change-Id: Iefbd5ad2d71501e232965ae13a524e66c47185b0
Signed-off-by: Peter Gubka <pgubka@cisco.com>

Remove faulty variable KARAF_HOME

Change-Id: I288d311f7792be0fd02f8133061853108b056d4f
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Input JSON value is corrected for keyword 'VPN Delete L3VPN'

Change-Id: I9e54d0e21c508902b36a10bcfa9f14d1990db432
Signed-off-by: Dhevendran Kulandaivel <dhevendran.k@tcs.com>

Test cases for L3VPN creation,association and deletion are added

Change-Id: I9ff3a1c6107036aac31c9ca0b3445b9a65a4dc6d
Signed-off-by: Dhevendran Kulandaivel <dhevendran.k@tcs.com>

new bgpclustering ha scenario with node isolation

Change-Id: I637493b266a81b5c81e6d2fbe7387831908594f8
Signed-off-by: Peter Gubka <pgubka@cisco.com>

teardown improved with linking bugs if test failed for bgp multipath suite

Change-Id: If5b309a900ac3f5aac8fd9b5fa060dd5fc4ecf1c
Signed-off-by: Peter Gubka <pgubka@cisco.com>

Docs and minor usability fixes for robot.tidy tool

Change-Id: I2d501efcf0eae35d5840d40e5dd2f0be14068675
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>

fix typo s/config/operational/ in FlowLib

Change-Id: I187425c52c88ad8b5af200e661ed4cbde51c80fe
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

In suite 1node.robot: check creation of snapshot with transferred persisted data added.

Change-Id: I15e803ff464efa360724a9939c5362762a9f7e9a
Signed-off-by: lbuckuli <lbuckuli@cisco.com>

change from set-br to set bridge and use XML header

Change-Id: Ia853a1809ba920c72c6e32db63c841842cd981dc
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Enable Bug reporting in dsbenchmark suite

Change-Id: I0f0822bea79ff1fd12aa9879bf45ce283eda4598
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

New OpenFlow REST perf test

New test to send Bulk REST request for single node and cluster.
Includes disable persistence + JVM monitoring framework.
Also modify mininet KW to account for total flows in OVS.

Change-Id: I5f57d983be61b08e6180c703473b70e203e6a5fe
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Fixed logic error occuring at certain values

When the "Wait For Getter Error Or Safe Stateful Validator
Consecutive Success" keyword receives certain arguments, it
will crash with a "Logic error" because the calculated repeat
count will be less than 1 or even 2.

WaitUtilsTest.robot: a new test case Timeout_Hits_Off_By_One_Bug added.

In WaitUtils.robot for keywords:
Wait_For_Getter_And_Safe_Stateful_Validator_Consecutive_Success,

Wait_For_Getter_Error_Or_Safe_Stateful_Validator_Consecutive_Success
changed:
: FOR    ${try}    IN RANGE    1    ${maximum_tries}+1    # If maximum_tries is 3, for will go through 1, 2, and 3.
to
: FOR    ${try}    IN RANGE    1    ${maximum_sleeps}+2    # If maximum_sleeps is 2, for will go through 1, 2, and 3.

Change-Id: Ie924cbd22dad01abf0e3ab9d06c2843abfcfda86
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Signed-off-by: lbuckuli <lbuckuli@cisco.com>

Netconf configuration stress HA suites

+ The main suite where topology Owner is rebooted.
+ Python utility for continuous device (de)configuration.
+ Additional suite where config Leader is rebooted.
+ Suite for installing feature in controlled manner
  to ensure Owner and Leader are not co-located.
+ Reset suite to undo feature installation before next suite starts.
+ Testplan.

Change-Id: I87b9b1539395011a759135f0280edb544c6a506a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Introduce ClusterManagement.List_Indices_Minus_Member

Change-Id: I4ebb62614f622760c20e7657346a062d52ca0f90
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Allow setting Karaf log levels on suite basis

+ Usage for netconf cluster entity test.

Change-Id: I34752852e9ab663beed6c9bbda72248aa18f85ce
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Set test delay to 0 by default

This applies to scalability and cbench test.

Change-Id: I53067dc93de1ab27b854b542a85fe03c4a476460
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

make flow action suite more robust

-  some systems give slightly different output to ifconfig so adding a more
   complete cleanup step from the ovsdb library.  it will stop/wipe db/start
   openvswitch which should ensure no leftovers will be there

-  when running this suite on a single vm setup where the ssh to the "mininet
   system" is only to localhost, it is happening too fast and the flows are
   not added/removed to the local ovs when it checks.  so adding a quick little
   wuks (3s/1s) to account for that.

Change-Id: I0c690c2951af7b22d0bdb1b48e89c111f07ccf90
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

add example robot suite for CSIT tutorial at 2016 ODL Summit

some very basic openflow related test cases are written and a few
more stubbed out for students to fill in.

Change-Id: Ibb89023ab8fc2b32bb496254188491a5fe50284f
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Many library improvements.

Major changes:
+ Introduced SSHKywords.Run_Keyword_Preserve_Connection.
+ Most ClusterManagement keywords should not affect active SSH connection anymore.

Minor improvements:
+ CarPeople.Set_Variables_For_Shard also sets \${${shard_name}_first_follower_index}.
+ ClusterManagement variables sorted.
+ ${KARAF_HOME} constructed in ClusterManagement.
+ ClustwerManagement.Get_Owner_And_Candidates_For_Type_And_Id added.
+ Start_Members_From_List_Or_All checks sync only once per 10 seconds.
+ Renamed Run_Command_On_* to Run_Bash_Command_On_*.
+ Introduced Run_Karaf_Command_On_*.
+ Clean_Directories_* and Install_Feature_* addd to ClusterManagement.
+ (Unsafe) With_Ssh_To_List_Or_All_Run_Keyword and Safe_* added.
+ Restore_Current_Ssh_Connection_From_Index moved from KarafKeywords to SSHKeywords.
+ Introduced KarafKeywords.Safe_Issue_Command_On_Karaf_Console.
+ SSHKeywords.Open_Connection_To_* take ${ip_address} as an optional argument.
+ Karaf EOF workaround added to SetiupUtils.Setup_Utils_For_Setup_And_Teardown.

Change-Id: Ia61abe2bdaa15f90e3042742275ddbd45b4fc72d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

variable usage improvement for KarafKeywords.robot

change based on https://trello.com/c/GRwYsMPF/294-extract-improvements-from-change-35877

Change-Id: Ib88963c69130ed3afb2110e173fb96b1a9364595
Signed-off-by: Peter Gubka <pgubka@cisco.com>

added logging for debug purposes

change done due to https://trello.com/c/GRwYsMPF/294-extract-improvements-from-change-35877

Change-Id: Id09b98f7c4c1924f92a766bfbbe62ed38b36a734
Signed-off-by: Peter Gubka <pgubka@cisco.com>

Topoprocessing - Adjust tests for blueprint on carbon

* Instead of pushing configuration XML, now push the .cfg
* Requires https://git.opendaylight.org/gerrit/#/c/44504/

Change-Id: Ieeadfbb43512526737c0f51e8a19081b667a70c1
Signed-off-by: Martin Dindoffer <martin.dindoffer@pantheon.tech>

Fixed the VPN service test case issues.
1. Fixed Get port ID Library API
2. Delete neutron port API call correction.
3. Delete Port validation string corrected.

Change-Id: Id1a3c7b2a6b7b33a754ef776762694f0a21f7c16
Signed-off-by: suvitha.balu <suvitha.balu@tcs.com>

Organize bulkomatic performance suites

Place bulkomatic perf suites in Performance_Bulkomatic folder.

Change-Id: Ia7a8c24fc4fc54e787053a0e157d728ea6a56b01
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Refactor WaitForFailure to propagate failure message

Change-Id: Ib6d80d6306a24acf4ba4c59dfc226aa379f2d937
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Added command to activate virtualenv for csit jobs in
lispflowmapping generate_bindings script.

Change-Id: I7aa353457198c0875d0375f3e57173569b8e9dbe
Signed-off-by: Ashish <ashishk.iiit@gmail.com>

SFC: make tidytool.py happy

The verify job is now broken for all contributions because of this.

Change-Id: If573a0d928b7e72c97240dba0d5bdea058cdb7ba
Signed-off-by: Lorand Jakab <lojakab@cisco.com>

Added test suites for Scaleup test in 3 node

cluster with varied number of DPNs

Description: In a 3 node cluster initial inventory shard status is
verified, logs set to error in all nodes and following tests are performed.

- Using Bulkomatic API pushed 10K flows to config datastore via
  follower node2

- Config DS write time and Config DS write rate is calculated

- Mininet flow installation write time and rate is calculated

- Oper DS write time and Oper DS write rate is calculated

- Stop Mininet and Delete the flows

- Calculate config DS delete time and rate

- Added steps to Plot graph for rate and time

- Added test plan for sandbox run

- Improve 1 node suite

Change-Id: I4dd0e7e7f6044be787d0904e7a66cb1995263099
Signed-off-by: Sanjib Mohapatra <sanjib.mohapatra@ericsson.com>
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

add entropy check to karaf logging keyword

Change-Id: Id4649c4bd4e3800e7632174a512a6c9ce0395aa4
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Merge SFC clustering test suite into SFC rest basic

To alleviate number of jenkins generated n ODLPUB,this commit merges tests from clustering
test suite into rest basic. Note the job for clustering is removed in this commit:
https://git.opendaylight.org/gerrit/#/c/45619/

Change-Id: Ibfe31f9379b9672975a02df18cf180bca951897c
Signed-off-by: Miguel Angel Munoz Gonzalez <miguel.angel.munoz.gonzalez@ericsson.com>

Make tox run also tidy check

+ Added another action "diff" to tidytool.py
+ Added "tidy" tox environment which run the action.
- Removed "docs" from envlist for now.

Change-Id: Ieaa0b9ef40ecfb60f010109893f4ee55e9c73bfb
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Add Boron perf report stub

Change-Id: I11517736517134b06ea983959a4599a1ac611a6a
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>

Tidy after recent merges

Change-Id: Ib938ba8c10dfe952001dba317b6cfde39e1888a0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Revert "upgrade tempest environment based on requirements.txt"

I think something transient was breaking us.  now with this patch the openstack services start dying.  I've tried in the sandbox without the step that this patch adds and it seems tempest is back again:

https://jenkins.opendaylight.org/sandbox/job/netvirt-vpnservice-csit-1node-openstack-mitaka-openstack-jamo-boron/1/

This reverts commit d594b5c6aed3492e09b0d3a60827837b67c88291.

Change-Id: Id80233701cc774e09993ec9f74b6fb0604308233
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

OpenFlow cluster test rework

Make all test suites branch and swith agnostic.
Change to use right entity-owner names.
Rework the Entity-Owner suite.

Change-Id: I694ad4adfe3a4afe8c84a886a6c9925008c59b56
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

ClusterManagement: improvement towards not having to copy lists

Every keyword which calls ClusterManagement__Given_Or_Internal_Index_List
now receives copied list, so removing items is safe.

Also, empty lists are not considered ${EMPTY} anymore.

Other improvements:

+ Care taken to return sorted lists.
+ Added comments about Beryllium and Boron ownership candidates.
+ Used CompareStream before list copying.

Change-Id: I6342520fe7c737a5f503b806928d0c6896e1d4da
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Move Tempest Tests behind the other tests

This solves the current problem of tempest breaking mitaka jobs.
Also, we can avoid cleanup after tempest.

Change-Id: I2a191f5523148c3c9c89aa73c6ee4712cfbc7283
Signed-off-by: gvrangan <venkatrangang@hcl.com>

Adding first system test for FaaS

Change-Id: I931a4fc3a3005af7bef61cb445a6b2ca27ce60d5
Signed-off-by: xingjun <xingjun.chu@huawei.com>

look for ofp-flow-services instead of -li plugin

Change-Id: Id6d735168cf31876d4cb1c8251380f19eecf81b0
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

upgrade tempest environment based on requirements.txt

Change-Id: Iaed3f58906de38a73bea70014c9406d6e47bc3a8
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Add mode memory for dsbenchark

Change-Id: I6db5071e2156d897ba657aac4c5c8fba3b2ee4de
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Topoprocessing - workaroud for EOFError

Change-Id: Id18bbb6320bd8a5994eac0af536ee020ea932562
Signed-off-by: Samuel Kontriš <samuel.kontris@pantheon.tech>

Adding arp table troubleshoot info to Test Operations From Vm
To eliminate arp resolution issues  in analysis

Change-Id: I76ad293ef2f7262a47fedc1df6b4ded2375ae843
Signed-off-by: Ravit Peretz <ravit.peretz@hpe.com>

Add sustain time in Scalability tests

Add Retry on Issue Karaf command

Change-Id: I963ba41353254fa1f00c213f286db220503bb517
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Adapt cluster test for Beryllium

Change-Id: If45cd2d0860810c884bc91de2ec21764012891ca
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Small adjusts in JVM metrics

Change-Id: I549f915fb461c5945269f9b7600e9973bc992508
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Fix the longevity test

Change-Id: I250e96569b7bdc216e274c109bf2798bfac6e556
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Add missing library in longevity test

Change-Id: I270a4c456653a712636d6c5242e50fea9961a8db
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Set Log level ERROR for longevity so we can track better issues

Add some time between mininet network down and network up

Change-Id: I48bc24741c35718e19d6bcbd5af57d1acb505911
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

OpenFlow cluster test stabilize 2

Remove 1 switch connection at a time in HA test.
Add Shard check in node isolation/rejoin test.
Add Check for Owner Clear in node isolation/rejoin test.

Change-Id: Ie4183a4062abdceb454268c2a581eed38a22f29c
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Add a workaroud for EOF error to netconf readiness suite

Change-Id: I73de79d9509728f6c281dd1ea4887101c4a9e9e0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Topoprocessing - fix for bug 6277

Change-Id: Ic0e921d19f658c0c0e31e25b1454235310cba6e2
Signed-off-by: Samuel Kontriš <samuel.kontris@pantheon.tech>

Adjust OpenFlow Entity Owner tests for changes in candidate behavior

Also harden the OpenFlow HA test for mininet connections.

Change-Id: I6ef91b8cbe6c4b54911b770c5a4c50233ce717bf
Signed-off-by: Luis Gomez <ecelgp@gmail.com>