Enable Bug reporting in dsbenchmark suite

Change-Id: I0f0822bea79ff1fd12aa9879bf45ce283eda4598
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

New OpenFlow REST perf test

New test to send Bulk REST request for single node and cluster.
Includes disable persistence + JVM monitoring framework.
Also modify mininet KW to account for total flows in OVS.

Change-Id: I5f57d983be61b08e6180c703473b70e203e6a5fe
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Fixed logic error occuring at certain values

When the "Wait For Getter Error Or Safe Stateful Validator
Consecutive Success" keyword receives certain arguments, it
will crash with a "Logic error" because the calculated repeat
count will be less than 1 or even 2.

WaitUtilsTest.robot: a new test case Timeout_Hits_Off_By_One_Bug added.

In WaitUtils.robot for keywords:
Wait_For_Getter_And_Safe_Stateful_Validator_Consecutive_Success,

Wait_For_Getter_Error_Or_Safe_Stateful_Validator_Consecutive_Success
changed:
: FOR    ${try}    IN RANGE    1    ${maximum_tries}+1    # If maximum_tries is 3, for will go through 1, 2, and 3.
to
: FOR    ${try}    IN RANGE    1    ${maximum_sleeps}+2    # If maximum_sleeps is 2, for will go through 1, 2, and 3.

Change-Id: Ie924cbd22dad01abf0e3ab9d06c2843abfcfda86
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Signed-off-by: lbuckuli <lbuckuli@cisco.com>

Netconf configuration stress HA suites

+ The main suite where topology Owner is rebooted.
+ Python utility for continuous device (de)configuration.
+ Additional suite where config Leader is rebooted.
+ Suite for installing feature in controlled manner
  to ensure Owner and Leader are not co-located.
+ Reset suite to undo feature installation before next suite starts.
+ Testplan.

Change-Id: I87b9b1539395011a759135f0280edb544c6a506a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Introduce ClusterManagement.List_Indices_Minus_Member

Change-Id: I4ebb62614f622760c20e7657346a062d52ca0f90
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Allow setting Karaf log levels on suite basis

+ Usage for netconf cluster entity test.

Change-Id: I34752852e9ab663beed6c9bbda72248aa18f85ce
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Set test delay to 0 by default

This applies to scalability and cbench test.

Change-Id: I53067dc93de1ab27b854b542a85fe03c4a476460
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

make flow action suite more robust

-  some systems give slightly different output to ifconfig so adding a more
   complete cleanup step from the ovsdb library.  it will stop/wipe db/start
   openvswitch which should ensure no leftovers will be there

-  when running this suite on a single vm setup where the ssh to the "mininet
   system" is only to localhost, it is happening too fast and the flows are
   not added/removed to the local ovs when it checks.  so adding a quick little
   wuks (3s/1s) to account for that.

Change-Id: I0c690c2951af7b22d0bdb1b48e89c111f07ccf90
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

add example robot suite for CSIT tutorial at 2016 ODL Summit

some very basic openflow related test cases are written and a few
more stubbed out for students to fill in.

Change-Id: Ibb89023ab8fc2b32bb496254188491a5fe50284f
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Many library improvements.

Major changes:
+ Introduced SSHKywords.Run_Keyword_Preserve_Connection.
+ Most ClusterManagement keywords should not affect active SSH connection anymore.

Minor improvements:
+ CarPeople.Set_Variables_For_Shard also sets \${${shard_name}_first_follower_index}.
+ ClusterManagement variables sorted.
+ ${KARAF_HOME} constructed in ClusterManagement.
+ ClustwerManagement.Get_Owner_And_Candidates_For_Type_And_Id added.
+ Start_Members_From_List_Or_All checks sync only once per 10 seconds.
+ Renamed Run_Command_On_* to Run_Bash_Command_On_*.
+ Introduced Run_Karaf_Command_On_*.
+ Clean_Directories_* and Install_Feature_* addd to ClusterManagement.
+ (Unsafe) With_Ssh_To_List_Or_All_Run_Keyword and Safe_* added.
+ Restore_Current_Ssh_Connection_From_Index moved from KarafKeywords to SSHKeywords.
+ Introduced KarafKeywords.Safe_Issue_Command_On_Karaf_Console.
+ SSHKeywords.Open_Connection_To_* take ${ip_address} as an optional argument.
+ Karaf EOF workaround added to SetiupUtils.Setup_Utils_For_Setup_And_Teardown.

Change-Id: Ia61abe2bdaa15f90e3042742275ddbd45b4fc72d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

variable usage improvement for KarafKeywords.robot

change based on https://trello.com/c/GRwYsMPF/294-extract-improvements-from-change-35877

Change-Id: Ib88963c69130ed3afb2110e173fb96b1a9364595
Signed-off-by: Peter Gubka <pgubka@cisco.com>

added logging for debug purposes

change done due to https://trello.com/c/GRwYsMPF/294-extract-improvements-from-change-35877

Change-Id: Id09b98f7c4c1924f92a766bfbbe62ed38b36a734
Signed-off-by: Peter Gubka <pgubka@cisco.com>

Topoprocessing - Adjust tests for blueprint on carbon

* Instead of pushing configuration XML, now push the .cfg
* Requires https://git.opendaylight.org/gerrit/#/c/44504/

Change-Id: Ieeadfbb43512526737c0f51e8a19081b667a70c1
Signed-off-by: Martin Dindoffer <martin.dindoffer@pantheon.tech>

Fixed the VPN service test case issues.
1. Fixed Get port ID Library API
2. Delete neutron port API call correction.
3. Delete Port validation string corrected.

Change-Id: Id1a3c7b2a6b7b33a754ef776762694f0a21f7c16
Signed-off-by: suvitha.balu <suvitha.balu@tcs.com>

Organize bulkomatic performance suites

Place bulkomatic perf suites in Performance_Bulkomatic folder.

Change-Id: Ia7a8c24fc4fc54e787053a0e157d728ea6a56b01
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Refactor WaitForFailure to propagate failure message

Change-Id: Ib6d80d6306a24acf4ba4c59dfc226aa379f2d937
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Added command to activate virtualenv for csit jobs in
lispflowmapping generate_bindings script.

Change-Id: I7aa353457198c0875d0375f3e57173569b8e9dbe
Signed-off-by: Ashish <ashishk.iiit@gmail.com>

SFC: make tidytool.py happy

The verify job is now broken for all contributions because of this.

Change-Id: If573a0d928b7e72c97240dba0d5bdea058cdb7ba
Signed-off-by: Lorand Jakab <lojakab@cisco.com>

Added test suites for Scaleup test in 3 node

cluster with varied number of DPNs

Description: In a 3 node cluster initial inventory shard status is
verified, logs set to error in all nodes and following tests are performed.

- Using Bulkomatic API pushed 10K flows to config datastore via
  follower node2

- Config DS write time and Config DS write rate is calculated

- Mininet flow installation write time and rate is calculated

- Oper DS write time and Oper DS write rate is calculated

- Stop Mininet and Delete the flows

- Calculate config DS delete time and rate

- Added steps to Plot graph for rate and time

- Added test plan for sandbox run

- Improve 1 node suite

Change-Id: I4dd0e7e7f6044be787d0904e7a66cb1995263099
Signed-off-by: Sanjib Mohapatra <sanjib.mohapatra@ericsson.com>
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

add entropy check to karaf logging keyword

Change-Id: Id4649c4bd4e3800e7632174a512a6c9ce0395aa4
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Merge SFC clustering test suite into SFC rest basic

To alleviate number of jenkins generated n ODLPUB,this commit merges tests from clustering
test suite into rest basic. Note the job for clustering is removed in this commit:
https://git.opendaylight.org/gerrit/#/c/45619/

Change-Id: Ibfe31f9379b9672975a02df18cf180bca951897c
Signed-off-by: Miguel Angel Munoz Gonzalez <miguel.angel.munoz.gonzalez@ericsson.com>

Make tox run also tidy check

+ Added another action "diff" to tidytool.py
+ Added "tidy" tox environment which run the action.
- Removed "docs" from envlist for now.

Change-Id: Ieaa0b9ef40ecfb60f010109893f4ee55e9c73bfb
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Add Boron perf report stub

Change-Id: I11517736517134b06ea983959a4599a1ac611a6a
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>

Tidy after recent merges

Change-Id: Ib938ba8c10dfe952001dba317b6cfde39e1888a0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Revert "upgrade tempest environment based on requirements.txt"

I think something transient was breaking us.  now with this patch the openstack services start dying.  I've tried in the sandbox without the step that this patch adds and it seems tempest is back again:

https://jenkins.opendaylight.org/sandbox/job/netvirt-vpnservice-csit-1node-openstack-mitaka-openstack-jamo-boron/1/

This reverts commit d594b5c6aed3492e09b0d3a60827837b67c88291.

Change-Id: Id80233701cc774e09993ec9f74b6fb0604308233
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

OpenFlow cluster test rework

Make all test suites branch and swith agnostic.
Change to use right entity-owner names.
Rework the Entity-Owner suite.

Change-Id: I694ad4adfe3a4afe8c84a886a6c9925008c59b56
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

ClusterManagement: improvement towards not having to copy lists

Every keyword which calls ClusterManagement__Given_Or_Internal_Index_List
now receives copied list, so removing items is safe.

Also, empty lists are not considered ${EMPTY} anymore.

Other improvements:

+ Care taken to return sorted lists.
+ Added comments about Beryllium and Boron ownership candidates.
+ Used CompareStream before list copying.

Change-Id: I6342520fe7c737a5f503b806928d0c6896e1d4da
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Move Tempest Tests behind the other tests

This solves the current problem of tempest breaking mitaka jobs.
Also, we can avoid cleanup after tempest.

Change-Id: I2a191f5523148c3c9c89aa73c6ee4712cfbc7283
Signed-off-by: gvrangan <venkatrangang@hcl.com>

Adding first system test for FaaS

Change-Id: I931a4fc3a3005af7bef61cb445a6b2ca27ce60d5
Signed-off-by: xingjun <xingjun.chu@huawei.com>

look for ofp-flow-services instead of -li plugin

Change-Id: Id6d735168cf31876d4cb1c8251380f19eecf81b0
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

upgrade tempest environment based on requirements.txt

Change-Id: Iaed3f58906de38a73bea70014c9406d6e47bc3a8
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Add mode memory for dsbenchark

Change-Id: I6db5071e2156d897ba657aac4c5c8fba3b2ee4de
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Topoprocessing - workaroud for EOFError

Change-Id: Id18bbb6320bd8a5994eac0af536ee020ea932562
Signed-off-by: Samuel Kontriš <samuel.kontris@pantheon.tech>

Adding arp table troubleshoot info to Test Operations From Vm
To eliminate arp resolution issues  in analysis

Change-Id: I76ad293ef2f7262a47fedc1df6b4ded2375ae843
Signed-off-by: Ravit Peretz <ravit.peretz@hpe.com>

Add sustain time in Scalability tests

Add Retry on Issue Karaf command

Change-Id: I963ba41353254fa1f00c213f286db220503bb517
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Adapt cluster test for Beryllium

Change-Id: If45cd2d0860810c884bc91de2ec21764012891ca
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Small adjusts in JVM metrics

Change-Id: I549f915fb461c5945269f9b7600e9973bc992508
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Fix the longevity test

Change-Id: I250e96569b7bdc216e274c109bf2798bfac6e556
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Add missing library in longevity test

Change-Id: I270a4c456653a712636d6c5242e50fea9961a8db
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Set Log level ERROR for longevity so we can track better issues

Add some time between mininet network down and network up

Change-Id: I48bc24741c35718e19d6bcbd5af57d1acb505911
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

OpenFlow cluster test stabilize 2

Remove 1 switch connection at a time in HA test.
Add Shard check in node isolation/rejoin test.
Add Check for Owner Clear in node isolation/rejoin test.

Change-Id: Ie4183a4062abdceb454268c2a581eed38a22f29c
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Add a workaroud for EOF error to netconf readiness suite

Change-Id: I73de79d9509728f6c281dd1ea4887101c4a9e9e0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Topoprocessing - fix for bug 6277

Change-Id: Ic0e921d19f658c0c0e31e25b1454235310cba6e2
Signed-off-by: Samuel Kontriš <samuel.kontris@pantheon.tech>

Adjust OpenFlow Entity Owner tests for changes in candidate behavior

Also harden the OpenFlow HA test for mininet connections.

Change-Id: I6ef91b8cbe6c4b54911b770c5a4c50233ce717bf
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Cleanup Elasticsearch indices before test

Change-Id: I9b74c2c780e535afa7ee65db8ee48f24da136f43

Change-Id: I028fbe76782f17be1b0c426ce1169bf075ce6f13
Signed-off-by: Kumar Rishabh <shailrishabh@gmail.com>

Work around new entity candidate behavior in Boron

Change-Id: Ib5c4e17da7cb58f7edfccd45085a526648243a20
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Set log ERROR for scalability test

Change-Id: Iea441bc4c1cf7db6f790cc12528129bee52e32eb
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Stabilize cbench test

In general 10 sec sleep between Cbench runs seems to stabilize.

Change-Id: Ia0be1d73f6084f5b7612d0798e93e1fce705871f
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

add neutron port-list to debug steps

Change-Id: I8b7c0454139bd88fc391086fda38da7d99c9e692
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Remove deprecated tempest tests

Change-Id: I5791ddf7a48756d6e5d6ae153eddf35c2e108d0a
Signed-off-by: Sam Hague <shague@redhat.com>

clean up networks and subnets after running tempest

Change-Id: Ia09159203a08b5ba0ce049a327382f7780deda72
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

aligned and updated the Documentation part for some of the test cases

Change-Id: Ic1d8369cdbb4d416fbe0bde6e730dc77031edbf4
Signed-off-by: vidya sathyanarayanachar <s.vidya990@gmail.com>

Adapt 404 response when delete non-existent element

Add new function "Remove All Elements at URI If Exists" inside Utils.robot
which sends a Delete REST request only if the element sent as input
parameter exists in the datastore.

Delete all calls to "Remove All Elements at URI" at the beggining of every
test case, which was used as "test case setup" and add a Robot FW Test Case
Setup calling the function "Remove All Elements at URI If Exists".

Adapt test cases verifying the deletion of a non-existent element to avoid
calling "Remove All Elements at URI". This function checks that the
result code returned is (200, 201 or 204) and since boron release a 404 is
returned if the element to be removed does not exist in the datastore.
Instead, a delete request is sent and it is checked that the result
obtained is 404 when the element is not present.

Change-Id: Icfba27e646a19aa27f1be24afc398c87b7323ebf
Signed-off-by: Jose Luis Franco Arza <jose.luis.franco.arza@ericsson.com>

trello 334 - Resource created, 050_bmp_basic.robot suite changed

Change-Id: I31fd1f789e80dd242da22d56ae764803ebcf658d
Signed-off-by: Lydia <lydia.buckuliakova@pantheon.tech>

linkstate suite update

Linkstate suite did not use mandatory arguments in update messages and
this caused bug 6373. Now the play.py script is fixed in 44261.
To be able to catch the problem from the bug the TC1_ cases are updated
to use --skipattr with play.py.
Cases TC2_ are to verify linkstate data in the advertised routes.

Change-Id: Ib53725c68595cf507c940ae4cca366b54c16ebaa
Signed-off-by: Peter Gubka <pgubka@cisco.com>

moving mandatory arguments in front of everything for update message

Change-Id: Ie7ea83927b84a0045c33a424960e7c6580b76b3a
Signed-off-by: Peter Gubka <pgubka@cisco.com>

updating bgp clustering test suite due to present bgpcep singleton impl

For Be there must remain the old suites, because they will be too
different from B and C, so differentiating the code inside robot will be
less maintainable and readable

Added configplan code is moved from builder https://git.opendaylight.org/gerrit/45206
and is valid for Be-bgp only. B and C implementations doesnt need it.

Change-Id: I0aa189af2e786abd5ff6b2064c043ef1a8ca28a5
Signed-off-by: Peter Gubka <pgubka@cisco.com>

changing peer configuration for bgp clustering ha suite

configuration via netconf connector is changed to use openconfig

Change-Id: I0961cb051743e5f103ca02f55f08b749c2905952
Signed-off-by: Peter Gubka <pgubka@cisco.com>

Add Bug report for the failing test case in VTN CSIT

* Test case failure in VTN Flowfilter verification of flows for action
  vtn-set-inet-src and vtn-set-inet-dst in OF13.
* Failure is not consistent.
* Added Report_Failure_Due_To_Bug 6643 in the failing case.

Change-Id: I5e86744d793c3ad1a85e940e1fd64654ee084811
Signed-off-by: Karthik.S <siva-karthik@hcl.com>

Fix VTN CSIT Failures with OVS 2.5

The wrong action was being searched in the flow entries.
The same has been fixed.

Change-Id: Id2584a810c810d44137c8f0aae80eb4bcc828254
Signed-off-by: gvrangan <venkatrangang@hcl.com>

list Open_vSwitch table to show local_ip

Change-Id: I5518e00f0103545b394548548d8dea97186ba4a9
Signed-off-by: Sam Hague <shague@redhat.com>

Mark bug 6595 on test failure

Change-Id: Ibca7b69c3fa12c1a8219001222b1e13094bbb6ae
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Use vm instance names for Show Debugs

Change-Id: Ia13f0dd5bcc5ef0633cecb38462e42ef0f7994c7
Signed-off-by: Sam Hague <shague@redhat.com>

add arp debug

Change-Id: I319bf2e75269ad1ea9b1a6b2ba999903e2410290
Signed-off-by: Sam Hague <shague@redhat.com>

Added Bug reference for Router failure in Failover

Change-Id: I6b0ac55df17001a470c06f7a83abdda5195fae9b
Signed-off-by: gvrangan <venkatrangang@hcl.com>

Fix openstack clustering SSHLibrary

Change-Id: I84e5d5e0d2d217e05871287506ef03a6e0e44581
Signed-off-by: Sam Hague <shague@redhat.com>

Make BGP l3vpn suite honor DEFAULT_BGPCEP_LOG_LEVEL

Change-Id: I63c95c25daab32baeacc5772f0d2a6599b0ef4c6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Changed test csit/suites/lispflowmapping/msmr/030_RPC_Datatypes.robot

Replaced static Json file variables with pyangbind generated binding files.
Removed Instance Id test.

Change-Id: I67f33b007407e94d2738c937a07c05857c076fc3
Signed-off-by: Ashish <ashishk.iiit@gmail.com>

Changed test csit/suites/lispflowmapping/msmr/020_RPC_CRUD.robot

Removed the static Json file variables and changed tests
which uses the pyangbind generated binding file.

Change-Id: I790e59bd84b4774352059da545dd4d2e8fe3104e
Signed-off-by: Ashish <ashishk.iiit@gmail.com>

Adds the generator and helper functions which uses the
pyangbind library and python bindings generated by
pyangbind plugin to generate the JSON dict for the given
type.

Change-Id: I135243aba8896f6ae203d70674294039165e12c4
Signed-off-by: Ashish <ashishk.iiit@gmail.com>

Adds support for different branches.

Extended generate_bindings.sh to pull different yang files
depending upon the branch.

Change-Id: Ia4551c4089b957d8db25176e33e3757c88341ce6
Signed-off-by: Ashish <ashishk.iiit@gmail.com>

fixing compare condition for more complicated values

such as "/odl-general-entity:entity[odl-general-entity:name='Uri [_value=example-bgp-rib]-service-group']"

Change-Id: I94cafbb533c58780008bc4f69ee3a403029311bb
Signed-off-by: Peter Gubka <pgubka@cisco.com>

Add check for link down in basic OF test

Change-Id: I1274a21d9a92a71ef833007c2b7d44cf1b42d8ee
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Stabilize OF cluster test 1

Add 1 sec before reconnect extra switches

Change-Id: I46d7c2ca63edd1d9d36d76d040c1f297b08166fe
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Adjust OpenFlow system test for singleton cluster

All cluster members are device candidates.
This applies to Li plugin in Boron and Carbon.
Avoid Controller connection bounce as this generates unstability.

Change-Id: I70bbee2d178361cfd6fc037bc2c197d45e3be13a
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Add verbose ovs logging

Change-Id: Ifaf1e537f9bdab8cfea5a95cb70651c6a41538df
Signed-off-by: Sam Hague <shague@redhat.com>
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Correct bug ID in bulkomatic test

Change-Id: I096adeea5d1d0f4cb7840a7373846fd9500e973e
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Ignore any ERROR in JVM plots

Lately I see some sporadic failure in JVM plots.
These ERRORs should not impact test suite.

Change-Id: I807e43d6f643d773cd129c4cd8912fa66afead73
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Add check to verify bug 6176

Change-Id: I55cdbc4dfc769f3410f608e5fb8fdfaa270ea193
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Add Security Rule to allow SSH and fix CSIT

Added a new custom security group called csit
Added rules in csit group to allow tcp ingress as well as egress
Split the create router as the first create fails a lot of time
bug reported: https://bugs.opendaylight.org/show_bug.cgi?id=6617

Change-Id: I1a671c5805c84ad72e4d5070cf15001688b96648
Signed-off-by: gvrangan <venkatrangang@hcl.com>

Stabilize Cbench throughput test

- Set log to ERROR
- Add start delay
- Reduce MAC #

Change-Id: If06642b56875cb0fe716d98c2be0fde094e5629a
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

quickfix for GBP clustering CSIT

Change-Id: Ie8dc42d5e2e1af762e09ef0c274033965260e307
Signed-off-by: Konstantin Blagov <kblagov@cisco.com>

remove karaf logging from test setup

this keyword was always going just to ODL1 to write to karaf log.  in these
cluster suites, sometimes ODL1 is taken down, so this causes problems.

we need a better way to handle this, so removing it from here for now because
it's breaking our test cases.

Change-Id: Ia8d75c52c2e81180dd731d37dcb703beda3431b7
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Add more logging to ovs debug

Change-Id: I40d2d674acb037f8787fa8e303a52a25b0ea2e75
Signed-off-by: Sam Hague <shague@redhat.com>
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Adding security group workaround for netvirt-vpnservice-3node-openstack

Change-Id: I92ca362ce70a02a9b17f4ae15971aee3ef073c2f
Signed-off-by: Ravit Peretz <ravit.peretz@hpe.com>

CSIT scripts for Genius project
Description:
Luis,
1.Updated the Variable.py file as per master branch.
Even Did not change single variable from Variable.py ( same as master branch)
2.Updated the review comments for following files
A.01_Interface_manager.robot
B.02_ID_manager.robot
C.03_Configure_ITM.robot
D.Itm_creation_no_vlan.json

3.Added the below scripts files
i.scriptplans/genius-genius.txt
ii.set_genius_host.sh

Change-Id:I270ecd2ab7e65f23160623b3ec9bde71c0ae144b
Signed-off-by: vidya sathyanarayanachar <s.vidya990@gmail.com>
Signed-off-by: vidya sathyanarayanachar <s.vidya990@gmail.com>

Correcting Test Teardown

Change-Id: Id958fad4d22521f2b4065b74890c6c97ee304cc4
Signed-off-by: Ernest Deák <erdeak@cisco.com>

Mark bug in OpenFlow tests

- Cbench issues in boron are related to bug.

Change-Id: I0359b36ed8d155f0756ccb7d9a2c9fadad362227
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Fix handling of 404 in Neconf notification suite

+ Added argument for Delete_* keywords of TemplatedRequests to allow 404.

Change-Id: I1f40a661be6f5681aea17c8c895dc93a10e7c043
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

loosen PUT response code expectation from 200 to 200,201,etc

Change-Id: I09021c1dc33354e53cd5deea9ca36484ff3b20cc
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>

Improve the test code

Change-Id: Ib98f93a960a7c67fcb6bc539672f522ac99e1509
Signed-off-by: Xiao Lin <linxiao9292@outlook.com>

new bgp suite to test ha

job will be https://git.opendaylight.org/gerrit/44718

Change-Id: I7cf94e23b96ae04a74a7f064030c51924594866b
Signed-off-by: Peter Gubka <pgubka@cisco.com>

Tidied up robot files

Change-Id: I30834849aa40386684ebf4789f97c6526d22c2c5
Signed-off-by: Lydia <lydia.buckuliakova@pantheon.tech>

Revert "Cleanup Elasticsearch indices before test"

This reverts commit 7358817f715ef058296841ea289b131ac3d12c87.

Change-Id: Ia7e8609464779758a690d09646e2de9686b4b530
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

Cleanup Elasticsearch indices before test

Change-Id: I9b74c2c780e535afa7ee65db8ee48f24da136f43
Signed-off-by: Kumar Rishabh <shailrishabh@gmail.com>

Fix bugs caused by return code 201 from 200

Change-Id: Icc4513c0484dea0c73d4e9bb2e123b1832bb3124
Signed-off-by: Xiao Lin <linxiao9292@outlook.com>

Add more clear variable name

Change-Id: I5f074fcdc9df2825e28c7d461830f42b20a8c0c7
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

New bulkomatic performance test single instance

- Add test to push 100K flows in 100 switches and plot flow stats
- Add KW in ClusterManagement for writing to karaf console
- Adjust bulk json to push multipe flows per transaction
- Add persistence off
- Add JVM monitoring

Change-Id: Ib6958bc1caae5a9e25048a16025120479d16b102
Signed-off-by: Luis Gomez <ecelgp@gmail.com>

log testcase starts for netvirt

Change-Id: I39257f0ffc41c2fa3e6bd42db67ad2bf5bf3cb33
Signed-off-by: Sam Hague <shague@redhat.com>

new testplans for jobs testing frs

odl-openflowplugin-app-forwardingrules-sync is an improved
odl-openflowplugin-app-forwardingrules-manager

jobs https://git.opendaylight.org/gerrit/44721

Change-Id: I3934a9fe4d2f83d46ceb8b9cbbf13be61801253e
Signed-off-by: Peter Gubka <pgubka@cisco.com>