Jozef Behran [Thu, 24 Mar 2016 09:58:46 +0000 (10:58 +0100)]
Refactor performance suites to use keyword timeouts
This removes the ugly hack with ${XXX_TIMEOUT_FOR_TEST_CASE}
global variables and test timeouts for a more elegant
solution that uses a keyword timeout instead. Requires Robot
Framework 3.0.
Change-Id: If5876cce5edccfc693a06fff5a9c8c892b2da0f2
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Thu, 24 Mar 2016 10:07:40 +0000 (11:07 +0100)]
Remove dead code that somehow survived code cleanup
Change-Id: I4fef816734be3eeb0b6ff277d7a8b458c9da359d
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Thu, 24 Mar 2016 09:54:58 +0000 (10:54 +0100)]
Add missing reference to SetupUtils
Change-Id: Ib308ea9439a77f0ac88e7ffb2998afd23a61ced1
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Wed, 23 Mar 2016 17:52:33 +0000 (18:52 +0100)]
Tidied updated resource
Change-Id: If74ebb7276a3dbda64dd2e50e488ff9aca55e213
Signed-off-by: Jozef Behran <jbehran@cisco.com>
priya.ramasubbu [Mon, 29 Feb 2016 13:13:40 +0000 (18:43 +0530)]
Single Node Odl Tempest Job Tests
* Create two networks, two subnets and router
* Verify dhcp, gateway and instance ips in the dump flow
Change-Id: I714ccaf83d52aea7a8494a0c10efc5c3a4e83a48
Signed-off-by: priya.ramasubbu <priya.ramasubbu@hcl.com>
Jozef Behran [Tue, 22 Mar 2016 09:46:23 +0000 (10:46 +0100)]
Configure timeout in RestPerfClient
Add --timeout argument setting the timeout for the
RestPerfClient threads issuing requests to the timeouts
calculated in the suites instead of the default 5 minutes.
Do that change for all three RestPerfClient performance
tests.
Change-Id: I7497eb4284b3dde5909d1fab68783d03ce7a5e1a
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Wed, 23 Mar 2016 07:52:25 +0000 (08:52 +0100)]
Remove restperfclient invocation code triplication
Move the triplicated restperfclient invocation code into its
own bunch of keywords and hide some implementation details
from the test suite files. This makes the test suite files
easier to read and as a result it is also easier to add
additional code into the restperfclient invocation process.
Change-Id: I7a64b15e72c5fcf7766a768b44d6ebc3dd5434b2
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Wed, 23 Mar 2016 07:38:01 +0000 (08:38 +0100)]
Move the timeout tests in mdsal.robot to their proper place
The timeout tests are conceptually "failed requests tests"
so they don't belong to a test case whose name says "invoke
restperfclient" when there is another whose name says "check
for request failures". Move these checks to the proper test
case.
Change-Id: I7ab625df6c29fd6fb91b7174715476ed77eda07f
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jamo Luhrsen [Tue, 22 Mar 2016 18:03:02 +0000 (11:03 -0700)]
cleaning up system variables
- trying to change all MININET to TOOLS_SYSTEM as well as CONTROLLER
to ODL_SYSTEM
- also found a few small refactors to make
* MODULES_API instead of REST_CONTEXT
* moved DIDM variables to subdir for clarity
Change-Id: Ifa50e14a6f9479c55dfd0a748fb8936e1a6af0a6
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
Jozef Behran [Tue, 22 Mar 2016 09:39:23 +0000 (10:39 +0100)]
Add test for RestPerfClient timeouts
When RestPerfClient times out, it means a poor Netconf
Connector performance bug was caught. In the MDSAL Northbound
case it is reported as bug 5581, no such bugs were seen in
the other two cases so none are reported. However after the
RestPerfClient bug that causes it to hang in this situation
(see bug 5413) is fixed, the suite in itself tends to fail to
take a notice of such problems so add this specific check for
timed out threads that points the poor Netconf performance
bugs out.
Change-Id: Ib75707f517ee34f40b6c9961f90309c26870bafb
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Tue, 22 Mar 2016 09:55:39 +0000 (10:55 +0100)]
Add missing timeout to the test tool device performance test
The RestPerfClient on testtool device test suite was missing
a timeout setting. This would lead to suite hangs when this
scenario would trigger a "poor Netconf connector performance"
bug (see bug 5581 for an example) or spurious successes.
Change-Id: Ibf1c1843a86de12e11a4012c4209a36c0f0997e6
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Tue, 22 Mar 2016 15:26:20 +0000 (16:26 +0100)]
Tidy updated test suites
Change-Id: I8005dc69c8d07380bcdfefb832ebffb7c4d698e8
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jamo Luhrsen [Mon, 21 Mar 2016 22:31:45 +0000 (15:31 -0700)]
Giving the right library for Report_Failure_Due_To_Bug_Found keyword
Change-Id: I9d72f9cbe0b0e89b1f188e2034e94be171f17b11
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
Jamo Luhrsen [Mon, 21 Mar 2016 22:11:56 +0000 (15:11 -0700)]
Updating ODL versions for consumption by networking-odl project
Change-Id: I0141da5aea7daac874a1f6efc4a60c9fa2e11790
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
Jozef Behran [Mon, 21 Mar 2016 11:22:46 +0000 (12:22 +0100)]
Add PIP installation command into notifications test suite
Some tools system images (Ubuntu in particular) don't have
PIP installed and this causes the notifications test suite to
fail. Fix that by adding the code to install PIP before using
it.
Change-Id: Ib871cf554fc9c8e9456e16882d799a532fbf2c8d
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Luis Gomez [Sat, 19 Mar 2016 00:58:23 +0000 (17:58 -0700)]
Add more robust wait for flow stats
Change-Id: Iae0c0d26d6f1b8ee54d67f236d51c811567cb5a3
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
Karthik.S [Mon, 14 Mar 2016 11:09:31 +0000 (16:39 +0530)]
Modify VTN Manager CSIT for Stable Lithium
* Add Flow to OpenFlow Switch to forward packet in case of Table Miss
* Fix the wrong Keyword that was causing the entire job to fail
Change-Id: I32a66208acb88b66d178ba87d63135922b01840c
Signed-off-by: Karthik.S <siva-karthik@hcl.com>
gvrangan [Fri, 18 Mar 2016 22:18:58 +0000 (22:18 +0000)]
Fix VTN Coordinator CSIT Failures
* Removed Unwanted Call to Stop Mininet
* The Mininet wqs stopped by an earlier case
Change-Id: Ia106b348cdc4d7db52befd59b6ceb96808f7c369
Signed-off-by: gvrangan <venkatrangang@hcl.com>
Peter Gubka [Fri, 18 Mar 2016 14:37:26 +0000 (15:37 +0100)]
renaming bgp userfeatures testplans to fit 35774
Change-Id: Ifca4fb70720a7dadd559db46ee23e7e1c1b096d0
Signed-off-by: Peter Gubka <pgubka@cisco.com>
Vratko Polak [Thu, 3 Mar 2016 17:46:48 +0000 (18:46 +0100)]
Rework of controller car/people cluster suite
- Deleted the previous car/people cluster suites
+ New Resources: CarPeople, ClusterManagement
+ Updated/fixed: TemplatedRequests.robot, norm_json.py
+ New suite names, without number prefixes
+ Full-fields data files for car/people TemplatedRequests
- Simplistic iterated values for the fields
+ controller-clustering testplan updated
Change-Id: I56d0743129d6e8108b66e9b48c135e4c3bc13d5c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
vinoth [Mon, 29 Feb 2016 22:27:53 +0000 (03:57 +0530)]
Bug 5423: Fix for ERROR messages when intents were deleted.
* Previously the warn message "Invalid Address" is written in source code as log.error,
due to this warn message was displaying in error message.
* Currently the warn message handled properly in the source code as log.warn
link: https://git.opendaylight.org/gerrit/#/c/35273/
other changes:
* Fixed one of additional test case failed on to check drop the
packet when intent is delete.
Change-Id: I608ba47c8b64639c09a22056a710be194ca6bc50
Signed-off-by: vinoth <m.vinoth@hcl.com>
Karthik.S [Tue, 15 Mar 2016 11:24:17 +0000 (16:54 +0530)]
Enable loglevel as Trace for VTN Manager
Change-Id: Ie118580c68cab3e11bd6203b39eeb0a35fcc4257
Signed-off-by: Karthik.S <siva-karthik@hcl.com>
Peter Gubka [Thu, 11 Feb 2016 10:42:25 +0000 (11:42 +0100)]
flowspec tests
it has two test cases
-various flow details
-redirect option
Change-Id: I440ba40669711092917b9250e6546c3f8c891ce8
Signed-off-by: Peter Gubka <pgubka@cisco.com>
Tomas Cechvala [Tue, 15 Mar 2016 15:04:03 +0000 (16:04 +0100)]
Creating testplan for Openstack job
Change-Id: Ic356d9aafb2a4d16912c7e10814e9e43bcd6a63a
Signed-off-by: Tomas Cechvala <tcechval@cisco.com>
Luis Gomez [Wed, 16 Mar 2016 22:11:06 +0000 (15:11 -0700)]
Replace sleep by WUKS in Flow Stats suite
Change-Id: I99e4849f965293d938751f7ce0bbb99be735d60c
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
Vratko Polak [Tue, 15 Mar 2016 14:39:43 +0000 (15:39 +0100)]
Include needed Assure_* keywords in BGP tests
Ubuntu tools system seem to be missing ipaddr installation.
This could be fixed on releng/builder side,
but this makes it easier to run on onther environments.
Also, small improvements in Keyword ordering in BGP suites.
Change-Id: Ic863a083d0306ce5c9a7cc8b1f89c061a1e92065
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Radovan Sajben [Thu, 18 Feb 2016 11:59:40 +0000 (12:59 +0100)]
Carrying LSP State Information in BGP
- basic functional test
Change-Id: I1866d7d96dc4265c595d709714bc381a2b5ff61b
Signed-off-by: Peter Gubka <pgubka@cisco.com>
Jozef Behran [Mon, 14 Mar 2016 11:30:30 +0000 (12:30 +0100)]
Fix documentation of Utils.Set_User_Configurable_Variable_Default
The documentation was updated to stress that the name of the
variable to be set must be specified without the ${} syntactic
sugar. Also the TODO was updated to stress we don't have yet
examples of usage where doing the TODO would bring a benefit.
Change-Id: I614769c9c2565c0463633d56b306510c829e3965
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Lorand Jakab [Tue, 15 Mar 2016 18:35:59 +0000 (20:35 +0200)]
Add auth key for 0.0.0.0/0 in LISP perf tests
We recently discovered a security issue in lispflowmapping and an
explicitly configured authentication key is needed since the fix was
committed to allow southbound Map-Register messages to write into the
mapping database. This patch adds such a key for the Map-Register tests
to produce usable results (notifies/s graph has value 0).
Change-Id: I14bac6c92f040abce71f40a24c531b9ca8e312b3
Signed-off-by: Lorand Jakab <lojakab@cisco.com>
Luis Gomez [Wed, 16 Mar 2016 04:36:24 +0000 (21:36 -0700)]
Add WUKS to stabilize l2switch suite
Change-Id: I426ea63f67d690a9782df1b9c0e4dbb08c3af5e2
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
Jozef Behran [Fri, 19 Feb 2016 13:25:38 +0000 (14:25 +0100)]
Performance test suite for MDSAL northbound
This suite uses RestPerfClient on MDSAL northbound, via
Restconf. Similar to "performance.robot" but no device is
involved and thus no testtool deployment is necessary,
the only needed tool is restperfclient.
Change-Id: I117e790cd5434933d105ccbc29c6bcf7a9fca69e
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Vratko Polak [Tue, 15 Mar 2016 11:13:03 +0000 (12:13 +0100)]
NexusKeywords: Make Compose_*_Java_Command also work on Ubuntu
Active SSH connection is now required,
but all suites had that satisfied already.
Change-Id: Ib0222ce50358e122c288bc4d74ac2026059bf714
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jozef Behran [Thu, 10 Mar 2016 17:10:34 +0000 (18:10 +0100)]
Tidy new and updated test suites
Change-Id: I1290e2eff4977de37bd8375c380ca7cd1161c190
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Samuel Kontriš [Wed, 9 Mar 2016 15:15:29 +0000 (16:15 +0100)]
Topoprocessing Basic tests - Link computation
Change-Id: I660acae83a253fd18aad6731f9c18e18db2816e6
Signed-off-by: Samuel Kontriš <samuel.kontris@pantheon.tech>
Lorand Jakab [Tue, 8 Mar 2016 23:10:58 +0000 (15:10 -0800)]
Add Map-Register LISP SB performance test
Change-Id: I1c0a4a599733d3e3b5c24756fcfcf116e8db5dcd
Signed-off-by: Lorand Jakab <lojakab@cisco.com>
Jozef Behran [Fri, 13 Nov 2015 09:30:30 +0000 (10:30 +0100)]
Cycling device and checking that the data survived.
After the device data modification step the test suite
deconfigures the device, configures it back and checks that
the data is still there as they were when it was last
modified. Then the suite tries to modify the data again
just to make sure the deconfigure/configure cycle did not
mysteriously make them read-only.
Change-Id: I403357d85b80f28060775e57bb6192de90a6114e
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Fri, 4 Mar 2016 10:46:12 +0000 (11:46 +0100)]
Clear known bug ID in SetupUtils.Teardown_Test_Show_Bugs_...
When a known bug ID is set to e.g. 1234 and the test steps
after that will catch the bug 1234, the bug ID 1234 is
reported (correctly). But then the rest of the test case is
skipped and the next one is started. This means that the
next test case will have the bug ID set to 1234 and if
it fails, it will also report it found bug 1234 while in
reality it was supposed to report a bug search link instead.
Fix the problem by clearing the bug ID after reporting the
bug.
Change-Id: I44d9c17bd9e22dc4792529dea0425a7f6d06940e
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Samuel Kontriš [Fri, 26 Feb 2016 12:30:26 +0000 (13:30 +0100)]
Topoprocessing - tests correction
- reworked aggregation with filtration tests
- reworked Filtration termination points tests
- removed unnecessary files
- corrected some other tests
Change-Id: I8fc28154433517f22965d5eb93a52f218f2401ed
Signed-off-by: Samuel Kontriš <samuel.kontris@pantheon.tech>
Karthik.S [Thu, 10 Mar 2016 19:13:04 +0000 (00:43 +0530)]
Fix for VTN Manager CSIT test failures for Beryllium.
* Removed "Stop Suite" Keyword from Stop SuiteVtnMa function. Since, "Stop Miniet" Keyword used at the end of the VTN suite
which is used again in suite "TearDown function" which makes Test suite fails.
Change-Id: I1e5cf84ba7a76bb19bf4d7dc8f11bcdd12a58d56
Signed-off-by: Karthik.S <siva-karthik@hcl.com>
Jozef Behran [Thu, 10 Mar 2016 16:17:41 +0000 (17:17 +0100)]
Fix more error message problems
It turns out there is much more code duplication regarding
error message reporting. Fix that so the error message
strings appear in the code only once and are reused for
both, the exception and the log file. As a result the new
code is more readable and less confusing.
Change-Id: Ib72b7de11648b718e2db41ee1d576ad1993cbc10
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Thu, 10 Mar 2016 15:56:10 +0000 (16:56 +0100)]
Do not emit raw binary data after unconfirmed open
When the OPEN message generated by the player is rejected,
the original code emitted raw binary data in the resulting
exception. Change that so it emits the hexlified version of
the raw binary data. The fix was done by removing the
duplicated code that generates the two error messages (one
for the log file, the other for the exception), taking the
correct code only.
Change-Id: If1ac202ba0d3c8720c8c442da1d533143dcddb7c
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Samuel Kontriš [Thu, 25 Feb 2016 13:20:27 +0000 (14:20 +0100)]
Topoprocessing - bugfix for bug5156
Change-Id: Iaf9e7aadbc05bc49400286fe5c37f814ecc7650c
Signed-off-by: Samuel Kontriš <samuel.kontris@pantheon.tech>
Vratko Polak [Wed, 9 Mar 2016 13:02:21 +0000 (14:02 +0100)]
Fix logic in updater.py with respect to Counter class
Previously, it worked for Counter.py but not for collections.
Change-Id: I0fff144b0c261b47ce40a03766281f9df642f277
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Luis Gomez [Thu, 10 Mar 2016 05:28:10 +0000 (21:28 -0800)]
Add WUKS after conneting OVS instance to controller
Change-Id: Ie2fdeee11b851fa2237f6c752ead0d6aa4266484
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
Vratko Polak [Wed, 9 Mar 2016 14:38:38 +0000 (15:38 +0100)]
Throughpcep: Download pcc-mock log to current working directory
Change-Id: I9d5657fab8b831e9e6bafd51775d3950a4801b34
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Wed, 9 Mar 2016 10:51:07 +0000 (11:51 +0100)]
Fix typo in throughpcep suite.
Change-Id: Ia5152cd9c5c6f04d4c2c9b95a35a8991c9a8a2ad
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Gubka [Tue, 8 Mar 2016 14:44:01 +0000 (15:44 +0100)]
adding onos benchmarking scripts
Change-Id: I505ba2f1085392fa5031816c6fc1c7e2f50a0fd2
Signed-off-by: Peter Gubka <pgubka@cisco.com>
Jamo Luhrsen [Tue, 8 Mar 2016 00:31:41 +0000 (16:31 -0800)]
adding more configuration around shard names and restconf port
- added ability to provide specific port numbers for each controllers
restconf endpoint
- added ability to selectively ignore some shards. specifically, I
didn't want to look at the toaster shard when giving a demo
Change-Id: Ia7186193d186e34ba7963741ac54902d9619d34f
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
Jan Medved [Mon, 7 Mar 2016 00:13:27 +0000 (16:13 -0800)]
Fixed flow_config_blaster Floodlight edition
Fixed measurements of time for stats collection in flow_add_delete_test
Fixed PIP-8 violations (at least the fixable ones)
Change-Id: I01a361a7245fe479fbb65eea95bea93808d787a8
Signed-off-by: Jan Medved <jmedved@cisco.com>
Luis Gomez [Sun, 6 Mar 2016 21:19:53 +0000 (13:19 -0800)]
Remove exclude cleaning from OVSDB cluster test case
Change-Id: I5aaa4551d8a470aff115a0dd42f1504deffe1bd6
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
Jozef Behran [Thu, 3 Mar 2016 14:30:27 +0000 (15:30 +0100)]
Make pep8 more picky
Several guidelines were disabled and as a result I was
slipping into my old coding style, incompatible with the
Python sources here. Enabling them turned out to uncover I
was not the only one slipping. As a matter of fact all
checks are enabled now except E133 which is not compatible
with E123.
Change-Id: I754c740f49a213360df5b187897e776266e6653f
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Luis Gomez [Mon, 29 Feb 2016 05:45:30 +0000 (21:45 -0800)]
Fix and clean OVSDB cluster suite
- Simplify OVSDB cluster keywords.
- Modify Entity Owner KW to support uuid.
- Restore OVSDB clean environment.
Change-Id: I2c3034c5d09a4fce4e0b96f40bced30fff3204dd
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
premnath [Mon, 29 Feb 2016 11:40:05 +0000 (17:10 +0530)]
Modified HBase scripts to run in Lithium Branch.
Added Testplan to source.
Change-Id: I7fe969340d95c4bdf15f2ea836498096f3de58aa
Signed-off-by: premnath <prem.annauniv@gmail.com>
Jozef Behran [Fri, 26 Feb 2016 11:00:49 +0000 (12:00 +0100)]
Add keyword needed by guidelines
The new variable naming guidelines [1] specify the use of a
new keyword named Utils.Set_User_Configurable_Variable_Default
when the default value for an user configurable variable
needs to be computed at the suite setup, either using
BuiltIn.Evaluate or even invoking other, more complex
keywords (that look around in the environment or do other
stuff like that).
[1] https://wiki.opendaylight.org/view/Integration/Test/Test_Code_Guidelines#User_configurable_variables
Change-Id: I08982748380c54b483383fbcd07a1b6ce617d1fb
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Thu, 3 Mar 2016 13:10:06 +0000 (14:10 +0100)]
Tidied updated test suite
Change-Id: I9ca8ba1794dc4f6117d4f46ff1553ed7a9b1f45a
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Vratko Polak [Tue, 1 Mar 2016 12:21:19 +0000 (13:21 +0100)]
Add odl-cluster-rpc back to akka conf template
This section does not affect Beryllium+,
but fixes Lithium clustering.
As repeatedly stated, this is just a temporary solution,
we need better way of choosing proper template.
Change-Id: Idd1d92be27e500aa85e55db36576efc1d7971ba7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jozef Behran [Fri, 26 Feb 2016 10:38:26 +0000 (11:38 +0100)]
Fix variable naming for some immutable variables
A bunch of immutable but not user configurable variables now
need to use snake_case instead of ALL_CAPS due to new
variable naming guidelines [1].
[1] https://wiki.opendaylight.org/view/Integration/Test/Test_Code_Guidelines#Variable_naming
Change-Id: I45f4e3c684c2b2f1905a9ad91afe2cf2fbbb6569
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Thu, 25 Feb 2016 14:51:31 +0000 (15:51 +0100)]
Fix timeouts for Install/Uninstall Karaf Feature
15 seconds is not enough for some of the features. Even one
minute may be insufficient. Increase thus the default
timeout for these keywords to 3 minutes.
Change-Id: If79ece224becea091d3c42c2ecdac84be2b95861
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jamo Luhrsen [Thu, 25 Feb 2016 05:43:48 +0000 (21:43 -0800)]
fixing syntax for chaning odl_version in devstack setup
Change-Id: I46db6702957d4b3404cee556255909a2c88a7ff6
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
Luis Gomez [Wed, 24 Feb 2016 05:34:12 +0000 (21:34 -0800)]
Add topology check in OpenFlow cluster test
Add 2 more switches connecting to first switch candidate instance.
Verify new inventory and topology during owner instance failure and recover.
verify topology when link between switches goes down and up.
Change-Id: I153a24599ce9478bc8e57cd161d46c606aa26bad
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
Vratko Polak [Thu, 25 Feb 2016 17:29:42 +0000 (18:29 +0100)]
Comment out Netconf (netopeer) suite from userfeatures testplan
Change-Id: I511606ca3d4f17d11518ccefa727af220fbf9c75
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jozef Behran [Wed, 24 Feb 2016 15:52:34 +0000 (16:52 +0100)]
Add ability to report exact bugs into the new bug reporting
Use SetupUtils.Set_Known_Bug_Id with the bug ID before
checking for the bug and then use SetupUtils.Set_Unknown_Bug
when the checks for the concrete bug are over.
Change-Id: I954f801ff7351b16b9978e5e77652d9a2cce3562
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Tue, 23 Feb 2016 09:07:21 +0000 (10:07 +0100)]
Add test case to wait for MDSAL to become ready
The Netconf Readiness suite got another testcase which waits
for the Netconf MD-SAL to become ready. This testcase first
checks if that feature is installed and skips with a message
if not.
Change-Id: If763e6fba6639536bb5360dcd6fcc4ce922261e7
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Tue, 23 Feb 2016 12:04:05 +0000 (13:04 +0100)]
Fix Netconf scaling suites not reporting test cases to karaf.log
Change-Id: Ia797313aeeb85ab9d0e3780699570e027294e5ed
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Wed, 24 Feb 2016 14:46:15 +0000 (15:46 +0100)]
Use the "external references" field as the source of bug links
The Report_Failure_And_Point_To_Linked_Bugs keyword now uses
the "external references" field to search for linked bugs.
Change-Id: Ic62550889e8cb9911201ab373f4b315ef0bfb85b
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Thu, 25 Feb 2016 16:21:45 +0000 (17:21 +0100)]
Tidy new and updated test suites.
Change-Id: I46fd19561a150a74db3e1de413f5db71a25baf64
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Thu, 25 Feb 2016 13:55:56 +0000 (14:55 +0100)]
Fix crash in tidytool.py when processing non-ASCII Robot file
Change-Id: Ie28116c94db9a03129aca7ac4c0416719847743f
Signed-off-by: Jozef Behran <jbehran@cisco.com>
wucangji [Mon, 14 Sep 2015 17:19:18 +0000 (13:19 -0400)]
Update iotdm library and tests.
Support latest resource format.(Feb 22)
Change-Id: I38cdb8053f51161b2cdd518b4a32ea831d7fe733
Signed-off-by: wucangji <wucangji@gmail.com>
Vratko Polak [Wed, 24 Feb 2016 15:35:58 +0000 (16:35 +0100)]
Add ability to compose java command according to version
This fixes Boron csit jobs which download Java tools from Nexus.
UscUtils not edited, as their jar presumably does not depend on {stream}.
Change-Id: I1e61ad44b810838d333fde56cfe5edca906fda9f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Luis Gomez [Tue, 23 Feb 2016 05:29:47 +0000 (21:29 -0800)]
Add check for missing candidates in entity owner Keyword
Change-Id: I6a47cffddb739b9d2be78abc7b7e746f9b7d4921
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
Jozef Behran [Mon, 22 Feb 2016 13:38:07 +0000 (14:38 +0100)]
Fix netconf port variables
There are two netconf ports in ODL, one is MDSAL and the
other one is the config subsystem. However there was only
one Netconf port variable, confusingly named ODL_NETCONF_PORT
which pointed to the MDSAL port. Fix that by putting the
name of the subsystem behind the port into the name of the
variable and also create the other variable which for some
reason was still missing.
Change-Id: I526f1a314a7a3b1414f333f9b161f146e5e88d87
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Mon, 22 Feb 2016 14:01:41 +0000 (15:01 +0100)]
Remove superfluous call to NexusKeywords.Initialize_Artifact ...
The NexusKeywords.Initialize_Artifact_Deployment_And_Usage is
already called by NetconfKeywords.Setup_Netconf_Keywords so
it is not needed to call it again explicitly.
Change-Id: I2fb804ac378916d512541d8d676c5d0eaca29204
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Mon, 22 Feb 2016 13:55:59 +0000 (14:55 +0100)]
Fix outdated FailFast teardown usage
Change-Id: I6708bbe023654a7d3ec49f30874e244801e796c7
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Mon, 22 Feb 2016 13:46:42 +0000 (14:46 +0100)]
Fix copyright year
Change-Id: I2a5a12650ea1d401a262f63928212e2451769637
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Mon, 22 Feb 2016 13:36:35 +0000 (14:36 +0100)]
Fix insufficient check for failed requests
Some request failures are reported with "Status code: XYZ"
where "XYZ" is some error status code. This is not caught by
the failed requests checking test case, leading to a spurious
test pass.
Change-Id: Icbc32036590fcff86ca025deef4dcc1e1a3226b4
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Mon, 22 Feb 2016 11:47:11 +0000 (12:47 +0100)]
Add more configurability to Netconf device configurator
The Configure_Device_On_Netconf now got "address", "port",
"user" and "password" arguments that specify these
configuration options for the device. This is needed to be
able to connect to non-testtool devices which have real
authentication and live on different address:port than
the testtool ones live.
Change-Id: I22c541302bfc2c9d78eee18358654aaaa1baf052
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Junaid Zulfiqar [Sun, 14 Feb 2016 23:03:01 +0000 (15:03 -0800)]
Moved calls to "RequestLibrary.<action> Request" in csit/suites/ (2)
+ RequestsLibrary.Get Request
+ RequestsLibrary.Delete Request
+ RequestsLibrary.Put Request
+ RequestsLibrary.Post Request
Updated RequestLibrary calls in following directories
csit/suites/iotdm/
csit/suites/l2switch/
csit/suites/lacp/
csit/suites/lispflowmapping/
csit/suites/messaging4transport/ (removed due to failure)
csit/suites/nemo/
csit/suites/netconf/
csit/suites/netide/
csit/suites/nic/
Change-Id: I8a513c6bf3cc05825158b484c1d25fbe30e96ec8
Signed-off-by: Junaid Zulfiqar <junaid.rao21@gmail.com>
Junaid Zulfiqar [Mon, 15 Feb 2016 00:19:56 +0000 (16:19 -0800)]
Moved calls to "RequestLibrary.<action> Request" in csit/suites/ (3)
+ RequestsLibrary.Get Request
+ RequestsLibrary.Delete Request
+ RequestsLibrary.Put Request
+ RequestsLibrary.Post Request
Updated RequestLibrary calls in following directories
csit/suites/sdninterfaceapp/
csit/suites/sxp/
csit/suites/topoprocessing/
csit/suites/ttp/
csit/suites/unimgr/
csit/suites/usc/ (Removed due to failure)
csit/suites/usecplugin/
Change-Id: I81a8f366835d31a3d70ea52bd99d8afd345aba1b
Signed-off-by: Junaid Zulfiqar <junaid.rao21@gmail.com>
Junaid Zulfiqar [Sun, 14 Feb 2016 22:35:56 +0000 (14:35 -0800)]
Moved calls to "RequestLibrary.<action> Request" in csit/suites/ (1)
+ RequestsLibrary.Get Request
+ RequestsLibrary.Delete Request
Updated RequestLibrary calls in following directories
csit/suites/armoury/ (removed due to failure)
csit/suites/bgpcep/
csit/suites/capwap/
csit/suites/centinel/
csit/suites/controller/
csit/suites/didm/
Change-Id: I5efd4fe53330022809e2ffcf4592b547c21d77a0
Signed-off-by: Junaid Zulfiqar <junaid.rao21@gmail.com>
Karthik.S [Tue, 16 Feb 2016 12:35:27 +0000 (18:05 +0530)]
BUG 5343: Fix CSIT test case to verify dataflow in VTN Manager
* Modified dataflow URL in verify dataflow function VtnMaKeyword.robot file
Change-Id: Ie814583667d93fa3b3113d16c6e16abb1e42ae31
Signed-off-by: Karthik.S <siva-karthik@hcl.com>
Samuel Kontriš [Thu, 18 Feb 2016 17:37:09 +0000 (18:37 +0100)]
Topoprocessing - reworked test Unification Termination Point Inside
Change-Id: I6c05a7ebc2f59d7efa4c95c1f00daf2ae7dfd067
Signed-off-by: Samuel Kontriš <samuel.kontris@pantheon.tech>
Jozef Behran [Fri, 19 Feb 2016 13:33:18 +0000 (14:33 +0100)]
Removed unnecessary "operational" alias for RequestKeywords
The removed line was copied from the CRUD suite but it turns
out it is not used for anything in the
Change-Id: Ib0cdb652a5ebca6c63abf3922c750e29c4d20e54
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Fri, 19 Feb 2016 13:41:42 +0000 (14:41 +0100)]
Fix hardcoded nexus URL in NexusKeywords
Use ${NEXUSURL_PREFIX} instead of hardcoding
http://nexus.opendaylight.org/some/random/location in the
NexusKeywords resource. Not everyone wants or can go
downloading artifacts directly from ODL Nexus.
Change-Id: I4b75370077930e548e5d86f0e045912b924c1f4a
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Fri, 19 Feb 2016 12:44:17 +0000 (13:44 +0100)]
Remove unused keyword left behind after refactoring
The "Wait_Until_Prompt" was used in the early versions of
the suite but it turned out to be not necessary - similar
functionality already exists in SSHLibrary. But the keyword
was left behind, unused.
Change-Id: I1baa000bf044de5045d9643ac38ccc6352250ab0
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Junaid Zulfiqar [Sun, 14 Feb 2016 23:51:23 +0000 (15:51 -0800)]
Moved calls to "RequestLibrary.<action> Request" in suites/ovsdb/
+ RequestsLibrary.Get Request
+ RequestsLibrary.Post Request
+ RequestsLibrary.Put Request
+ RequestsLibrary.Delete Request
Change-Id: I937339d5474e4ffb72d65e002879eac8f6976e5f
Signed-off-by: Junaid Zulfiqar <junaid.rao21@gmail.com>
A H [Sat, 20 Feb 2016 01:58:25 +0000 (17:58 -0800)]
Add testplan for USC TCP test suite
Change-Id: I4ef825e5820116e361aa13364ad1d2fafd5be392
Signed-off-by: A H <an.ho@huawei.com>
Jozef Behran [Wed, 2 Dec 2015 09:35:42 +0000 (10:35 +0100)]
RestPerfClient performance test suite
Deploy restperfclient and ask it to bombard one testtool
device mounted on a netconf connector with configuration
update requests. The count of these requests is configurable
via a Robot variable.
Change-Id: I4550a9ce4f6ac2e3233097c0c1246fee4861b14c
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Tue, 2 Feb 2016 11:40:59 +0000 (12:40 +0100)]
Added more thorough CRUD testing
Added a bunch of test cases that create a list of cars and
add cars into this list. One car is added using XML, the
other is added using JSON.
Change-Id: I22ef64f58095ba9316cd4087dbd536e44f9f5929
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Thu, 18 Feb 2016 16:03:29 +0000 (17:03 +0100)]
Add suite name to the testtool log file name
To prevent suites using the test tool overwriting the log
file of the test tool(s) they use, add the name of the
suite to the name of the log file produced by the test
tool. This currently affects suites using the "testtool"
tool (CRUD and scaling suites). The core code in this change
was packaged into the keyword Utils.Get_Log_File_Name because
the functionality is going to be needed in the RestPerfClient
suite as well.
Change-Id: Idf5fbed8baf4b150d66e91c95c2bcaa6dbeab90b
Signed-off-by: Jozef Behran <jbehran@cisco.com>
Jozef Behran [Fri, 19 Feb 2016 10:42:43 +0000 (11:42 +0100)]
Replace "Get" with "Get Request" in netconf readiness suite.
To avoid a deprecation warning and a possible breakage of the
suite in the future change it to use "Get Request" instead of
"Get" to do its checks.
Change-Id: I6c68f9d9df6d9bf921f64dbda061daa23d7e841a
Signed-off-by: Jozef Behran <jbehran@cisco.com>
vinoth [Fri, 12 Feb 2016 19:50:49 +0000 (01:20 +0530)]
Fix for NIC CSIT in beryllium
Change-Id: I809233559a4382a062c2b02af6faa541c65dc9c2
Signed-off-by: vinoth <m.vinoth@hcl.com>
Lorand Jakab [Tue, 16 Feb 2016 09:38:52 +0000 (11:38 +0200)]
Move calls to "RequestsLibrary.<action> Request" in suites/lispflowmapping
Change-Id: I9660c1ced0575f073d57eebdb2826c9827ec74cf
Signed-off-by: Lorand Jakab <lojakab@cisco.com>
Junaid Zulfiqar [Mon, 15 Feb 2016 00:06:18 +0000 (16:06 -0800)]
Moved calls to "RequestLibrary.<action> Request" in suites/vpnservice/
+ RequestsLibrary.Get Request
+ RequestsLibrary.Post Request
+ RequestsLibrary.get Request
+ RequestsLibrary.Delete Request
Change-Id: Ifd0154d3e22bbd507d6fef7577b3ec595a99f2c7
Signed-off-by: Junaid Zulfiqar <junaid.rao21@gmail.com>
Junaid Zulfiqar [Sun, 14 Feb 2016 23:18:57 +0000 (15:18 -0800)]
Moved calls to "RequestLibrary.<action> Request" in suites/sfc/
+ RequestsLibrary.Get Request
+ RequestsLibrary.Post Request
Change-Id: I300d6c6a3ef0b8f05b8a8647831ab9eb194a3f86
Signed-off-by: Junaid Zulfiqar <junaid.rao21@gmail.com>
Peter Gubka [Fri, 18 Dec 2015 08:11:45 +0000 (09:11 +0100)]
robot lib to catch network traffic
this library is primarily to be used in sandbox for debug
purposes, because the job config must be modified to save
additional files
typical usage would be
*** Test Cases ***
Catch Test
Start Tcpdumping
<more keywords>
Stop Tcpdumping And Download [filaname.pcap]
Change-Id: I263cda801d9b2266fad9594073f19ba825e3ffcb
Signed-off-by: Peter Gubka <pgubka@cisco.com>
Jamo Luhrsen [Thu, 18 Feb 2016 00:04:53 +0000 (16:04 -0800)]
marking failing SNMP test case with relevant bug 5360
Change-Id: I834441d8daadfe844c6b8699ae8c7feac62deb51
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
Tomas Cechvala [Tue, 16 Feb 2016 14:47:04 +0000 (15:47 +0100)]
Editing rest calls in GBP demos
- added verification
- depricated methods replaced
Change-Id: I74d4de26f7bce54201afdc1edff0979f80497788
Signed-off-by: Tomas Cechvala <tcechval@cisco.com>
Vratko Polak [Thu, 18 Feb 2016 11:04:46 +0000 (12:04 +0100)]
Add TemplatedRequests.robot Resource
+ Resource to simplify handling Restconf requests using data from files.
+ Suite with basic 1-node car/people tests, for library verification.
+ Data for the suite, not suitable for more thorough car/people tests.
+ The suite added to test-libraries testplan.
+ Add mising Utils dependency to SetupUtils.
Change-Id: I851376426132669b9d344a19118cfe06b38d6b97
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
premnath [Thu, 11 Feb 2016 07:23:29 +0000 (12:53 +0530)]
Added Syslog Scripts to run in Cassandra,HBase and HSQLDB
Debugging Syslog Failures
Change-Id: I243d89cf3260e4b1d90cb8bce10db74dd10ada0b
Signed-off-by: premnath <prem.annauniv@gmail.com>
Jozef Behran [Thu, 18 Feb 2016 13:32:32 +0000 (14:32 +0100)]
Tidied updated tests.
Change-Id: I6b22374cb3d232ac1eb19907db840cf3d03e453b
Signed-off-by: Jozef Behran <jbehran@cisco.com>