integration/test.git
8 years agoStep 2: Move test folder to root 36/26136/1
Luis Gomez [Fri, 28 Aug 2015 02:18:45 +0000 (19:18 -0700)]
Step 2: Move test folder to root

Change-Id: I26bbe73fe106247b32ca237546436e92d34cf114
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
8 years agoStep 1: Move vm scripts to the right place 34/26134/3
Luis Gomez [Fri, 28 Aug 2015 01:59:27 +0000 (18:59 -0700)]
Step 1: Move vm scripts to the right place

Change-Id: I71289bcda9a623e62fe4846408ad3da8f3603227
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
8 years agoAdd .gitreview for integration/test 24/26124/1
Andrew Grimberg [Thu, 27 Aug 2015 23:52:16 +0000 (16:52 -0700)]
Add .gitreview for integration/test

Add a .gitreview file for the integration/test project after the split
from the base integration

Change-Id: I2f7c9e2ca7d3c082d4985a0a61b74ec40155767c
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
8 years agoAdd robot test files for VTN Coordinator features
Karthik.S [Thu, 6 Aug 2015 16:02:08 +0000 (21:32 +0530)]
Add robot test files for VTN Coordinator features

     * Rename all robot test files with vtn features name
     * Modify test cases to reduce delay time of controller
     * Add Tags in some test cases to disable them
     * Fix error in VtnCoKeywords library file
     * Implemented the alternative solution discussed in Bug 4008

Change-Id: Ibd9dd634a2c9cd7880014966a8c8d62b5522a9bd
Signed-off-by: Karthik.S <siva-karthik@hcl.com>
8 years agoKeyword to log messages to controller's karaf log
Jozef Behran [Wed, 26 Aug 2015 11:45:27 +0000 (13:45 +0200)]
Keyword to log messages to controller's karaf log

The keyword "Log Message To Controller Karaf" sends the
specified text to the Karaf log. It makes initialization
on its first call so no special initialization is necessary
and it does not drain any resources from suites that don't
use it. This keyword is not "cluster friendly" as it always
sends the message to the controller which is specified using
the "CONTROLLER" Robot variable.

Change-Id: I07417c242b5ad0e8fea2ee9910d2b44764a02ade
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoModifying "Find Max Links" keyword to gracefully exit if failure (timeout) occurs...
Kailash Khalasi [Wed, 26 Aug 2015 22:17:59 +0000 (15:17 -0700)]
Modifying "Find Max Links" keyword to gracefully exit if failure (timeout) occurs around mininet

Change-Id: Ib5eecbab374961130df8c22d66faa6e341ad6cf2
Signed-off-by: Kailash Khalasi <kkhalasi@iix.net>
8 years agoUpdated ADSAL Test references to "Library RequestsLibrary"
Chaudhry Muhammad Usama [Wed, 26 Aug 2015 15:40:35 +0000 (08:40 -0700)]
Updated ADSAL Test references to "Library RequestsLibrary"

This will move references libraries/RequestsLibrary.py to "RequestsLibrary" of
openflowplugin/AD_SAL_NSF_10
openflowplugin/AD_SAL_NSF_13

Change-Id: I9569764573ef03330c55ef168027b861440649d6
Signed-off-by: Chaudhry Muhammad Usama <chaudhryusama@gmail.com>
8 years agoAdded Tests For Flowfilter With Attributes.
priya.ramasubbu [Thu, 20 Aug 2015 15:22:00 +0000 (20:52 +0530)]
Added Tests For Flowfilter With Attributes.

   + Create flowfilters on vbridge interfaces
   + Various actions on flow filters added
   + Flows installed by VTN for various options are verified
   + Create flowfilters on Vtn and Vbridge
   + Added Macmap.

Signed-off-by: priya.ramasubbu <priya.ramasubbu@hcl.com>
Change-Id: Idbf2a6da1d62d3be9de24bb1e30367dbcbf0c0e8

8 years agoFull and Generic Datastore CRUD Library
Phillip Shea [Sat, 22 Aug 2015 00:21:40 +0000 (17:21 -0700)]
Full and Generic Datastore CRUD Library

Implements generic Create, Read, Update and Delete keywords to be
used on any controller datastore.
A cars and people library was started such that modular CRUD tests
can be written for those shards.
The Config and Operational API  variables in Variables.py were modified
to remove a trailing '/' which was causing REST failures.

Change-Id: I732b03a7449d2b0a4d6bb1b57f5e8e8b19c87644
Signed-off-by: Phillip Shea <phillip.shea@hp.com>
8 years agoModifying openflow switch scale test to gracefully handle failures (mininet timeouts)
Kailash Khalasi [Mon, 24 Aug 2015 22:50:10 +0000 (15:50 -0700)]
Modifying openflow switch scale test to gracefully handle failures (mininet timeouts)

Change-Id: Ida1e98573a82bf076c3e77c345f840d31f09b562
Signed-off-by: Kailash Khalasi <kkhalasi@iix.net>
8 years agoAdded a check to verify controller has no Null Pointer Exceptions
Nitika Agarwal [Tue, 25 Aug 2015 14:02:28 +0000 (07:02 -0700)]
Added a check to verify controller has no Null Pointer Exceptions

Change-Id: I0c529b3a23ecb098a03fb778749c9720faef3e15
Signed-off-by: Nitika Agarwal <nitikaagarwal18@gmail.com>
8 years agoAdd support for HOLDTIME=0
Jozef Behran [Tue, 25 Aug 2015 07:52:25 +0000 (09:52 +0200)]
Add support for HOLDTIME=0

When HOLDTIME=0, no KEEPALIVE messages will be sent and no
keepalive checking will be done. See RFC 4271, section 4.4.

Additionally a timing bug was exposed by this change and thus
fixed.

Change-Id: Icab0ef46207638c0072cc77a9b3bafe71b31c8eb
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoMake hold time configurable via Robot variable
Jozef Behran [Tue, 25 Aug 2015 05:57:22 +0000 (07:57 +0200)]
Make hold time configurable via Robot variable

The default value for hold time is 180 seconds. If that is
not desired, another value can be passed via the ROBOT
variable HOLDTIME.

Change-Id: I21ee13d4a7810936a5de7b7f0b5d56ec904fa1fe
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoUpdated Test references to "Library RequestsLibrary"
Chaudhry Muhammad Usama [Mon, 17 Aug 2015 16:24:54 +0000 (09:24 -0700)]
Updated Test references to "Library RequestsLibrary"

This will move references libraries/RequestsLibrary.py to "RequestsLibrary" of
suites/openflowplugin
libraries/AAAKeywords.robot
libraries/FlowLib.robot
libraries/PcepOperations.robot
except ADSAL Testsuites.

Change-Id: Ibe0b823d13c679b057503c2d0cb7cc207bdca9fa
Signed-off-by: Chaudhry Muhammad Usama <chaudhryusama@gmail.com>
8 years agolispflowmapping: update RPC URL
Lorand Jakab [Mon, 24 Aug 2015 10:46:39 +0000 (13:46 +0300)]
lispflowmapping: update RPC URL

The URL for lispflowmapping RPCs changes in Beryllium, this commit
updates the system tests accordingly.

Change-Id: Id00478646bbbffcddcf8817bc6a49bccc444eb63
Signed-off-by: Lorand Jakab <lojakab@cisco.com>
8 years agoFixed failure due to a too sensitive command
Jozef Behran [Wed, 19 Aug 2015 15:14:31 +0000 (17:14 +0200)]
Fixed failure due to a too sensitive command

There is a command in the "Verify Keyword Does Not Fail
Within Timeout" keyword which tried to catch the "timeout
failure" error but the problem is that the "timeout failure"
error looks different on different versions of Robot
Framework. The result is that the test fails on any Robot
Framework version except the one that it was debugged on.
The fix simply reduces the sensitivity of the command to
"any error is ok with me".

Change-Id: I4ecd7b5f7c2ea7bc070313dc69b3a7c7d3f96908
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoSwitched to "Get|Put|Delete" from "[Get|Put|Delete]_Request"
Jozef Behran [Wed, 19 Aug 2015 13:49:40 +0000 (15:49 +0200)]
Switched to "Get|Put|Delete" from "[Get|Put|Delete]_Request"

The "Get_Request" command has a different format and the
format differs with different versions of Robot Framework.
The "Get" is deprecated but is the same across different
Robot Framework versions so to fix the problem the test was
switched to use "Get". The same is true for "Put_Request"
versus "Put" and "Delete_Request" versus "Delete".

Change-Id: I0e28024e3384212db79520296ace3dd7a3dc95e9
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoFixed SSH login not working
Jozef Behran [Wed, 19 Aug 2015 13:49:09 +0000 (15:49 +0200)]
Fixed SSH login not working

SSHLibrary.Login_With_Public_Key requires the SSH on the
machine where Robot is running not doing key verification and
asking questions of type "Host A.B.C.D was not seen before,
are you sure you want to connect to it?".

This fix uses the newly added "flexible login" keyword which
uses either password if it gets one or public key
authentication if no password provided. This allowed to
bypass these problems with public key authentication by
simply providing a password.

Change-Id: I6c9987ba2871274b4fad75ba56dcadd9623239d5
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoUpdated the MessageError to produce less confusing messages
Jozef Behran [Fri, 21 Aug 2015 15:34:43 +0000 (17:34 +0200)]
Updated the MessageError to produce less confusing messages

The first change is that there is a colon between the text of
the error message and the message hexdump and the second
change is that when the message is empty, then string "(empty
message)" is placed there instead of an empty string. These
changes shall reduce user's confusion.

Change-Id: I46deb344797fc6949d28fdccfb24f60c45e9115a
Signed-off-by: Jozef Behran <jbehran@cisco.com>
8 years agoAdd Tests to check the FlowEntry installed by VTN.
ananthip [Thu, 16 Jul 2015 13:58:00 +0000 (19:28 +0530)]
Add Tests to check the FlowEntry installed by VTN.

  + Fetch Flow entries from OpenFlow switch and validate the same.

Signed-off-by: ananthip <ananthip@hcl.com>
Change-Id:  I670a52c0f2477da28632dbae4f362f020568f71c

8 years agoUpdated OpenStack references to "Library RequestsLibrary" release/lithium-sr1
Chaudhry Muhammad Usama [Thu, 13 Aug 2015 19:53:08 +0000 (12:53 -0700)]
Updated OpenStack references to "Library RequestsLibrary"

Change-Id: Icd721572ac26a767089c57cc84fcaac92e90a25c
Signed-off-by: Chaudhry Muhammad Usama <chaudhryusama@gmail.com>
8 years agoAdd Tests for VTN Renderer feature of NIC.
kavitha.ma [Fri, 10 Jul 2015 02:42:26 +0000 (08:12 +0530)]
Add Tests for VTN Renderer feature of NIC.

Change-Id: Icda97dedd24c3c4cc02b616fbe77a92a673e861b
Signed-off-by: kavitha.ma <kavitha.ma@hcl.com>
8 years agoUpdated some Test references to "Library RequestsLibrary"
Chaudhry Muhammad Usama [Fri, 14 Aug 2015 18:08:22 +0000 (11:08 -0700)]
Updated some Test references to "Library RequestsLibrary"

This will move all references of ../../libraries/RequestsLibrary.py to just "Library RequestsLibrary" of following
Robot_Tool/suites/base
Robot_Tool/suites/cluster
Robot_Tool/suites/ha

Change-Id: Ife9c44bd4157f78e89681386729735798c86f5c5
Signed-off-by: Chaudhry Muhammad Usama <chaudhryusama@gmail.com>
8 years agoAdded a small testcase to debug the issue with testcase failures
Chaudhry Muhammad Usama [Wed, 19 Aug 2015 19:03:20 +0000 (12:03 -0700)]
Added a small testcase to debug the issue with testcase failures

Change-Id: I953d8916e9032bd6f6db6cb06f584b2a20457bbf
Signed-off-by: Chaudhry Muhammad Usama <chaudhryusama@gmail.com>
8 years agoUpdated Vpnservice references to "Library RequestsLibrary"
Chaudhry Muhammad Usama [Mon, 17 Aug 2015 16:08:36 +0000 (09:08 -0700)]
Updated Vpnservice references to "Library RequestsLibrary"

Change-Id: I46502780da286780b8d4330c01cc7d18ae3a3f7f
Signed-off-by: Chaudhry Muhammad Usama <chaudhryusama@gmail.com>
8 years agoFix typo in filled.json for bgpuser suite
Vratko Polak [Wed, 19 Aug 2015 13:52:14 +0000 (15:52 +0200)]
Fix typo in filled.json for bgpuser suite

Change-Id: I35d027e9d577f11c5097161bd9d3899b46f11e0c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 years agoIntroduce Keywords for flexible SSH login
Vratko Polak [Thu, 13 Aug 2015 16:22:50 +0000 (18:22 +0200)]
Introduce Keywords for flexible SSH login

Some environments require to use public keys for SSH authentication,
other environments do not have known_hosts prepared for that.

This change introduces *_PASSWORD variables to Variables.py
which by default are empty; and Utils.robot now have
"Flexible" keywords that choose Login method
based on presence of non-empty password.

This change should not require edits in existing suites.

Change-Id: Ibe077c5af32570bce285cf5dcda84042fe3651ec
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 59463500c53326221de6cbf4f1b0f48a27b3ae91)

8 years ago${starttime} is a local variable, so we need to pass it to "Save Setup Time"
Jamo Luhrsen [Tue, 18 Aug 2015 22:49:27 +0000 (15:49 -0700)]
${starttime} is a local variable, so we need to pass it to "Save Setup Time"

this is not seen in older versions of robotframe work because variable
scoping was not as strict.  In the new RF2.9, local variables do not
"leak".  This is probably a problem in many places, but I found this one
for now.  It breaks on my local RF2.9 environment.  Works with this
patch and should not have any problems upstream with older RF versions

Change-Id: I58e3f5b9ce1f71a86cf6bac8ca4c5e359e82832c
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
8 years agoTest case 2: OVSDB openflow extension
Chaudhry Muhammad Usama [Sun, 2 Aug 2015 12:27:01 +0000 (05:27 -0700)]
Test case 2: OVSDB openflow extension

Use OF1.3 tunnel-id match and action to read VxLAN incoming packet tunnel-id
and write VxLAN outgoing packet tunnel-id.

Restoring original patch...

Change-Id: I0c376568e8bf1e78bdc7d6a626a06eddf183e585
Signed-off-by: Chaudhry Muhammad Usama <chaudhryusama@gmail.com>
8 years agoImprove Regex in Isolation Library
Phillip Shea [Mon, 17 Aug 2015 20:52:19 +0000 (13:52 -0700)]
Improve Regex in Isolation Library

IPTables are now checked for the string DROP for
isolated controllers. This is so the isolation
keywords will not erroneously match actions
other than DROP on the same controller pair.

Change-Id: I0a55f994c6d19a6aebd30375396ca840da4da61b
Signed-off-by: Phillip Shea <phillip.shea@hp.com>
8 years agoAdd controller isolation keywords.
Phillip Shea [Thu, 13 Aug 2015 02:05:58 +0000 (19:05 -0700)]
Add controller isolation keywords.

The following test features are added:
Isolate or rejoin a single pair of controllers.
Isolate or rejoin a controller from a cluster.
Rejoin all isolated contrllers to eachother.

Change-Id: Ic8376aa1c7283248eceeb80c90a5e999b29999f2
Signed-off-by: Phillip Shea <phillip.shea@hp.com>
8 years agousing robot library functions instead of subprocess
Jamo Luhrsen [Mon, 10 Aug 2015 22:17:32 +0000 (15:17 -0700)]
using robot library functions instead of subprocess

Change-Id: If6f472f00bd5df86679a2e41fad0f31466a0bbdb
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
8 years agoUpdated some Test references to "Library RequestsLibrary"
Chaudhry Muhammad Usama [Thu, 13 Aug 2015 20:11:43 +0000 (13:11 -0700)]
Updated some Test references to "Library RequestsLibrary"

This will move all references of ../../libraries/RequestsLibrary.py to just "Library RequestsLibrary" of following
l2switch
iodtm

Change-Id: I4ca9b3d2e9822cac2d53befcd3b820dbd46bb7e8
Signed-off-by: Chaudhry Muhammad Usama <chaudhryusama@gmail.com>
8 years agoUtils.Stop Suite needs to have ${mininet_conn_id} available
Jamo Luhrsen [Thu, 13 Aug 2015 20:35:48 +0000 (13:35 -0700)]
Utils.Stop Suite needs to have ${mininet_conn_id} available

Change-Id: Ic266cf37d52f6aac754c2b75451844fed1e82cbb
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
8 years agoUpdated some Test references to "Library RequestsLibrary"
Chaudhry Muhammad Usama [Thu, 13 Aug 2015 14:44:51 +0000 (07:44 -0700)]
Updated some Test references to "Library RequestsLibrary"

This will move all references of ../../libraries/RequestsLibrary.py to just "Library RequestsLibrary" of following
AAA
Controller
lispflowmapping
snmp
usc

Change-Id: I4c131967cd68749e75a9f5c43de9065a10aa8d65
Signed-off-by: Chaudhry Muhammad Usama <chaudhryusama@gmail.com>
8 years agochanging suite name to use .robot extension
Jamo Luhrsen [Thu, 13 Aug 2015 05:06:25 +0000 (22:06 -0700)]
changing suite name to use .robot extension

Change-Id: I285938a1ceea493c3cc12bdbcd953b07de2ec755
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
8 years agoUsing a single point of reference for DEFAULT_LINUX_PROMPT
Jamo Luhrsen [Tue, 11 Aug 2015 21:11:02 +0000 (14:11 -0700)]
Using a single point of reference for DEFAULT_LINUX_PROMPT

the idea is to have all prompts defaults come from a single place
in Variables.py.  This is only the first patch for this work.  Two
goals here:

1.  remove all local definitions of the default prompt and point
those suites/libs to use the DEFAULT_LINUX_PROMPT in Variables.py

2.  convert all default args (e.g. ${prompt}=${linux_prompt} to use
this new ${DEFAULT_LINUX_PROMPT}

future patches can be more specific and start referencing variables
not yet introduced for things like ${MININETVM0_PROMPT},
${MININETVM1_PROMPT}, ${ODLVM2_PROMPT}, etc.

Change-Id: Ic87dfb930b25b37b1e02c50750a7a2f6732b24bf
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
8 years agodefault user for verifying karaf log file should be ${CONTROLLER_USER}
Jamo Luhrsen [Wed, 12 Aug 2015 22:33:51 +0000 (15:33 -0700)]
default user for verifying karaf log file should be ${CONTROLLER_USER}

hopefully we will end up using more descriptive variables like
ODLVM1_USER, but for now CONTROLLER_USER is avaiable.  This patch
fixes a bug, where the default user for "Run Command On Remote
System" has it's default user as ${MININET_USER}.  If the
given environment has different users for the mininet and controller
VM, this keyword "Check Karaf Log File Does Not Have Messages"
ended up using ${MININET_USER} which is obviously wrong since
the karaf.log file is always going to be on the controller.

small bug, but hit me locally.

Change-Id: Id9ef26a1ac691a814e6165bd55cbf69edc3e325f
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
8 years agoAdd an all-features template to the cluster deployer.
Phillip Shea [Thu, 6 Aug 2015 23:33:49 +0000 (16:33 -0700)]
Add an all-features template to the cluster deployer.

This is to assist in local reproduction of failures in
the Jenkins continuous integration environment.

Change-Id: Iac7922b5a067b884f221d7441cbcc61c694f1eaf
Signed-off-by: Phillip Shea <phillip.shea@hp.com>
8 years agoEditing path to resources file in SFC Clustering
Tomas Cechvala [Tue, 11 Aug 2015 15:29:48 +0000 (17:29 +0200)]
Editing path to resources file in SFC Clustering

Adding CURDIR variable into resources path.

Change-Id: I69cc2f9c1de3a829c3940c7aaf9620940fa3fafd
Signed-off-by: Tomas Cechvala <tcechval@cisco.com>
8 years agoUpdate Routed RPC tests to be runnable in CI
Phillip Shea [Mon, 10 Aug 2015 21:06:37 +0000 (14:06 -0700)]
Update Routed RPC tests to be runnable in CI

Clear all data from shards before running test.
Find the leader and followers rather than assume the first controller
    is leader.
Do a better job of verifying shard contents.
Because test 23 is a subset of test 24, both tests were combined as
    test 23 and then test 24 was eliminated.

Change-Id: I63621efe814b7ab95d8990275ef14f4354698894
Signed-off-by: Phillip Shea <phillip.shea@hp.com>
8 years agoAdd Routed RPC to clustering test set.
Phillip Shea [Tue, 11 Aug 2015 19:14:07 +0000 (12:14 -0700)]
Add Routed RPC to clustering test set.

Change-Id: Iaf7165a755c1094584e01f321982d49b49252528
Signed-off-by: Phillip Shea <phillip.shea@hp.com>
8 years agoRename VtnMaKeywords.txt to VtnMaKeywords.robot
Marcus G K Williams [Mon, 10 Aug 2015 15:47:02 +0000 (08:47 -0700)]
Rename VtnMaKeywords.txt to VtnMaKeywords.robot

This facilitates identification of robot files.
All references to this file have also been updated.

Change-Id: If94f5ee4777e3750b1739a53d0c1a52156459ce6
Signed-off-by: Marcus G K Williams <Marcus.G.Williams@gmail.com>
8 years agoRename VtnCoKeywords.txt to VtnCoKeywords.robot
Marcus G K Williams [Mon, 10 Aug 2015 15:33:45 +0000 (08:33 -0700)]
Rename VtnCoKeywords.txt to VtnCoKeywords.robot

This facilitates identification of robot files.
All references to this file have also been updated.

Change-Id: I4d26b74a02997df760c37b3dfd37d4a2cdb12772
Signed-off-by: Marcus G K Williams <Marcus.G.Williams@gmail.com>
8 years agoRename FlowLib.txt to FlowLib.robot
Marcus G K Williams [Mon, 10 Aug 2015 02:24:43 +0000 (19:24 -0700)]
Rename FlowLib.txt to FlowLib.robot

This facilitates identification of robot files.
All references to this file have also been updated.

Change-Id: I234f23dd8398ca5815bb4fe0e129ba4db9d89ada
Signed-off-by: Marcus G K Williams <Marcus.G.Williams@gmail.com>
8 years agoEditing path to resource file in GBP Clustering
Tomas Cechvala [Tue, 11 Aug 2015 14:17:34 +0000 (16:17 +0200)]
Editing path to resource file in GBP Clustering

Adding CURDIR variable into resource path.

Change-Id: Ic1da0810bd0375ef83c331f705f4cd7d34866b90
Signed-off-by: Tomas Cechvala <tcechval@cisco.com>
8 years agoRename AAAKeywords.txt to AAAKeywords.robot
Marcus G K Williams [Mon, 10 Aug 2015 02:16:00 +0000 (19:16 -0700)]
Rename AAAKeywords.txt to AAAKeywords.robot

This facilitates identification of robot files.
All references to this file have also been updated.

Change-Id: I938a58ff1c9f364147391ee5805418f0b0f34c5b
Signed-off-by: Marcus G K Williams <Marcus.G.Williams@gmail.com>
8 years agoRename SwitchUtils.txt to SwitchUtils.robot
Marcus G K Williams [Mon, 10 Aug 2015 01:48:50 +0000 (18:48 -0700)]
Rename SwitchUtils.txt to SwitchUtils.robot

This facilitates identification of robot files.
All references to this file have also been updated.

Change-Id: I8f1ae8d371add9f9cb71c917d961df30c9d4f084
Signed-off-by: Marcus G K Williams <Marcus.G.Williams@gmail.com>
8 years agoModify the iotdm library and add add test cases
Cangji Wu [Wed, 3 Jun 2015 01:26:33 +0000 (21:26 -0400)]
Modify the iotdm library and add add test cases

Modfify ciotdm.py and criotdm.py to meet the requirements.
Add 5 robot files under iotdm basic folder.

Signed-off-by: Cangji Wu <canwu@cisco.com>
Signed-off-by: Jamo Luhrsen <james.luhrsen@hp.com>
Add 2 libraries and one more test suite

Criotdm is based on ciotdm. And ciotdm is based on iotdm library.
Both libraries follow pep8 and pep257.
For test suites, modify a lot of duplicate code into keyword.
Remove the invalid elapse method in test cases.
Delete the useless 020 test suite.
Comment some test cases to let all the test cases pass.
Remove unused "time" in the criotdm library.

Change-Id: Idcdd4bd378a2b92c495ee1f7f4d6cb20631582ad
Signed-off-by: Cangji Wu <canwu@cisco.com>
8 years agoRename TsdrUtils.txt to TsdrUtils.robot
Marcus G K Williams [Mon, 10 Aug 2015 01:42:14 +0000 (18:42 -0700)]
Rename TsdrUtils.txt to TsdrUtils.robot

This facilitates identification of robot files.
All references to this file have also been updated.

Change-Id: I372f113b1564d04e17a7fb6fdea201ed78337367
Signed-off-by: Marcus G K Williams <Marcus.G.Williams@gmail.com>
8 years agoRename KarafKeywords.txt to KarafKeywords.robot
Marcus G K Williams [Mon, 10 Aug 2015 01:14:39 +0000 (18:14 -0700)]
Rename KarafKeywords.txt to KarafKeywords.robot

This facilitates identification of robot files.
All references to this file have also been updated.

Change-Id: Id97489020199b54b3657a54c4452af1de3453814
Signed-off-by: Marcus G K Williams <Marcus.G.Williams@gmail.com>
8 years agobulk support proposal
Michal Rehak [Fri, 12 Jun 2015 18:01:07 +0000 (20:01 +0200)]
bulk support proposal

 - support only flows add (through dataStore or direct rpc)
 - depends on https://git.opendaylight.org/gerrit/22692
 - cosmetics
 - added missing docs

Change-Id: I3729ad0930777b53cb2b9b047455ea192c82caa0
Signed-off-by: Michal Rehak <mirehak@cisco.com>
(cherry picked from commit 74d009aae88c0c062dde45a40b9b6ec93ba58105)

8 years agoRename Scalability.txt to Scalability.robot
Marcus G K Williams [Fri, 7 Aug 2015 16:37:35 +0000 (09:37 -0700)]
Rename Scalability.txt to Scalability.robot

This facilitates identification of robot files.
All references to this file have also been updated.

Change-Id: If0fbdf430a5356117d1f2baa071ec0b1b50eef21
Signed-off-by: Marcus G K Williams <Marcus.G.Williams@gmail.com>
8 years agoRename Utils.txt to Utils.robot.
Phillip Shea [Fri, 7 Aug 2015 00:51:43 +0000 (17:51 -0700)]
Rename Utils.txt to Utils.robot.

This will make it easier to identify robot files.
All references to this file have been updated, too.

Change-Id: I7e2a16875f0d206793deaafff8982e221764ecdb
Signed-off-by: Phillip Shea <phillip.shea@hp.com>
8 years agoRename ClusterKeywords.txt to ClusterKeywords.robot.
Phillip Shea [Fri, 7 Aug 2015 00:36:57 +0000 (17:36 -0700)]
Rename ClusterKeywords.txt to ClusterKeywords.robot.

This will make it easier to identify robot files.
All references to this file have been updated, too.

Change-Id: I7af63b59ef0f0d40e0dbbc7cf13eeeafbb3f0393
Signed-off-by: Phillip Shea <phillip.shea@hp.com>
8 years agotestplan for openflowplugin clustering jobs
Jamo Luhrsen [Thu, 6 Aug 2015 20:58:27 +0000 (13:58 -0700)]
testplan for openflowplugin clustering jobs

Change-Id: I55f79485760fc649e5bfb9e2a05daed1d04bfdc7
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
8 years agoUpdate Cluster State Library to report all states.
Phillip Shea [Fri, 24 Jul 2015 22:24:02 +0000 (15:24 -0700)]
Update Cluster State Library to report all states.

Change-Id: Id354bbf9c9f717b1c4952386d4464ddd4d4670b9
Signed-off-by: Phillip Shea <phillip.shea@hp.com>
8 years agoImplemented idmlite REST tests. Added library to support tests.
carmen.w.kelling [Thu, 25 Jun 2015 22:04:10 +0000 (15:04 -0700)]
Implemented idmlite REST tests.  Added library to support tests.

Change-Id: Ic23ff08394e8b048b1b12a49dbf158210d9601bf
Signed-off-by: carmen.w.kelling <carmen.w.kelling@hp.com>
8 years agoFix output in the expected INTENT rules
carmen.w.kelling [Tue, 4 Aug 2015 21:00:12 +0000 (14:00 -0700)]
Fix output in the expected INTENT rules

Change-Id: I8445b4ae051af39fcc37f75604c253d817d7081f
Signed-off-by: carmen.w.kelling <carmen.w.kelling@hp.com>
8 years agoSimple 3-node clustering for SFC
Tomas Cechvala [Tue, 4 Aug 2015 09:42:39 +0000 (11:42 +0200)]
Simple 3-node clustering for SFC

Data are written into one node and read from the other.

Change-Id: Ie8c496f446088a3f7d0eb55716474684bd351058
Signed-off-by: Tomas Cechvala <tcechval@cisco.com>
8 years agoSimple 3-node clustering for GBP
Tomas Cechvala [Mon, 3 Aug 2015 13:54:33 +0000 (15:54 +0200)]
Simple 3-node clustering for GBP

Data are written to one node and read from the other.

Change-Id: Ie314d150e43886c99570d745743ea204f3fbbe05
Signed-off-by: Tomas Cechvala <tcechval@cisco.com>
8 years agolongevity testplan for openflowplugin lithium redesign
Jamo Luhrsen [Wed, 5 Aug 2015 20:00:44 +0000 (13:00 -0700)]
longevity testplan for openflowplugin lithium redesign

Change-Id: I61665f5326e62dde8707331f2997a7b93ca5dc1f
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
8 years agoConverting sleep into a working WUKS
Kailash Khalasi [Mon, 27 Jul 2015 22:25:25 +0000 (15:25 -0700)]
Converting sleep into a working WUKS

Change-Id: If879abacaee5229391c1e1e02d23b8f56bc46ff0
Signed-off-by: Kailash Khalasi <kkhalasi@iix.net>
8 years agoMove new Clustering Keywords
Phillip Shea [Fri, 24 Jul 2015 17:54:30 +0000 (10:54 -0700)]
Move new Clustering Keywords

Move new clustering keywords from utils.txt to ClusteringKeywords.txt.
Also ran Tidy on all affected files.

Change-Id: I6174deefef5e15ab0ef18d5cf544fd2a26a16c98
Signed-off-by: Phillip Shea <phillip.shea@hp.com>
8 years agoAdding simple script to create Robot testsuite and library documents
Kailash Khalasi [Tue, 21 Jul 2015 16:55:21 +0000 (09:55 -0700)]
Adding simple script to create Robot testsuite and library documents

Change-Id: I3eef3597903da4534b67825b00af15de98d309ee
Signed-off-by: Kailash Khalasi <kkhalasi@iix.net>
8 years agomoving special update test case from tools to csit
Peter Gubka [Wed, 29 Jul 2015 09:16:05 +0000 (11:16 +0200)]
moving special update test case from tools to csit

library update had to be done too

Change-Id: Ibfc0637fa450daecb01469d3a5ecc74fe1205ea8
Signed-off-by: Peter Gubka <pgubka@cisco.com>
8 years agomoving a simple test for 3 node ofp cluster from tools to csit
Peter Gubka [Fri, 10 Jul 2015 11:49:48 +0000 (13:49 +0200)]
moving a simple test for 3 node ofp cluster from tools to csit

DynamicMininet - adding functions to start switch(es) with multiple controllers
XmlComparator - added function to create flow xml content
removing unused code
minor improvements to robot, replacing urls with variables

Change-Id: I6c641217c5713450c932d065df0cd4b4d2a7da79
Signed-off-by: Peter Gubka <pgubka@cisco.com>
8 years agoSuite bgpuser: Return normalized jsons, so that comparison works.
Vratko Polak [Wed, 29 Jul 2015 10:16:51 +0000 (12:16 +0200)]
Suite bgpuser: Return normalized jsons, so that comparison works.

Change-Id: I19ddcac10ad1e0ad1c6c7d59da2d51aebfbf2f99
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 8fa86e2df7234b119cf8db5a1f52d117be0820b0)

8 years agosourcing global Variables.py to get ${SSH_KEY} release/helium-sr4
Jamo Luhrsen [Thu, 23 Jul 2015 18:04:52 +0000 (11:04 -0700)]
sourcing global Variables.py to get ${SSH_KEY}

Change-Id: I7e9f92d59b27dfa1a296e250ac6684fc91041a46
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
(cherry picked from commit 613fa2bb3aff13c8d2cc8a978f0638fbab36cc88)

8 years agoCurrently, the addCar and addPerson methods create multiple cars/people in tight...
Shaleen Saxena [Wed, 22 Jul 2015 15:32:57 +0000 (08:32 -0700)]
Currently, the addCar and addPerson methods create multiple cars/people in tight loops. These
loops do not check the results of the individual post operations. In case of cluster failures,
each post operation may take up to 5 minutes to timeout. Hence, these loops could take many
hours to complete.

The fix is to add an additional 'expected' parameter to these methods. This is a list of possible
results expected by the post operation. If any post operation does not match any of the 'expected'
values, then the loop will exit and raise an exception. This way the loop will wait for only
few minutes instead of hours.

Please note that this 'expected' parameter is optional. If it is not provided, then the old
behavior is preserved.

The other changes are to pass the expected values from various AddCar and AddPerson test cases.

Change-Id: I7375979de90f64c3ce70cfe4f3f6634d0aeac8e2
Signed-off-by: Shaleen Saxena <ssaxena@brocade.com>
8 years agoAdded verification of the OpenFlow controller connection.
Gabriel Robitaille-Montpetit [Wed, 8 Jul 2015 19:16:00 +0000 (15:16 -0400)]
Added verification of the OpenFlow controller connection.

Change-Id: I6be5feab01510a49b251ef63b4ed50a03b22408b
Signed-off-by: Gabriel Robitaille-Montpetit <grmontpetit@inocybe.com>
8 years agoMaking ssh key configurable in all tests. ${SSH_KEY} variable placed in variables...
Kailash Khalasi [Thu, 16 Jul 2015 17:59:45 +0000 (10:59 -0700)]
Making ssh key configurable in all tests. ${SSH_KEY} variable placed in variables.py (default is id_rsa)

Change-Id: I8baf760ad1b331129ea430ff53d344c4686fbbba
Signed-off-by: Kailash Khalasi <kkhalasi@iix.net>
8 years agoVerify the ovs manager is connected.
Gabriel Robitaille-Montpetit [Wed, 8 Jul 2015 17:45:45 +0000 (13:45 -0400)]
Verify the ovs manager is connected.

Change-Id: I5889ca1cea35b8b1e535774544117303081cd4be
Signed-off-by: Gabriel Robitaille-Montpetit <grmontpetit@inocybe.com>
8 years agoChanged the directory name and added checking for persistence dependencies.
Linh Pham [Thu, 16 Jul 2015 21:12:17 +0000 (14:12 -0700)]
Changed the directory name and added checking for persistence dependencies.

Change-Id: I9d9d6ffad42994d58fde279ae82560cc1b14215b
Signed-off-by: Linh Pham <linh.pham@hp.com>
8 years agoThe following changes are made to clustering datastore tests:
Shaleen Saxena [Fri, 17 Jul 2015 20:56:38 +0000 (13:56 -0700)]
The following changes are made to clustering datastore tests:
 - "BuyCar" now raises an exception instead of returning True/False. Robot
   framework does not fail test on returning False. Exceptions are the
   correct way to return failure. This fixes the issue where routed RPC
   registrations hadn't been "gossiped" yet to follower1, and testcase
   did not retry because "BuyCar" hadn't failed with exception. The testcase
   is "Purchase cars on Follower1" in 010_crud_on_leader.robot. The change
   is in CrudLibrary.py.

 - "Get Leader" and "Get All Followers" now ignore any down controllers.
   The controller to ignore is passed in as an argument. Before this fix,
   "getClusterRoles" would repeatedly try to read from the downed node,
   which would cause unnecssary delays. With this fix the test cases have
   speeded up considerably. The change is in ClusterKeywords.txt,
   030_car_failover_crud_on_new_leader.robot, and
   040_people_failover_crud_on_new_leader.robot

 - Fixed a path issue in 010_crud_on_leader.robot. I would see warnings from
   robot for missing RequestsLibrary.

Change-Id: Ia72e164d667121edb3aced2f8ec6bc1c504afe5a
Signed-off-by: Shaleen Saxena <ssaxena@brocade.com>
8 years agoRename Stop Mininet keyword to Stop Mininet Simulation
Luis Gomez [Sun, 19 Jul 2015 18:49:16 +0000 (11:49 -0700)]
Rename Stop Mininet keyword to Stop Mininet Simulation

Stop Mininet keyword is reserved for more global use in Utils.txt

Change-Id: Ib14a8b52fdf9331471a8d2c933af23dead2f8184
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
8 years agoBasic Test suite to Test the VXLAN Functionality
Chaudhry Muhammad Usama [Wed, 1 Jul 2015 21:13:11 +0000 (14:13 -0700)]
Basic Test suite to Test the VXLAN Functionality

Change-Id: Ic4c1552a4e4bb43b17d1ae62f3708280dc7791f7
Signed-off-by: Chaudhry Muhammad Usama <chaudhryusama@gmail.com>
8 years agoChange the clustering test plan to run exactly what is required
Luis Gomez [Tue, 14 Jul 2015 18:52:22 +0000 (11:52 -0700)]
Change the clustering test plan to run exactly what is required

This will save test time in CI sepecially in the -all- test.

Change-Id: I79d21d751195ea6bce090683b34ea8cea4f34acf
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
8 years agoInitial commit for Persistence Test App
Linh Pham [Mon, 13 Jul 2015 22:08:44 +0000 (15:08 -0700)]
Initial commit for Persistence Test App

Change-Id: Ic3fdc929657f87728f2c2dff7901269a7f7892e4
Signed-off-by: Linh Pham <linh.pham@hp.com>
8 years agoModify Longevity test to include only switch scalability test
Luis Gomez [Thu, 9 Jul 2015 03:51:19 +0000 (20:51 -0700)]
Modify Longevity test to include only switch scalability test

host scalability involves l2switch (not openflowplugin)

link scalability test is not stable yet

Change-Id: Ib55ff63aad1fe7d6c1cf73fa0974f458b27fe412
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
(cherry picked from commit 94f790d2334fa0cc56f12b876fc9b62278c40efa)

Change-Id: I9b014830bf49cd9731926d478c842c575f60caf7
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
8 years agoTest suite to configure hosts on 2 switches for vpnservice
Sindhuri [Mon, 29 Jun 2015 13:19:08 +0000 (06:19 -0700)]
Test suite to configure hosts on 2 switches for vpnservice

Signed-off-by: Sindhuri <sindhuri.b@ericsson.com>
Change-Id: Ib8d13afffccdc62e4cc5ca416660460afa46ccf5

8 years agoInitial Docker Library for Robot
Marcus G K Williams [Wed, 10 Jun 2015 00:12:47 +0000 (16:12 -0800)]
Initial Docker Library for Robot

Wrapper for Docker-py to allow use in Robot System Tests

Change-Id: Iceaa48a42fbbee804039dbfa153737734e03fb66
Signed-off-by: Marcus G K Williams <Marcus.G.Williams@gmail.com>
8 years agoUpdate clustering tests for Continuous Integration
Phillip Shea [Mon, 22 Jun 2015 22:38:55 +0000 (15:38 -0700)]
Update clustering tests for Continuous Integration

Moved clustering tests to controller directory.

Replaced ${PORT} with ${RESTCONFPORT} in call to Wait For Controller Up.

This commit is a re-try of the following commit:
https://git.opendaylight.org/gerrit/#/c/23001/

It adds KEYFILE_PASS to variables.py
and then puts KEYFILE_PASS into
Run Command On Remote System.

It also contains the following from the
previous commit attempt:
    Change global variables to match those used in CI
    All ssh sign-ins now use certificates rather than passwords
    Remove Sleeps where possible.
    Move repeated variables into variables.py.
    Move repeated keywords into libraries.

Change-Id: Iacb328c89abe35d8c57eac4b4d081ff219b2e8b5
Signed-off-by: Phillip Shea <phillip.shea@hp.com>
8 years agoAdd openflow longevity testplan
Luis Gomez [Thu, 9 Jul 2015 00:16:30 +0000 (17:16 -0700)]
Add openflow longevity testplan

Change-Id: I7b4b43062063a8101a050d1cdcec6cfa9ade5847
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
8 years agoBug 3330 - Add System Tests for GBP
Ruijing Guo [Wed, 24 Jun 2015 07:35:07 +0000 (07:35 +0000)]
Bug 3330 - Add System Tests for GBP

Change-Id: I0219761e915c0f38bbc01a0e6f9a813c781e2d5a
Signed-off-by: Ruijing Guo <ruijing.guo@intel.com>
8 years agoEnsure netvirt is loaded before executing the remaining tests cases.
Gabriel Robitaille-Montpetit [Thu, 2 Jul 2015 16:44:27 +0000 (12:44 -0400)]
Ensure netvirt is loaded before executing the remaining tests cases.

Change-Id: I5af54a00b68f98a93a874cc5ba407f6c6c27b29b
Signed-off-by: Gabriel Robitaille-Montpetit <grmontpetit@inocybe.com>
8 years agoadding teardown part to log the ovs content
Peter Gubka [Wed, 8 Jul 2015 08:54:06 +0000 (10:54 +0200)]
adding teardown part to log the ovs content

Change-Id: I4a4eec94c778983a690636947b992ea7a5e6aaa0
Signed-off-by: Peter Gubka <pgubka@cisco.com>
8 years agogiving more time for He designed ofp to collect stats
Peter Gubka [Wed, 8 Jul 2015 10:27:31 +0000 (12:27 +0200)]
giving more time for He designed ofp to collect stats

Li designed plugin works well even with this setup
this has impact on *-sw-scalability-daily* jobs, better
result are expected

Change-Id: If23370cf5dbd2edeb50441016c222ba0cb65d1bb
Signed-off-by: Peter Gubka <pgubka@cisco.com>
8 years agoCorrect test case with the right html response code.
Gabriel Robitaille-Montpetit [Tue, 7 Jul 2015 18:45:16 +0000 (14:45 -0400)]
Correct test case with the right html response code.

Change-Id: I395e922e6ed32a2e862dfecdcbfcdd69038bbd5f
Signed-off-by: Gabriel Robitaille-Montpetit <grmontpetit@inocybe.com>
8 years agoScript to test MD-SAL datastore read performance.
Gary Wu [Wed, 1 Jul 2015 18:49:16 +0000 (11:49 -0700)]
Script to test MD-SAL datastore read performance.

Add a new script to test MD-SAL clustering datastore
read performance.  It will iterate through a list
of controller nodes and repeatedly retrieve flows
previously populated by flow_config_blaster.py.

Change-Id: I76ff6e7f837b268fff5db1f11b340353a220580b
Signed-off-by: Gary Wu <Gary.Wu1@huawei.com>
8 years agoIntroduce a Clean up OVS utility to use in Robot.
Gabriel Robitaille-Montpetit [Thu, 2 Jul 2015 15:26:22 +0000 (11:26 -0400)]
Introduce a Clean up OVS utility to use in Robot.

Change-Id: If2925ba1d9ea2eacdec6e7f76bdd0241ddf8b66a
Signed-off-by: Gabriel Robitaille-Montpetit <grmontpetit@inocybe.com>
8 years agominor improvement to be able to run the script from any location
Peter Gubka [Tue, 7 Jul 2015 10:21:52 +0000 (12:21 +0200)]
minor improvement to be able to run the script from any location

Change-Id: Ice274084144499f4fdab4e3fdcb360e59f2204c3
Signed-off-by: Peter Gubka <pgubka@cisco.com>
8 years agoRemove duplicated test plan for ovsdb souhtound.
Alexis de Talhouët [Fri, 3 Jul 2015 16:17:00 +0000 (12:17 -0400)]
Remove duplicated test plan for ovsdb souhtound.

One is declared here [1] and is used for csit, the other declared here [2]
isn't used. Thus this patch deletes [2]

[1] https://github.com/opendaylight/integration/blob/master/test/csit/testplans/ovsdb-southbound.txt
[2] https://github.com/opendaylight/integration/blob/master/test/csit/testplans/ovsdb-sbplugin.txt

Change-Id: I6f444b7e203364801af1d8993df0701e545d3194
Signed-off-by: Alexis de Talhouët <adetalhouet@inocybe.com>
8 years agonew robot to measure flow setup rate using add-flows-ds
Peter Gubka [Thu, 2 Jul 2015 12:38:47 +0000 (14:38 +0200)]
new robot to measure flow setup rate using add-flows-ds

- unifying performance suites and minor imrovements
- 090_BulkMaticConfigDsSetup_100k.robot - new robot
- 080_Rpc_100k_Flows_Configuration_Time_Measure.robot - adding rate to csv file
- 070_Stats_Collection_100k_WithMininetRestart.robot - adding rate to csv file
- new tesplan files

Change-Id: I1e812c8a21088907054128c328a83b08bea4bac7
Signed-off-by: Peter Gubka <pgubka@cisco.com>
8 years agoadding a new suite for new rpc calls
Peter Gubka [Wed, 20 May 2015 12:32:47 +0000 (14:32 +0200)]
adding a new suite for new rpc calls

Change-Id: Id5c0a83c0718fb783f61c19e6b22dff1e7154a25
Signed-off-by: Peter Gubka <pgubka@cisco.com>
8 years agoFix Failure to launch vtn coordinator
gvrangan [Tue, 23 Jun 2015 04:38:51 +0000 (13:38 +0900)]
Fix Failure to launch vtn coordinator

     * Excluded all cases other than add/remove controller
     * Fixed the installation of VTN coordinator

Change-Id: I76745303f3cb5847d5d55cb710cd89814b4115e6
Signed-off-by: gvrangan <venkatrangang@hcl.com>
8 years agoenlarging timeout
Peter Gubka [Thu, 2 Jul 2015 09:45:53 +0000 (11:45 +0200)]
enlarging timeout

when lots of switches are connected sometimes it takes more than 15s
for http response to be available and the keyword then runs only once
and we want more

Change-Id: Icb5438730be036f3afefffd96fff19066eb861e8
Signed-off-by: Peter Gubka <pgubka@cisco.com>
8 years agoFixed prompt issue on Run Command on Remove System procedure
mahesh.manivasagam [Thu, 2 Jul 2015 05:42:18 +0000 (11:12 +0530)]
Fixed prompt issue on Run Command on Remove System procedure

Change-Id: I2c09b55630cc097e27d85f936c94a2da526b92ff
Signed-off-by: mahesh.manivasagam <mahesh_manivasagam@dell.com>
8 years agonew robot suite which will measure a time to setup flows using rpcs
Peter Gubka [Tue, 30 Jun 2015 13:17:44 +0000 (15:17 +0200)]
new robot suite which will measure a time to setup flows using rpcs

http request sent contains a list of flows to be set up, parralel
https connections should make ofp as busy as possible

testplan files created for the jobs

to mbe merged after https://git.opendaylight.org/gerrit/#/c/23511/

Change-Id: I26450a0b5b8d896c5ed57ad9143f94121bc89ac1
Signed-off-by: Peter Gubka <pgubka@cisco.com>
8 years agoFixed Bug 2429 Verification CI
Jamo Luhrsen [Thu, 25 Jun 2015 18:14:17 +0000 (11:14 -0700)]
Fixed Bug 2429 Verification CI

the initial test was unable to pull the thread count of the controller
*after* running the DOS attack with the 'nc' tool.  Changing from the
Run command to the "Start Process" keyword helps with that.

Also added a few extra debug outputs that may help in the event this
test fails.

Change-Id: I8c34c75c85a4c8ea781a8a0c1d13f8ae4b664fff
Signed-off-by: Jamo Luhrsen <jluhrsen@gmail.com>