Removed testplans and suites for tsdr project.
JIRA: INTTEST-140
Change-Id: I484c40f47bd822f7b04161b2679917758f86a51e
Signed-off-by: Oleksandr Zharov <oleksandr.zharov@pantheon.tech>
[Documentation] Verifies all plugin data about Onem2mExample provider module plugin
Verify RPC Plugin Data onem2m_example/filtered
-1.06 Plugin data of TSDR - filtered
- [Documentation] Verifies all plugin data about Onem2mExample provider module plugin
- Verify RPC Plugin Data tsdr/filtered
-
-1.07 Plugin data of SimpleAdapter - filtered
+1.06 Plugin data of SimpleAdapter - filtered
[Documentation] Verifies all plugin data about Onem2mExample provider module plugin
Verify RPC Plugin Data simple_adapter/filtered
[Documentation] Verifies the result of RPC and looks for Onem2mExample registration
Verify RPC Db Registrations onem2m_example/filtered
-3.00.02 Default result of onem2m-plugin-manager-db-api-client-registrations RPC - TSDR
- [Documentation] Verifies the result of RPC and looks for TSDR registration
- Verify RPC Db Registrations tsdr/default
-
-3.00.03 Default result of onem2m-plugin-manager-db-api-client-registrations RPC - SimpleAdapter
+3.00.02 Default result of onem2m-plugin-manager-db-api-client-registrations RPC - SimpleAdapter
[Documentation] Verifies the result of RPC and looks for SimpleAdapter registration
Verify RPC Db Registrations simple_adapter/default
[Documentation] Verifies result of RPC with input filter for Onem2mExample
Verify RPC Db Registrations onem2m_example/filtered
-3.01.01 Default result of onem2m-plugin-manager-db-api-client-registrations RPC - filtered TSDR
- [Documentation] Verifies result of RPC with input filter for TSDR
- Verify RPC Db Registrations tsdr/filtered
-
-3.01.02 Default result of onem2m-plugin-manager-db-api-client-registrations RPC - filtered SimpleAdapter
+3.01.01 Default result of onem2m-plugin-manager-db-api-client-registrations RPC - filtered SimpleAdapter
[Documentation] Verifies result of RPC with input filter for SimpleAdapter
Verify RPC Db Registrations simple_adapter/filtered
Verify RPC Plugin Data mqtt/default
Verify RPC Plugin Data ws/default
Verify RPC Plugin Data onem2m_example/default
- Verify RPC Plugin Data tsdr/default
Verify RPC Plugin Data simple_adapter/default
Verify PluginData After Reconfiguration of HTTP
+++ /dev/null
-*** Settings ***
-Documentation Test suite for Cassandra DataStore PortStats Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library RequestsLibrary
-Library ../../../libraries/Common.py
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-@{INTERFACE_METRICS}
-... TransmittedPackets
-... TransmittedBytes
-... TransmitErrors
-... TransmitDrops
-... ReceivedPackets
-... ReceivedBytes
-... ReceiveOverRunError
-... ReceiveFrameError
-... ReceiveErrors
-... ReceiveDrops
-... ReceiveCrcError
-... CollisionCount
-${root_path} flow-capable-node-connector-statistics
-@{xpath}
-... ${root_path}/packets/transmitted
-... ${root_path}/bytes/transmitted
-... ${root_path}/transmit-errors
-... ${root_path}/transmit-drops
-... ${root_path}/packets/received
-... ${root_path}/bytes/received
-... ${root_path}/receive-over-run-error
-... ${root_path}/receive-frame-error
-... ${root_path}/receive-errors
-... ${root_path}/receive-drops
-... ${root_path}/receive-crc-error
-... ${root_path}/collision-count
-@{CATEGORY} FlowStats FlowTableStats PortStats QueueStats
-${TSDR_PORTSTATS} tsdr:list PortStats
-${metric_path} metric_path
-${metric_val} metric_val
-@{xml_list}
-@{tsdr_list}
-
-
-*** Test Cases ***
-Verification of TSDR Cassandra Feature Installation
- [Documentation] Install and Verify the TSDR Cassandra Features
- COMMENT Install a Feature odl-tsdr-cassandra-all ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 60
- Wait Until Keyword Succeeds 24x 10 sec Check Karaf Log Has Messages tsdr.openflow
- Verify Feature Is Installed odl-tsdr-cassandra
- Verify Feature Is Installed odl-tsdr-openflow-statistics-collector
- Start Tsdr Suite
- Ping All Hosts
- Wait Until Keyword Succeeds 5x 30 sec Check Metric val \\d{5}
-
-Storing Statistics from Openflow REST
- [Documentation] Store openflow PortStats metrics using REST.
- FOR ${item} IN @{xpath}
- ${ret_val}= Set Variable -1
- ${ret_val}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:1/node-connector/openflow:1:1 ${item}
- Append To List ${xml_list} ${ret_val}
- ${ret_val}= Set Variable -1
- ${ret_val}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:1/node-connector/openflow:1:2 ${item}
- Append To List ${xml_list} ${ret_val}
- ${ret_val}= Set Variable -1
- ${ret_val}= Get Stats XML
- ... ${OPERATIONAL_NODES_API}/node/openflow:1/node-connector/openflow:1:LOCAL
- ... ${item}
- Append To List ${xml_list} ${ret_val}
- ${ret_val}= Set Variable -1
- ${ret_val}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:2/node-connector/openflow:2:1 ${item}
- Append To List ${xml_list} ${ret_val}
- ${ret_val}= Set Variable -1
- ${ret_val}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:2/node-connector/openflow:2:2 ${item}
- Append To List ${xml_list} ${ret_val}
- ${ret_val}= Set Variable -1
- ${ret_val}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:2/node-connector/openflow:2:3 ${item}
- Append To List ${xml_list} ${ret_val}
- ${ret_val}= Set Variable -1
- ${ret_val}= Get Stats XML
- ... ${OPERATIONAL_NODES_API}/node/openflow:2/node-connector/openflow:2:LOCAL
- ... ${item}
- Append To List ${xml_list} ${ret_val}
- ${ret_val}= Set Variable -1
- ${ret_val}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:3/node-connector/openflow:3:1 ${item}
- Append To List ${xml_list} ${ret_val}
- ${ret_val}= Set Variable -1
- ${ret_val}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:3/node-connector/openflow:3:2 ${item}
- Append To List ${xml_list} ${ret_val}
- ${ret_val}= Set Variable -1
- ${ret_val}= Get Stats XML
- ... ${OPERATIONAL_NODES_API}/node/openflow:3/node-connector/openflow:3:LOCAL
- ... ${item}
- Append To List ${xml_list} ${ret_val}
- ${ret_val}= Set Variable -1
- END
- Log List ${xml_list}
-
-Verification of InterfaceMetrics-Attributes on Cassandra Client
- [Documentation] Verify the InterfaceMetrics has been updated on Cassandra Data Store
- Copy TSDR tables
- FOR ${list} IN @{INTERFACE_METRICS}
- ${ret_val1}= Extract From DB Table
- ... grep NID=openflow:1 | grep DC=PORTSTATS | grep MN=${list} | grep RK=Node:openflow:1,NodeConnector:openflow:1:1
- Append To List ${tsdr_list} ${ret_val1}
- ${ret_val1}= Extract From DB Table
- ... grep NID=openflow:1 | grep DC=PORTSTATS | grep MN=${list} | grep RK=Node:openflow:1,NodeConnector:openflow:1:2
- Append To List ${tsdr_list} ${ret_val1}
- ${ret_val1}= Extract From DB Table
- ... grep NID=openflow:1 | grep DC=PORTSTATS | grep MN=${list} | grep RK=Node:openflow:1,NodeConnector:openflow:1:LOCAL
- Append To List ${tsdr_list} ${ret_val1}
- ${ret_val1}= Extract From DB Table
- ... grep NID=openflow:2 | grep DC=PORTSTATS | grep MN=${list} | grep RK=Node:openflow:2,NodeConnector:openflow:2:1
- Append To List ${tsdr_list} ${ret_val1}
- ${ret_val1}= Extract From DB Table
- ... grep NID=openflow:2 | grep DC=PORTSTATS | grep MN=${list} | grep RK=Node:openflow:2,NodeConnector:openflow:2:2
- Append To List ${tsdr_list} ${ret_val1}
- ${ret_val1}= Extract From DB Table
- ... grep NID=openflow:2 | grep DC=PORTSTATS | grep MN=${list} | grep RK=Node:openflow:2,NodeConnector:openflow:2:3
- Append To List ${tsdr_list} ${ret_val1}
- ${ret_val1}= Extract From DB Table
- ... grep NID=openflow:2 | grep DC=PORTSTATS | grep MN=${list} | grep RK=Node:openflow:2,NodeConnector:openflow:2:LOCAL
- Append To List ${tsdr_list} ${ret_val1}
- ${ret_val1}= Extract From DB Table
- ... grep NID=openflow:3 | grep DC=PORTSTATS | grep MN=${list} | grep RK=Node:openflow:3,NodeConnector:openflow:3:1
- Append To List ${tsdr_list} ${ret_val1}
- ${ret_val1}= Extract From DB Table
- ... grep NID=openflow:3 | grep DC=PORTSTATS | grep MN=${list} | grep RK=Node:openflow:3,NodeConnector:openflow:3:2
- Append To List ${tsdr_list} ${ret_val1}
- ${ret_val1}= Extract From DB Table
- ... grep NID=openflow:3 | grep DC=PORTSTATS | grep MN=${list} | grep RK=Node:openflow:3,NodeConnector:openflow:3:LOCAL
- Append To List ${tsdr_list} ${ret_val1}
- END
-
-Comparing Mertics
- [Documentation] Compare openflow Interface metrics between data collected from openflow Plugin and TSDR
- FOR ${xml_val} ${tsdr_val} IN ZIP ${xml_list} ${tsdr_list}
- Compare Tsdr XML Metrics ${xml_val} ${tsdr_val} 20
- END
-
-
-*** Keywords ***
-Extract From DB Table
- [Documentation] Extract from metricpath table and return the value
- [Arguments] ${pattern}
- ${ret_val1}= Set Variable -100
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client ${pattern}
- RETURN ${ret_val1}
+++ /dev/null
-*** Settings ***
-Documentation Test suite for Cassandra DataStore Flow Stats Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Initialize the Tsdr Suite
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-@{FLOW_METRICS} PacketCount ByteCount
-${TSDR_FLOWSTATS} tsdr:list FlowStats
-${packet_count} flow/flow-statistics/packet-count
-${byte_count} flow/flow-statistics/byte-count
-@{tsdr_op1}
-@{tsdr_op2}
-@{tsdr_op3}
-@{tsdr_op1_pc}
-@{tsdr_op2_pc}
-@{tsdr_op3_pc}
-@{tsdr_op1_bc}
-@{tsdr_op2_bc}
-@{tsdr_op3_bc}
-
-
-*** Test Cases ***
-Verification of TSDR Cassandra Feature Installation
- [Documentation] Install and Verify the TSDR Cassandra Features
- Verify Feature Is Installed odl-tsdr-cassandra
- Verify Feature Is Installed odl-tsdr-openflow-statistics-collector
- Start Tsdr Suite
- Ping All Hosts
- Wait Until Keyword Succeeds 5x 30 sec Check Metric val \\d{5}
-
-Getting all Tables from Openflow Plugin
- [Documentation] Getting Flowstats from openflow plugin
- @{openflow_1}= Return all XML matches ${OPERATIONAL_NODES_API}/node/openflow:1/table/0/ flow/id
- @{openflow_2}= Return all XML matches ${OPERATIONAL_NODES_API}/node/openflow:2/table/0/ flow/id
- @{openflow_3}= Return all XML matches ${OPERATIONAL_NODES_API}/node/openflow:3/table/0/ flow/id
- Set Suite Variable @{openflow_1}
- Set Suite Variable @{openflow_2}
- Set Suite Variable @{openflow_3}
- @{openflow_1_packetcount}= Return all XML matches
- ... ${OPERATIONAL_NODES_API}/node/openflow:1/table/0/
- ... ${packet_count}
- @{openflow_2_packetcount}= Return all XML matches
- ... ${OPERATIONAL_NODES_API}/node/openflow:2/table/0/
- ... ${packet_count}
- @{openflow_3_packetcount}= Return all XML matches
- ... ${OPERATIONAL_NODES_API}/node/openflow:3/table/0/
- ... ${packet_count}
- Set Suite Variable @{openflow_1_packetcount}
- Set Suite Variable @{openflow_2_packetcount}
- Set Suite Variable @{openflow_3_packetcount}
- @{openflow_1_bytecount}= Return all XML matches
- ... ${OPERATIONAL_NODES_API}/node/openflow:1/table/0/
- ... ${byte_count}
- @{openflow_2_bytecount}= Return all XML matches
- ... ${OPERATIONAL_NODES_API}/node/openflow:2/table/0/
- ... ${byte_count}
- @{openflow_3_bytecount}= Return all XML matches
- ... ${OPERATIONAL_NODES_API}/node/openflow:3/table/0/
- ... ${byte_count}
- Set Suite Variable @{openflow_1_bytecount}
- Set Suite Variable @{openflow_2_bytecount}
- Set Suite Variable @{openflow_3_bytecount}
-
-Verification of FlowStats-Attributes on Cassandra Data Store
- [Documentation] Verify the InterfaceMetrics has been updated on Cassandra Data Store
- Copy TSDR tables
- FOR ${flow} IN @{openflow_1}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:1 | grep DC=FLOWSTATS | grep MN=PacketCount | grep -F 'RK=Node:openflow:1,Table:0,Flow:${flow}'
- Append To List ${tsdr_op1_pc} ${ret_val1}
- END
- FOR ${flow} IN @{openflow_2}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:2 | grep DC=FLOWSTATS | grep MN=PacketCount | grep -F 'RK=Node:openflow:2,Table:0,Flow:${flow}'
- Append To List ${tsdr_op2_pc} ${ret_val1}
- END
- FOR ${flow} IN @{openflow_3}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:3 | grep DC=FLOWSTATS | grep MN=PacketCount | grep -F 'RK=Node:openflow:3,Table:0,Flow:${flow}'
- Append To List ${tsdr_op3_pc} ${ret_val1}
- END
- FOR ${flow} IN @{openflow_1}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:1 | grep DC=FLOWSTATS | grep MN=ByteCount | grep -F 'RK=Node:openflow:1,Table:0,Flow:${flow}'
- Append To List ${tsdr_op1_bc} ${ret_val1}
- END
- FOR ${flow} IN @{openflow_2}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:2 | grep DC=FLOWSTATS | grep MN=ByteCount | grep -F 'RK=Node:openflow:2,Table:0,Flow:${flow}'
- Append To List ${tsdr_op2_bc} ${ret_val1}
- END
- FOR ${flow} IN @{openflow_3}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:3 | grep DC=FLOWSTATS | grep MN=ByteCount | grep -F 'RK=Node:openflow:3,Table:0,Flow:${flow}'
- Append To List ${tsdr_op3_bc} ${ret_val1}
- END
- Set Suite Variable @{tsdr_op1_pc}
- Set Suite Variable @{tsdr_op2_pc}
- Set Suite Variable @{tsdr_op3_pc}
- Set Suite Variable @{tsdr_op1_bc}
- Set Suite Variable @{tsdr_op2_bc}
- Set Suite Variable @{tsdr_op3_bc}
-
-Comparing Packet Count Metrics
- [Documentation] Comparing Packet count values between Cassandra and openflow plugin
- FOR ${xml_val} ${tsdr_val} IN ZIP ${openflow_1_packetcount} ${tsdr_op1_pc}
- Compare Tsdr XML Metrics ${xml_val} ${tsdr_val} 20
- END
- FOR ${xml_val} ${tsdr_val} IN ZIP ${openflow_2_packetcount} ${tsdr_op2_pc}
- Compare Tsdr XML Metrics ${xml_val} ${tsdr_val} 20
- END
- FOR ${xml_val} ${tsdr_val} IN ZIP ${openflow_3_packetcount} ${tsdr_op3_pc}
- Compare Tsdr XML Metrics ${xml_val} ${tsdr_val} 20
- END
-
-Comparing Byte Count Metrics
- [Documentation] Comparing byte count values between Cassandra and openflow plugin
- FOR ${xml_val} ${tsdr_val} IN ZIP ${openflow_1_bytecount} ${tsdr_op1_bc}
- Compare Tsdr XML Metrics ${xml_val} ${tsdr_val} 20
- END
- FOR ${xml_val} ${tsdr_val} IN ZIP ${openflow_2_bytecount} ${tsdr_op2_bc}
- Compare Tsdr XML Metrics ${xml_val} ${tsdr_val} 20
- END
- FOR ${xml_val} ${tsdr_val} IN ZIP ${openflow_3_bytecount} ${tsdr_op3_bc}
- Compare Tsdr XML Metrics ${xml_val} ${tsdr_val} 20
- END
-
-
-*** Keywords ***
-Initialize the Tsdr Suite
- Initialize Cassandra Tables Metricval
+++ /dev/null
-*** Settings ***
-Documentation Test suite for Cassandra DataStore Flow Table Stats Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Initialize the Tsdr Suite
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-${TSDR_FLOWTABLE_STATS} tsdr:list FlowTableStats
-@{tsdr_pl}
-@{tsdr_af}
-@{tsdr_pm}
-${packetlookup} flow-table-statistics/packets-looked-up
-${activeflows} flow-table-statistics/active-flows
-${packetmatched} flow-table-statistics/packets-matched
-@{openflow_packetlookup}
-@{openflow_activeflows}
-@{openflow_packetmatched}
-
-
-*** Test Cases ***
-Verification of TSDR Cassandra Feature Installation
- [Documentation] Install and Verify the TSDR Cassandra Features
- COMMENT Install a Feature odl-tsdr-cassandra-all ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 60
- Verify Feature Is Installed odl-tsdr-cassandra
- COMMENT Verify Feature Is Installed odl-tsdr-cassandra-persistence
- Verify Feature Is Installed odl-tsdr-openflow-statistics-collector
- Start Tsdr Suite
- Ping All Hosts
- Wait Until Keyword Succeeds 5x 30 sec Check Metric val \\d{5}
-
-Getting all Tables from Openflow Plugin
- [Documentation] Getting Flow Table Stats Values from Openflow plugin
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:1/table/0/ ${packetlookup}
- Append To List ${openflow_packetlookup} ${ret}
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:2/table/0/ ${packetlookup}
- Append To List ${openflow_packetlookup} ${ret}
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:3/table/0/ ${packetlookup}
- Append To List ${openflow_packetlookup} ${ret}
- Set Suite Variable @{openflow_packetlookup}
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:1/table/0/ ${activeflows}
- Append To List ${openflow_activeflows} ${ret}
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:2/table/0/ ${activeflows}
- Append To List ${openflow_activeflows} ${ret}
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:3/table/0/ ${activeflows}
- Append To List ${openflow_activeflows} ${ret}
- Set Suite Variable @{openflow_activeflows}
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:1/table/0/ ${packetmatched}
- Append To List ${openflow_packetmatched} ${ret}
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:2/table/0/ ${packetmatched}
- Append To List ${openflow_packetmatched} ${ret}
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:3/table/0/ ${packetmatched}
- Append To List ${openflow_packetmatched} ${ret}
- Set Suite Variable @{openflow_packetmatched}
-
-Verification of FlowStats-Attributes on Cassandra Data Store
- [Documentation] Verify the InterfaceMetrics has been updated on Cassandra Data Store
- Copy TSDR tables
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:1 | grep DC=FLOWTABLESTATS | grep MN=PacketLookup | grep RK=Node:openflow:1,Table:0
- Append To List ${tsdr_pl} ${ret_val1}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:2 | grep DC=FLOWTABLESTATS | grep MN=PacketLookup | grep RK=Node:openflow:2,Table:0
- Append To List ${tsdr_pl} ${ret_val1}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:3 | grep DC=FLOWTABLESTATS | grep MN=PacketLookup | grep RK=Node:openflow:3,Table:0
- Append To List ${tsdr_pl} ${ret_val1}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:1 | grep DC=FLOWTABLESTATS | grep MN=ActiveFlows | grep RK=Node:openflow:1,Table:0
- Append To List ${tsdr_af} ${ret_val1}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:2 | grep DC=FLOWTABLESTATS | grep MN=ActiveFlows | grep RK=Node:openflow:2,Table:0
- Append To List ${tsdr_af} ${ret_val1}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:3 | grep DC=FLOWTABLESTATS | grep MN=ActiveFlows | grep RK=Node:openflow:3,Table:0
- Append To List ${tsdr_af} ${ret_val1}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:1 | grep DC=FLOWTABLESTATS | grep MN=PacketMatch | grep RK=Node:openflow:1,Table:0
- Append To List ${tsdr_pm} ${ret_val1}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:2 | grep DC=FLOWTABLESTATS | grep MN=PacketMatch | grep RK=Node:openflow:2,Table:0
- Append To List ${tsdr_pm} ${ret_val1}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:3 | grep DC=FLOWTABLESTATS | grep MN=PacketMatch | grep RK=Node:openflow:3,Table:0
- Append To List ${tsdr_pm} ${ret_val1}
-
-Comparing Flow Table Metrics
- [Documentation] Comparing Flow table values between Cassandra and openflow plugin.
- FOR ${xml_val} ${tsdr_val} IN ZIP ${openflow_packetlookup} ${tsdr_pl}
- Compare Tsdr XML Metrics ${xml_val} ${tsdr_val} 5
- END
- FOR ${xml_val} ${tsdr_val} IN ZIP ${openflow_activeflows} ${tsdr_af}
- Compare Tsdr XML Metrics ${xml_val} ${tsdr_val} 5
- END
- FOR ${xml_val} ${tsdr_val} IN ZIP ${openflow_packetmatched} ${tsdr_pm}
- Compare Tsdr XML Metrics ${xml_val} ${tsdr_val} 5
- END
-
-
-*** Keywords ***
-Initialize the Tsdr Suite
- COMMENT Initialize the Cassandra for TSDR
- Initialize Cassandra Tables Metricval
+++ /dev/null
-*** Settings ***
-Documentation Test suite for Cassandra DataStore Queue Stats Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Initialize Cassandra Tables Metricval
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-@{QUEUE_METRICS} TransmittedPackets TransmittedBytes TransmissionErrors
-${TSDR_QUEUESTATS} tsdr:list QueueStats
-${QUERY_HEAD} ${OPERATIONAL_NODES_API}/node
-${query_head1} ${QUERY_HEAD}/openflow:2/node-connector/openflow:2:2/queue/
-@{tsdr_q0}
-@{tsdr_q2}
-@{tsdr_q1}
-${transmittedpackets} flow-capable-node-connector-queue-statistics/transmitted-packets
-${transmittedbytes} flow-capable-node-connector-queue-statistics/transmitted-bytes
-${transmittederrors} flow-capable-node-connector-queue-statistics/transmission-errors
-@{openflow_q0}
-@{openflow_q2}
-@{openflow_q1}
-
-
-*** Test Cases ***
-Verification of TSDR Cassandra Feature Installation
- [Documentation] Install and Verify the TSDR Cassandra Features
- COMMENT Install a Feature odl-tsdr-cassandra-all ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 60
- Verify Feature Is Installed odl-tsdr-cassandra
- COMMENT Verify Feature Is Installed odl-tsdr-cassandra-persistence
- Verify Feature Is Installed odl-tsdr-openflow-statistics-collector
- Start Tsdr Suite
- Configuration of Queue on Switch
- Ping All Hosts
- Wait Until Keyword Succeeds 5x 30 sec Check Metric val \\d{5}
-
-Getting all Tables from Openflow Plugin
- [Documentation] Getting Queue Stats from openflow plugin
- ${ret}= Get Stats XML ${query_head1}0/ ${transmittederrors}
- Append To List ${openflow_q0} ${ret}
- ${ret}= Get Stats XML ${query_head1}0/ ${transmittedpackets}
- Append To List ${openflow_q0} ${ret}
- ${ret}= Get Stats XML ${query_head1}0/ ${transmittedbytes}
- Append To List ${openflow_q0} ${ret}
- Set Suite Variable @{openflow_q0}
- ${ret}= Get Stats XML ${query_head1}1/ ${transmittederrors}
- Append To List ${openflow_q1} ${ret}
- ${ret}= Get Stats XML ${query_head1}1/ ${transmittedpackets}
- Append To List ${openflow_q1} ${ret}
- ${ret}= Get Stats XML ${query_head1}1/ ${transmittedbytes}
- Append To List ${openflow_q1} ${ret}
- Set Suite Variable @{openflow_q1}
- ${ret}= Get Stats XML ${query_head1}2/ ${transmittederrors}
- Append To List ${openflow_q2} ${ret}
- ${ret}= Get Stats XML ${query_head1}2/ ${transmittedpackets}
- Append To List ${openflow_q2} ${ret}
- ${ret}= Get Stats XML ${query_head1}2/ ${transmittedbytes}
- Append To List ${openflow_q2} ${ret}
- Set Suite Variable @{openflow_q2}
-
-Verification of FlowStats-Attributes on Cassandra Data Store
- [Documentation] Verify the InterfaceMetrics has been updated on Cassandra Data Store
- Copy TSDR tables
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:2 | grep DC=QUEUESTATS | grep MN=TransmissionErrors | grep RK=Node:openflow:2,NodeConnector:openflow:2:2,Queue:0
- Append To List ${tsdr_q0} ${ret_val1}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:2 | grep DC=QUEUESTATS | grep MN=TransmittedPackets | grep RK=Node:openflow:2,NodeConnector:openflow:2:2,Queue:0
- Append To List ${tsdr_q0} ${ret_val1}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:2 | grep DC=QUEUESTATS | grep MN=TransmittedBytes | grep RK=Node:openflow:2,NodeConnector:openflow:2:2,Queue:0
- Append To List ${tsdr_q0} ${ret_val1}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:2 | grep DC=QUEUESTATS | grep MN=TransmissionErrors | grep RK=Node:openflow:2,NodeConnector:openflow:2:2,Queue:1
- Append To List ${tsdr_q1} ${ret_val1}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:2 | grep DC=QUEUESTATS | grep MN=TransmittedPackets | grep RK=Node:openflow:2,NodeConnector:openflow:2:2,Queue:1
- Append To List ${tsdr_q1} ${ret_val1}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:2 | grep DC=QUEUESTATS | grep MN=TransmittedBytes | grep RK=Node:openflow:2,NodeConnector:openflow:2:2,Queue:1
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:2 | grep DC=QUEUESTATS | grep MN=TransmissionErrors | grep RK=Node:openflow:2,NodeConnector:openflow:2:2,Queue:2
- Append To List ${tsdr_q2} ${ret_val1}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:2 | grep DC=QUEUESTATS | grep MN=TransmittedPackets | grep RK=Node:openflow:2,NodeConnector:openflow:2:2,Queue:2
- Append To List ${tsdr_q2} ${ret_val1}
- ${ret_val1}= Verify the Metrics Attributes on Cassandra Client
- ... grep NID=openflow:2 | grep DC=QUEUESTATS | grep MN=TransmittedBytes | grep RK=Node:openflow:2,NodeConnector:openflow:2:2,Queue:2
- Append To List ${tsdr_q2} ${ret_val1}
-
-Comparing Queue Metrics
- [Documentation] Comparing Queue metrics between Cassandra and OF plugin
- FOR ${xml_val} ${tsdr_val} IN ZIP ${openflow_q0} ${tsdr_q0}
- Compare Tsdr XML Metrics ${xml_val} ${tsdr_val} 20
- END
- FOR ${xml_val} ${tsdr_val} IN ZIP ${openflow_q1} ${tsdr_q1}
- Compare Tsdr XML Metrics ${xml_val} ${tsdr_val} 20
- END
- FOR ${xml_val} ${tsdr_val} IN ZIP ${openflow_q2} ${tsdr_q2}
- Compare Tsdr XML Metrics ${xml_val} ${tsdr_val} 20
- END
-
-
-*** Keywords ***
-Configuration of Queue on Switch
- [Documentation] Queue configuration on openvswitch
- Configure the Queue on Switch s2-eth2
+++ /dev/null
-*** Settings ***
-Documentation Test suite for Cassandra DataStore Syslog Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-
-*** Test Cases ***
-Verification of TSDR Cassandra Feature Installation
- [Documentation] Install and Verify the TSDR Cassandra Syslog Features
- Initialize Cassandra Tables Metricval val_table=metriclog
- Wait Until Keyword Succeeds 24x 10 sec Check Karaf Log Has Messages tsdr.syslog
- Verify Feature Is Installed odl-tsdr-cassandra
- Verify Feature Is Installed odl-tsdr-syslog-collector
-
-Sending syslog to ODL Syslog collector using Logger command
- [Documentation] Sending Syslogs to collector.
- FOR ${key} IN ZIP &{syslog_facility}
- ${value}= Get From Dictionary ${syslog_facility} ${key}
- ${f_value}= Evaluate ${value} * 8
- Generate Syslog ${f_value}
- END
-
-Verifying TSDR Data Store For Syslog Entries
- [Documentation] Verifying if syslogs is getting stored.
- Copy TSDR tables val_table=metriclog
- ${metric_log}= Verify the Metrics Syslog on Cassandra Client grep DC=SYSLOG
- @{Syslogs}= Split to lines ${metric_log}
- ${iterator}= Set Variable 0
- FOR ${key} IN ZIP &{syslog_facility}
- ${value}= Get From Dictionary ${syslog_facility} ${key}
- ${f_value}= Evaluate ${value} * 8
- Should Contain ${syslogs}[${iterator}] ${MESSAGE}
- Should Contain ${syslogs}[${iterator}] <${f_value}>
- ${iterator}= Evaluate ${iterator} + 1
- END
+++ /dev/null
-*** Settings ***
-Documentation Test suite for Cassandra DataStore Netflow Stats Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Initialize Netflow
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-${IP_1} 10.0.0.1
-${IP_2} 10.0.0.2
-${NODE_ID} 127.0.0.1
-${engine_type} 11
-${engine_id} 11
-${nexthop} 0
-${port} 0
-${prot} 1
-${int1} 1
-${int2} 2
-${version} 5
-
-
-*** Test Cases ***
-Verifying TSDR Data Store For Netflow Entries
- [Documentation] Verify the Cassandra Data store to check if Netflow data is stored.
- Copy TSDR tables val_table=metriclog
- ${metric_log}= Verify the Metrics Syslog on Cassandra Client grep DC=NETFLOW
- Should Contain ${metric_log} srcAddr=${IP_2}
- ${netflow}= Create Temporary Key Info srcAddr=${IP_2} val_table=metriclog
- Should Contain ${netflow} srcAddr=${IP_2}
- Should Contain ${netflow} dstAddr=${IP_1}
- Should Contain ${netflow} srcPort=${port}
- Should Contain ${netflow} protocol=${prot}
- Should Contain ${netflow} nextHop=${nexthop}
- Should Contain ${netflow} engine_type
- Should Contain ${netflow} engine_id
- Should Contain ${netflow} input=${int2}
- Should Contain ${netflow} output=${int1}
- Should Contain ${netflow} sysUpTime
- Should Contain ${netflow} flow_sequence
- Should Contain ${netflow} unix_nsecs
- Should Contain ${netflow} dPkts
- Should Contain ${netflow} tcpFlags
- Should Contain ${netflow} samplingInterval=0
- Should Contain ${netflow} dstAS=0
- Should Contain ${netflow} srcAS=0
- Should Contain ${netflow} dstMask=0
- Should Contain ${netflow} srcMask=0
- ${netflow}= Create Temporary Key Info srcAddr=${IP_1} val_table=metriclog
- Should Contain ${netflow} srcAddr=${IP_1}
- Should Contain ${netflow} dstAddr=${IP_2}
- Should Contain ${netflow} dstPort=${port}
- Should Contain ${netflow} protocol=${prot}
- Should Contain ${netflow} nextHop=${nexthop}
- Should Contain ${netflow} engine_type
- Should Contain ${netflow} engine_id
- Should Contain ${netflow} input=${int1}
- Should Contain ${netflow} output=${int2}
- Should Contain ${netflow} sysUpTime
- Should Contain ${netflow} flow_sequence
- Should Contain ${netflow} unix_nsecs
- Should Contain ${netflow} dPkts
- Should Contain ${netflow} tcpFlags
- Should Contain ${netflow} samplingInterval=0
- Should Contain ${netflow} dstAS=0
- Should Contain ${netflow} srcAS=0
- Should Contain ${netflow} dstMask=0
- Should Contain ${netflow} srcMask=0
-
-
-*** Keywords ***
-Initialize Netflow
- [Documentation] Initialize Netflow setup and start collecting the netflow samples.
- Verify Feature Is Installed odl-tsdr-cassandra
- Bringup Netflow
- Initialize Cassandra Tables Metricval val_table=metriclog
- Wait Until Keyword Succeeds 36x 5 sec Ping Pair Hosts Cassandra \\d{2}
+++ /dev/null
-#!/bin/bash
-
-# Installation of Cassandra
-cat > ${WORKSPACE}/cassandrastartup.sh <<EOF
-cd /tmp/cassandra
-echo "Start the Cassandra Server"
-export JAVA_HOME=/usr
-sudo /tmp/cassandra/apache-cassandra-2.1.16/bin/cassandra
-ls -l /tmp/cassandra/apache-cassandra-2.1.16/bin/cassandra
-
-EOF
-echo "Copy the Cassanra startup script to ${ODL_SYSTEM_IP}"
-scp ${WORKSPACE}/cassandrastartup.sh ${ODL_SYSTEM_IP}:/tmp
-ssh ${ODL_SYSTEM_IP} 'bash /tmp/cassandrastartup.sh'
-ssh ${ODL_SYSTEM_IP} 'ps -ef | grep cassandra'
-# vim: ts=4 sw=4 sts=4 et ft=sh :
+++ /dev/null
-*** Settings ***
-Documentation Test suite for ElasticSearch DataStore PortStats Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library RequestsLibrary
-Library ../../../libraries/Common.py
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Resource ../../../variables/Variables.robot
-
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-@{tsdr_pl}
-@{tsdr_af}
-@{tsdr_pm}
-${packetlookup} flow-table-statistics/packets-looked-up
-${activeflows} flow-table-statistics/active-flows
-${packetmatched} flow-table-statistics/packets-matched
-@{openflow_packetlookup}
-@{openflow_activeflows}
-@{openflow_packetmatched}
-
-
-*** Test Cases ***
-Verification of TSDR ElasticSearch Feature Installation
- [Documentation] Install and Verify the Elastic Search Features
- COMMENT Install a Feature odl-tsdr-elasticsearch ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 60
- Install a Feature odl-tsdr-elasticsearch ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 60
- Install a Feature odl-tsdr-openflow-statistics-collector ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 260
- COMMENT Wait Until Keyword Succeeds 24x 10 sec Check Karaf Log Has Messages tsdr.openflow
- Verify Feature Is Installed odl-tsdr-elasticsearch
- Verify Feature Is Installed odl-tsdr-openflow-statistics-collector
- Start Tsdr Suite
- Ping All Hosts
- Clear Elasticsearch Datastore
- Wait Until Keyword Succeeds 30x 1 sec Check Available values from Elasticsearch FLOWTABLESTATS 4571
-
-Comparing Flow Table Metrics
- [Documentation] Comparing Flow table values between Elasticsearch and openflow plugin.
- Getting all Tables from Openflow Plugin
- Getting all Tables from ElasticSearch datastore
- Should Be Equal As Strings ${tsdr_pl} ${openflow_packetlookup}
- Should Be Equal As Strings ${tsdr_af} ${openflow_activeflows}
- Should Be Equal As Strings ${tsdr_pm} ${openflow_packetmatched}
-
-
-*** Keywords ***
-Getting all Tables from Openflow Plugin
- [Documentation] Getting Flow Table Stats Values from Openflow plugin
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:1/table/0/ ${packetlookup}
- Append To List ${openflow_packetlookup} ${ret}
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:2/table/0/ ${packetlookup}
- Append To List ${openflow_packetlookup} ${ret}
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:3/table/0/ ${packetlookup}
- Append To List ${openflow_packetlookup} ${ret}
- Set Suite Variable @{openflow_packetlookup}
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:1/table/0/ ${activeflows}
- Append To List ${openflow_activeflows} ${ret}
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:2/table/0/ ${activeflows}
- Append To List ${openflow_activeflows} ${ret}
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:3/table/0/ ${activeflows}
- Append To List ${openflow_activeflows} ${ret}
- Set Suite Variable @{openflow_activeflows}
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:1/table/0/ ${packetmatched}
- Append To List ${openflow_packetmatched} ${ret}
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:2/table/0/ ${packetmatched}
- Append To List ${openflow_packetmatched} ${ret}
- ${ret}= Get Stats XML ${OPERATIONAL_NODES_API}/node/openflow:3/table/0/ ${packetmatched}
- Append To List ${openflow_packetmatched} ${ret}
- Set Suite Variable @{openflow_packetmatched}
-
-Getting all Tables from ElasticSearch datastore
- [Documentation] Getting Flow Table Stats Values from ELK plugin
- ${ret}= Retrieve Value From Elasticsearch FLOWTABLESTATS PacketLookup openflow:1 openflow:1
- Append To List ${tsdr_pl} ${ret}
- ${ret}= Retrieve Value From Elasticsearch FLOWTABLESTATS PacketLookup openflow:2 openflow:2
- Append To List ${tsdr_pl} ${ret}
- ${ret}= Retrieve Value From Elasticsearch FLOWTABLESTATS PacketLookup openflow:3 openflow:3
- Append To List ${tsdr_pl} ${ret}
- Set Suite Variable @{tsdr_pl}
- ${ret}= Retrieve Value From Elasticsearch FLOWTABLESTATS ActiveFlows openflow:1 openflow:1
- Append To List ${tsdr_af} ${ret}
- ${ret}= Retrieve Value From Elasticsearch FLOWTABLESTATS ActiveFlows openflow:2 openflow:2
- Append To List ${tsdr_af} ${ret}
- ${ret}= Retrieve Value From Elasticsearch FLOWTABLESTATS ActiveFlows openflow:3 openflow:3
- Append To List ${tsdr_af} ${ret}
- Set Suite Variable @{tsdr_af}
- ${ret}= Retrieve Value From Elasticsearch FLOWTABLESTATS PacketMatch openflow:1 openflow:1
- Append To List ${tsdr_pm} ${ret}
- ${ret}= Retrieve Value From Elasticsearch FLOWTABLESTATS PacketMatch openflow:2 openflow:2
- Append To List ${tsdr_pm} ${ret}
- ${ret}= Retrieve Value From Elasticsearch FLOWTABLESTATS PacketMatch openflow:3 openflow:3
- Append To List ${tsdr_pm} ${ret}
- Set Suite Variable @{tsdr_pm}
+++ /dev/null
-#!/bin/bash
-
-# Installation of Elasticsearch.
-cat > ${WORKSPACE}/elasticsearch.sh <<EOF
-EL_PATH=/tmp/elasticsearch/elasticsearch-1.7.5
-LOG_FILE=\$EL_PATH/logs/elasticsearch.log
-
-echo "Start the Elasticsearch Server"
-export JAVA_HOME=/usr
-
-rm \$LOG_FILE
-cd \$EL_PATH/bin
-
-sudo \$EL_PATH/bin/elasticsearch -d
-echo "Check status of the Elasticsearch Server"
-
-sleep 2
-while : ;do
- [[ -f "\$LOG_FILE" ]] && grep -q "started" "\$LOG_FILE" && echo "Elastic search has been started" && break
-done
-less \$LOG_FILE | grep started
-
-EOF
-
-echo "Copy the Elasticsearch startup script to ${ODL_SYSTEM_IP}"
-scp ${WORKSPACE}/elasticsearch.sh ${ODL_SYSTEM_IP}:/tmp
-ssh ${ODL_SYSTEM_IP} 'bash /tmp/elasticsearch.sh'
-ssh ${ODL_SYSTEM_IP} 'ps -ef | grep elasticsearch'
+++ /dev/null
-*** Settings ***
-Documentation Test suite for H2 DataStore InterfaceMetrics Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Start Tsdr Suite
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-@{INTERFACE_METRICS}
-... TransmittedPackets
-... TransmittedBytes
-... TransmitErrors
-... TransmitDrops
-... ReceivedPackets
-... ReceivedBytes
-... ReceiveOverRunError
-... ReceiveFrameError
-... ReceiveErrors
-... ReceiveDrops
-... ReceiveCrcError
-... CollisionCount
-@{CATEGORY} FlowGroupStats FlowMeterStats FlowStats FlowTableStats PortStats QueueStats
-${TSDR_PORTSTATS} tsdr:list PortStats
-
-
-*** Test Cases ***
-Verification of TSDR H2 Feature Installation
- [Documentation] Install and Verify the TSDR H2 Datastore and JDBC
- Install a Feature jdbc ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 60
- Verify Feature Is Installed jdbc
- COMMENT Install a Feature odl-tsdr-all ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 60
- Verify Feature Is Installed odl-tsdr-all
- Verify Feature Is Installed odl-tsdr-H2-persistence
- Verify Feature Is Installed odl-tsdr-core
- Wait Until Keyword Succeeds
- ... 120s
- ... 1s
- ... Verify the Metric is Collected?
- ... log:display | grep "TSDR H2"
- ... TSDR H2
-
-Verification TSDR Command is exist in Help
- [Documentation] Verify the TSDR List command on Help
- ${output}= Issue Command On Karaf Console tsdr\t
- Should Contain ${output} tsdr:list
- Should Contain ${output} tsdr:purgeall
- ${output}= Issue Command On Karaf Console tsdr:list\t\t
- FOR ${list} IN @{CATEGORY}
- Should Contain ${output} ${list}
- END
- Wait Until Keyword Succeeds 60s 1s Verify the Metric is Collected? ${TSDR_PORTSTATS} openflow
-
-Verify PortStats On Karaf console
- [Documentation] Verify the InterfaceMetrics(PortStats),attributes using ${TSDR_PORTSTATS}
- FOR ${list} IN @{INTERFACE_METRICS}
- ${tsdr_cmd}= Concatenate the String ${TSDR_PORTSTATS} | grep ${list} | head
- ${output}= Issue Command On Karaf Console ${tsdr_cmd} ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 30
- Should Contain ${output} ${list}
- END
-
-Verify PortStats-Attributes on H2 Datastore using JDBC Client
- [Documentation] Verify the PortStats,attributes on H2 Datastore using JDBC Client
- FOR ${list} IN @{INTERFACE_METRICS}
- ${output}= Query Metrics on H2 Datastore PORTSTATS ${list}
- Should Contain ${output} ${list}
- END
+++ /dev/null
-*** Settings ***
-Documentation Test suite for H2 DataStore Flow Metrics Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Start Tsdr Suite
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-@{FLOW_METRICS} PacketCount ByteCount
-${TSDR_FLOWSTATS} tsdr:list FlowStats
-
-
-*** Test Cases ***
-Verification of TSDR FlowMetrics
- [Documentation] Verify the TSDR FlowStats
- Wait Until Keyword Succeeds 60s 1s Verify the Metric is Collected? ${TSDR_FLOWSTATS} PacketCount
- ${output}= Issue Command On Karaf Console ${TSDR_FLOWSTATS} ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 30
- FOR ${list} IN @{FLOW_METRICS}
- Should Contain ${output} ${list}
- END
-
-Verify FlowStats-Attributes on H2 Datastore using JDBC Client
- [Documentation] Verify the PortStats,attributes on H2 Datastore using JDBC Client
- FOR ${list} IN @{FLOW_METRICS}
- ${output}= Query Metrics on H2 Datastore FLOWSTATS ${list}
- Should Contain ${output} ${list}
- END
+++ /dev/null
-*** Settings ***
-Documentation Test suite for H2 DataStore Flow Table Metrics Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Start Tsdr Suite
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-@{FLOWTABLE_METRICS} ActiveFlows PacketLookup PacketMatch
-${TSDR_FLOWTABLE_STATS} tsdr:list FlowTableStats
-
-
-*** Test Cases ***
-Verification of TSDR FlowTableStats
- [Documentation] Verify the TSDR FlowiTableStats
- Wait Until Keyword Succeeds
- ... 60s
- ... 1s
- ... Verify the Metric is Collected?
- ... ${TSDR_FLOWTABLE_STATS}| grep ActiveFlow
- ... FLOWTABLESTATS
- ${output}= Issue Command On Karaf Console
- ... ${TSDR_FLOWTABLE_STATS}| grep openflow:1 | head
- ... ${ODL_SYSTEM_IP}
- ... ${KARAF_SHELL_PORT}
- ... 180
- FOR ${list} IN @{FLOWTABLE_METRICS}
- Should Contain ${output} ${list}
- END
-
-Verify FlowTableStats-Attributes on H2 Datastore using JDBC Client
- [Documentation] Verify the PortStats,attributes on H2 Datastore using JDBC Client
- FOR ${list} IN @{FLOWTABLE_METRICS}
- ${output}= Query Metrics on H2 Datastore FLOWTABLESTATS ${list}
- Should Contain ${output} ${list}
- END
+++ /dev/null
-*** Settings ***
-Documentation Test suite for H2 DataStore Queue Metrics Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Run Keywords Start Tsdr Suite Configuration of Queue on Switch
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-@{QUEUE_METRICS} TransmittedPackets TransmittedBytes TransmissionErrors
-${TSDR_QUEUE_STATS} tsdr:list QueueStats
-@{CMD_LIST} FlowGroupStats FlowMeterStats FlowStats FlowTableStats PortStats QueueStats
-
-
-*** Test Cases ***
-Verify the Queue Stats attributes exist thru Karaf console
- [Documentation] Verify the QueueMetrics attributes exist on Karaf Console
- Wait Until Keyword Succeeds 60s 1s Verify the Metric is Collected? ${TSDR_QUEUE_STATS} Transmitted
- ${output}= Issue Command On Karaf Console
- ... ${TSDR_QUEUE_STATS}
- ... ${ODL_SYSTEM_IP}
- ... ${KARAF_SHELL_PORT}
- ... 30
- FOR ${list} IN @{QUEUE_METRICS}
- Should Contain ${output} ${list}
- END
-
-Verify QueueStats-Attributes on H2 Datastore using JDBC Client
- [Documentation] Verify the QueueStats,attributes on H2 Datastore using JDBC Client
- FOR ${list} IN @{QUEUE_METRICS}
- ${output}= Query Metrics on H2 Datastore QUEUESTATS ${list}
- Should Contain ${output} ${list}
- END
-
-Verify tsdr:purgeall command
- [Documentation] Verify the tsdr:purgeall command
- Issue Command On Karaf Console tsdr:purgeall ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT}
- FOR ${list} IN @{CMD_LIST}
- ${out}= Issue Command On Karaf Console tsdr:list ${list} ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT}
- Should Contain ${out} no data of this category
- END
- FOR ${list} IN @{QUEUE_METRICS}
- ${out}= Query Metrics on H2 Datastore QUEUESTATS ${list}
- Should not Contain ${out} ${list}
- END
-
-
-*** Keywords ***
-Configuration of Queue on Switch
- [Documentation] Queue configuration on openvswitch
- Configure the Queue on Switch s2-eth2
+++ /dev/null
-*** Settings ***
-Documentation Test suite for H2 DataStore FlowGroup Stats Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Run Keywords Start TSDR suite with CPqD Switch Configuration of FlowGroup on Switch
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-@{FLOWGROUP_METRICS} ByteCount PacketCount RefCount
-${TSDR_FLOWGROUPSTATS} tsdr:list FlowGroupStats
-@{FLOWGROUP_HEADER} MetricName MetricValue MetricCategory MetricDetails
-
-
-*** Test Cases ***
-Verify the FlowGroup Stats attributes exist thru Karaf console
- [Documentation] Verify the FlowGroupStats attributes exist on Karaf Console
- Wait Until Keyword Succeeds 120s 1s Verify the Metric is Collected? ${TSDR_FLOWGROUPSTATS} ByteCount
- ${output}= Issue Command On Karaf Console
- ... ${TSDR_FLOWGROUPSTATS}
- ... ${ODL_SYSTEM_IP}
- ... ${KARAF_SHELL_PORT}
- ... 30
- FOR ${list} IN @{FLOWGROUP_METRICS}
- Should Contain ${output} ${list}
- END
-
-Verification of FlowGroupStats-ByteCount on Karaf Console
- [Documentation] Verify the FlowGroupStats has been updated thru tsdr:list command on karaf console
- ${tsdr_cmd}= Concatenate the String ${TSDR_FLOWGROUPSTATS} | grep ByteCount | head
- ${output}= Issue Command On Karaf Console ${tsdr_cmd} ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 90
- Should Contain ${output} ByteCount
- Should Contain ${output} FLOWGROUPSTATS
- Should not Contain ${output} null
- FOR ${list} IN @{FLOWGROUP_HEADER}
- Should Contain ${output} ${list}
- END
-
-Verify FlowGroupStats-Attributes on H2 Datastore using JDBC Client
- [Documentation] Verify the GroupStats,attributes on H2 Datastore using JDBC Client
- FOR ${list} IN @{FLOWGROUP_METRICS}
- ${output}= Query Metrics on H2 Datastore FLOWGROUPSTATS ${list}
- Should Contain ${output} ${list}
- END
-
-
-*** Keywords ***
-Start TSDR suite with CPqD Switch
- Start Tsdr Suite user
-
-Configuration of FlowGroup on Switch
- [Documentation] FlowGroup configuration on CPqD
- Run Command On Remote System ${TOOLS_SYSTEM_IP} sudo dpctl unix:/tmp/s1 group-mod cmd=add,group=1,type=all
- Run Command On Remote System
- ... ${TOOLS_SYSTEM_IP}
- ... sudo dpctl unix:/tmp/s1 flow-mod table=0,cmd=add eth_type=0x800,eth_src=00:01:02:03:04:05 apply:group=1
- Run Command On Remote System ${TOOLS_SYSTEM_IP} sudo dpctl unix:/tmp/s1 ping 10
- Run Command On Remote System ${TOOLS_SYSTEM_IP} sudo dpctl unix:/tmp/s2 ping 10
+++ /dev/null
-*** Settings ***
-Documentation Test suite for H2 DataStore FlowMeter Stats Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Run Keywords Start TSDR suite with CPqD Switch Configuration of FlowMeter on Switch
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-@{FLOWMETER_METRICS} ByteInCount PacketInCount FlowCount
-${TSDR_FLOWMETERSTATS} tsdr:list FlowMeterStats
-@{FLOWMETER_HEADER} MetricName MetricValue MetricCategory MetricDetails
-
-
-*** Test Cases ***
-Verify the FlowMeter Stats attributes exist thru Karaf console
- [Documentation] Verify the FlowMeterStats attributes exist on Karaf Console
- Wait Until Keyword Succeeds
- ... 120s
- ... 1s
- ... Verify the Metric is Collected?
- ... ${TSDR_FLOWMETERSTATS}
- ... ByteInCount
- ${output}= Issue Command On Karaf Console
- ... ${TSDR_FLOWMETERSTATS}
- ... ${ODL_SYSTEM_IP}
- ... ${KARAF_SHELL_PORT}
- ... 30
- FOR ${list} IN @{FLOWMETER_METRICS}
- Should Contain ${output} ${list}
- END
-
-Verification of FlowMeterStats-ByteInCount on Karaf Console
- [Documentation] Verify the FlowMeterStats has been updated thru tsdr:list command on karaf console
- ${tsdr_cmd}= Concatenate the String ${TSDR_FLOWMETERSTATS} | grep ByteInCount | head
- ${output}= Issue Command On Karaf Console ${tsdr_cmd} ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 90
- Should Contain ${output} ByteInCount
- Should Contain ${output} FLOWMETERSTATS
- Should not Contain ${output} null
- FOR ${list} IN @{FLOWMETER_HEADER}
- Should Contain ${output} ${list}
- END
-
-Verify FlowMeterStats-Attributes on H2 Datastore using JDBC Client
- [Documentation] Verify the FlowMeterStats,attributes on H2 Datastore using JDBC Client
- FOR ${list} IN @{FLOWMETER_METRICS}
- ${output}= Query Metrics on H2 Datastore FLOWMETERSTATS ${list}
- Should Contain ${output} ${list}
- END
-
-Uninstall all TSDR H2 Feature
- [Documentation] UnInstall all TSDR H2 Features
- Uninstall a Feature odl-tsdr-H2-persistence odl-tsdr-all odl-tsdr-core
- Verify Feature Is Not Installed odl-tsdr-H2-persistence
- Verify Feature Is Not Installed odl-tsdr-all
- Verify Feature Is Not Installed odl-tsdr-core
-
-Verification TSDR Command shouldnot exist in help
- [Documentation] Verify the TSDR List command on help
- ${output}= Issue Command On Karaf Console tsdr\t ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT}
- Should not Contain ${output} tsdr:list
-
-
-*** Keywords ***
-Start TSDR suite with CPqD Switch
- Start Tsdr Suite user
-
-Configuration of FlowMeter on Switch
- [Documentation] FlowMeter configuration on CPqD
- Run Command On Remote System
- ... ${TOOLS_SYSTEM_IP}
- ... sudo dpctl unix:/tmp/s1 meter-mod cmd=add,flags=1,meter=1 drop:rate=100
- Run Command On Remote System
- ... ${TOOLS_SYSTEM_IP}
- ... sudo dpctl unix:/tmp/s1 flow-mod table=0,cmd=add in_port=1 meter:1 apply:output=2
- Run Command On Remote System ${TOOLS_SYSTEM_IP} sudo dpctl unix:/tmp/s1 ping 10
- Run Command On Remote System ${TOOLS_SYSTEM_IP} sudo dpctl unix:/tmp/s2 ping 10
+++ /dev/null
-*** Settings ***
-Documentation Test suite for Hbase DataStore PortStats Verification
-Metadata https://bugs.opendaylight.org/show_bug.cgi?id=5068 ${EMPTY}
-
-Library SSHLibrary
-Library Collections
-Library String
-Library RequestsLibrary
-Library ../../../libraries/Common.py
-Resource ../../../libraries/CompareStream.robot
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Initialize the Tsdr Suite
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-@{INTERFACE_METRICS}
-... TransmittedPackets
-... TransmittedBytes
-... TransmitErrors
-... TransmitDrops
-... ReceivedPackets
-... ReceivedBytes
-... ReceiveOverRunError
-... ReceiveFrameError
-... ReceiveErrors
-... ReceiveDrops
-... ReceiveCrcError
-... CollisionCount
-&{HEADERS_QUERY} Content-Type=application/json Content-Type=application/json
-
-
-*** Test Cases ***
-Init Variables
- [Documentation] Initialize ODL version specific variables using resource CompareStream.
- Init Variables Master
-
-Verification of TSDR HBase Feature Installation
- [Documentation] Install and Verify the TSDR HBase Features
- COMMENT Install a Feature odl-tsdr-hbase ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 60
- Verify Feature Is Installed odl-tsdr-hbase
- Verify Feature Is Installed odl-hbaseclient
-
-Verification TSDR Command is exist in Help
- [Documentation] Verify the TSDR List command on Help
- ${output}= Issue Command On Karaf Console tsdr\t
- Should Contain ${output} tsdr:list
- ${output}= Issue Command On Karaf Console tsdr:list\t\t
- FOR ${list} IN @{CATEGORY}
- Should Contain ${output} ${list}
- END
- Wait Until Keyword Succeeds 620s 1s Verify the Metric is Collected? ${TSDR_PORTSTATS} openflow
-
-Verification of TSDR PortStats
- [Documentation] Verify the TSDR InterfaceMetrics
- FOR ${list} IN @{INTERFACE_METRICS}
- ${tsdr_cmd}= Concatenate the String ${TSDR_PORTSTATS} | grep ${list} | head
- ${output}= Issue Command On Karaf Console ${tsdr_cmd} ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 30
- Should Contain ${output} ${list}
- END
-
-Verification of InterfaceMetrics-Attributes on HBase Client
- [Documentation] Verify the InterfaceMetrics has been updated on HBase Datastore
- FOR ${list} IN @{INTERFACE_METRICS}
- Verify the Metrics Attributes on Hbase Client ${list} ${node_connector} ${portstats}
- END
-
-Verify Configuration Interval-change
- [Documentation] Verify the TSDR Collection configuration changes
- Wait Until Keyword Succeeds 5x 3 sec Post TSDR Configuration Interval ${default_poll}
- Wait Until Keyword Succeeds 5x 3 sec Verify TSDR Configuration Interval ${default_poll}
- Wait Until Keyword Succeeds 5x 3 sec Post TSDR Configuration Interval ${non_default_poll}
- Wait Until Keyword Succeeds 5x 3 sec Verify TSDR Configuration Interval ${non_default_poll}
- Wait Until Keyword Succeeds 5x 3 sec Post TSDR Configuration Interval ${default_poll}
- Wait Until Keyword Succeeds 5x 3 sec Verify TSDR Configuration Interval ${default_poll}
- [Teardown] Report_Failure_Due_To_Bug 5068
-
-
-*** Keywords ***
-Init Variables Master
- [Documentation] Sets variables specific to latest(master) version
- Set Suite Variable @{CATEGORY} FLOWGROUPSTATS FLOWMETERSTATS FLOWSTATS FLOWTABLESTATS PORTSTATS
- ... QUEUESTATS
- Set Suite Variable ${TSDR_PORTSTATS} tsdr:list PORTSTATS
- Set Suite Variable ${CONFIG_INTERVAL} /restconf/config/tsdr-openflow-statistics-collector:TSDROSCConfig
- Set Suite Variable
- ... ${OPER_INTERVAL}
- ... /restconf/operations/tsdr-openflow-statistics-collector:setPollingInterval
- Set Suite Variable ${default_poll} 15000
- set Suite Variable ${non_default_poll} 20000
- set Suite Variable ${node_connector} Node:openflow:1,NodeConnector:1
- set suite Variable ${portstats} PORTSTATS
-
-Initialize the Tsdr Suite
- COMMENT Initialize the HBase for TSDR
- Start Tsdr Suite
- Create Session session http://${ODL_SYSTEM_IP}:${RESTCONFPORT} auth=${AUTH} headers=${HEADERS_QUERY}
-
-Verify TSDR Configuration Interval
- [Documentation] Verify Configuration interval of TSDR Collection
- [Arguments] ${interval}
- ${resp}= RequestsLibrary.Get Request session ${CONFIG_INTERVAL}
- Should Be Equal As Strings ${resp.status_code} 200
- Should Contain ${resp.content} ${interval}
-
-Post TSDR Configuration Interval
- [Documentation] Configuration TSDR collection interval ${interval}
- [Arguments] ${interval}
- ${p1}= Create Dictionary interval=${interval}
- ${p2}= Create Dictionary input=${p1}
- ${p2_json}= json.dumps ${p2}
- ${resp}= RequestsLibrary.Post Request session ${OPER_INTERVAL} data=${p2_json}
- Should Be Equal As Strings ${resp.status_code} 200
+++ /dev/null
-*** Settings ***
-Documentation Test suite for Hbase DataStore Flow Stats Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/CompareStream.robot
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Start Tsdr Suite
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-@{FLOW_METRICS} PacketCount ByteCount
-
-
-*** Test Cases ***
-Init Variables
- [Documentation] Initialize ODL version specific variables using resource CompareStream.
- Init Variables Master
-
-Verification of TSDR FlowMetrics
- [Documentation] Verify the TSDR FlowStats
- Wait Until Keyword Succeeds 120s 1s Verify the Metric is Collected? ${TSDR_FLOWSTATS} PacketCount
- ${output}= Issue Command On Karaf Console ${TSDR_FLOWSTATS} ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 30
- FOR ${list} IN @{FLOW_METRICS}
- Should Contain ${output} ${list}
- END
-
-Verification of FlowMetrics-PacketCount on HBase Client
- [Documentation] Verify the FlowStats-Packetcount on both Karaf console and Hbase client
- ${tsdr_cmd}= Concatenate the String ${TSDR_FLOWSTATS} | grep PacketCount | head
- ${output}= Issue Command On Karaf Console ${tsdr_cmd} ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 90
- ${Line1}= Get Line ${output} 0
- Should Contain ${Line1} PacketCount
- Verify the Metrics Attributes on Hbase Client PacketCount ${node_connector} ${flowstats}
-
-Verification of FlowMetrics-BytesCount on HBase Client
- [Documentation] Verify the FlowStats-ByteCount on both Karaf Console and Hbase Client
- ${tsdr_cmd}= Concatenate the String ${TSDR_FLOWSTATS} | grep ByteCount | head
- ${output}= Issue Command On Karaf Console ${tsdr_cmd} ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 90
- ${Line1}= Get Line ${output} 0
- Should Contain ${Line1} ByteCount
- Verify the Metrics Attributes on Hbase Client ByteCount ${node_connector} ${flowstats}
-
-
-*** Keywords ***
-Init Variables Master
- [Documentation] Sets variables specific to latest(master) version
- Set Suite Variable ${TSDR_FLOWSTATS} tsdr:list FLOWSTATS
- set Suite Variable ${node_connector} Node:openflow:1,Table:0
- set suite Variable ${flowstats} FLOWSTATS
+++ /dev/null
-*** Settings ***
-Documentation Test suite for Hbase DataStore Flow Table Stats Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/CompareStream.robot
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Start Tsdr Suite
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-${TSDR_FLOWTABLE_STATS} tsdr:list FLOWTABLESTATS
-
-
-*** Test Cases ***
-Init Variables
- [Documentation] Initialize ODL version specific variables using resource CompareStream.
- Init Variables Master
-
-Verification of TSDR FlowTableMetrics
- [Documentation] Verify the TSDR FlowTableMetrics
- Wait Until Keyword Succeeds 120s 1s Verify the Metric is Collected? ${TSDR_FLOWTABLE_STATS} openflow
- ${output}= Issue Command On Karaf Console
- ... ${TSDR_FLOWTABLE_STATS}
- ... ${ODL_SYSTEM_IP}
- ... ${KARAF_SHELL_PORT}
- ... 30
- Should Contain ${output} openflow
-
-Verification of FlowTableMetrics on Karaf Console
- [Documentation] Verify the FlowTableMetrics has been updated thru tsdr:list command on karaf console
- ${tsdr_cmd}= Concatenate the String ${TSDR_FLOWTABLE_STATS} | grep ActiveFlows | head
- ${output}= Issue Command On Karaf Console ${tsdr_cmd} ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 90
- Should Contain ${output} ActiveFlows
-
-Verification of FlowTableMetrics-ActiveFlows on HBase Client
- [Documentation] Verify the FlowTableMetrics has been updated on HBase Datastore
- Verify the Metrics Attributes on Hbase Client ActiveFlows ${node_connector} ${flowtablestats}
-
-Verification of FlowTableMetrics-PacketMatch on HBase Client
- [Documentation] Verify the FlowTableMetrics has been updated on HBase Datastore
- Verify the Metrics Attributes on Hbase Client PacketMatch ${node_connector} ${flowtablestats}
-
-Verification of FlowTableMetrics-PacketLookup on HBase Client
- [Documentation] Verify the FlowTableMetrics has been updated on HBase Datastore
- Verify the Metrics Attributes on Hbase Client PacketLookup ${node_connector} ${flowtablestats}
-
-
-*** Keywords ***
-Init Variables Master
- [Documentation] Sets variables specific to latest(master) version
- Set Suite Variable ${TSDR_FLOWSTATS} tsdr:list FLOWTABLESTATS
- set Suite Variable ${node_connector} Node:openflow:1,Table:0
- set suite Variable ${flowtablestats} FLOWTABLESTATS
+++ /dev/null
-*** Settings ***
-Documentation Test suite for Hbase DataStore Queue Stats Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/CompareStream.robot
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Run Keywords Start Tsdr Suite Configuration of Queue on Switch
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-@{QUEUE_METRICS} TransmittedPackets TransmittedBytes TransmissionErrors
-
-
-*** Test Cases ***
-Init Variables
- [Documentation] Initialize ODL version specific variables using resource CompareStream.
- Init Variables Master
-
-Verify the Queue Metrics attributes exist thru Karaf console
- [Documentation] Verify the QueueMetrics attributes exist on Karaf Console
- Wait Until Keyword Succeeds 180s 1s Verify the Metric is Collected? ${TSDR_QUEUESTATS} Transmitted
- ${output}= Issue Command On Karaf Console ${TSDR_QUEUESTATS} ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 90
- FOR ${list} IN @{QUEUE_METRICS}
- Should Contain ${output} ${list}
- END
-
-Verification of QueueMetrics-TransmittedPackets on Karaf Console
- [Documentation] Verify the QueueMetrics has been updated thru tsdr:list command on karaf console
- ${tsdr_cmd}= Concatenate the String ${TSDR_QUEUESTATS} | grep TransmittedPackets | head
- ${output}= Issue Command On Karaf Console ${tsdr_cmd} ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 90
- Should Contain ${output} TransmittedPackets
-
-Verification of QueueMetrics-TransmittedPackets on HBase Client
- [Documentation] Verify the QueueMetrics has been updated on HBase Datastore
- Verify the Metrics Attributes on Hbase Client TransmittedPackets ${node_connector} ${queuestats}
-
-Verification of QueueMetrics-TransmittedBytes on HBase Client
- [Documentation] Verify the QueueMetrics has been updated on HBase Datastore
- Verify the Metrics Attributes on Hbase Client TransmittedBytes ${node_connector} ${queuestats}
-
-Verification of QueueMetrics-TransmissionErrors on HBase Client
- [Documentation] Verify the QueueMetrics has been updated on HBase Datastore
- Verify the Metrics Attributes on Hbase Client TransmissionErrors ${node_connector} ${queuestats}
-
-
-*** Keywords ***
-Configuration of Queue on Switch
- [Documentation] Queue configuration on openvswitch
- Configure the Queue on Switch s2-eth2
-
-Init Variables Master
- [Documentation] Sets variables specific to latest(master) version
- Set Suite Variable ${TSDR_QUEUESTATS} tsdr:list QUEUESTATS
- set Suite Variable ${node_connector} Node:openflow:2
- set suite Variable ${queuestats} QUEUESTATS
+++ /dev/null
-*** Settings ***
-Documentation Test suite for HBase Syslog Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-
-*** Test Cases ***
-Verification of TSDR HBase Feature Installation
- [Documentation] Install and Verify the TSDR Cassandra Syslog Features
- Wait Until Keyword Succeeds 24x 10 sec Check Karaf Log Has Messages tsdr.syslog
- Verify Feature Is Installed odl-tsdr-hbase
- Verify Feature Is Installed odl-tsdr-syslog-collector
-
-Sending syslog to ODL Syslog collector using Logger command
- [Documentation] Verifying if syslogs is collected and getting stored.
- Query the Data from HBaseClient truncate 'SYSLOG'
- FOR ${key} IN ZIP &{syslog_facility}
- ${value}= Get From Dictionary ${syslog_facility} ${key}
- ${f_value}= Evaluate ${value} * 8
- Generate Syslog ${f_value}
- END
- ${output}= Query the Data from HBaseClient scan 'SYSLOG'
- Should Contain X Times ${output} ${MESSAGE_PATTERN} 1
- FOR ${key} IN ZIP &{syslog_facility}
- ${value}= Get From Dictionary ${syslog_facility} ${key}
- ${f_value}= Evaluate ${value} * 8
- Should Match ${output} *${f_value}>*
- END
+++ /dev/null
-*** Settings ***
-Documentation Test suite for Hbase DataStore Netflow Stats Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Initialize Netflow
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-${IP_1} 10.0.0.1
-${IP_2} 10.0.0.2
-${NODE_ID} 127.0.0.1
-${engine_type} 11
-${engine_id} 11
-${nextHop} 0
-${port} 0
-${protocol} 1
-${int1} 1
-${int2} 2
-${version} 5
-
-
-*** Test Cases ***
-Verification of Full Record Text for Netflow Dumps
- [Documentation] Verify the Netflow Record Text Hbase client
- ${out}= Query the Data from HBaseClient
- ... scan 'NETFLOW',{ COLUMNS => 'c1' , LIMIT => 10, FILTER => "ValueFilter( =, 'regexstring:srcAddr=${IP_2}' )" }
- Should Contain ${out} srcAddr=${IP_2}
- Should Contain ${out} dstAddr=${IP_1}
- Should Contain ${out} srcPort=${port}
- Should Contain ${out} protocol=${protocol}
- Should Contain ${out} nextHop=${nexthop}
- Should Contain ${out} engine_type
- Should Contain ${out} engine_id
- Should Contain ${out} input=${int2}
- Should Contain ${out} output=${int1}
- ${out}= Query the Data from HBaseClient
- ... scan 'NETFLOW',{ COLUMNS => 'c1' , LIMIT => 10, FILTER => "ValueFilter( =, 'regexstring:srcAddr=${IP_1}' )" }
- Should Contain ${out} srcAddr=${IP_1}
- Should Contain ${out} dstAddr=${IP_2}
- Should Contain ${out} srcPort=${port}
- Should Contain ${out} protocol=${protocol}
- Should Contain ${out} nextHop=${nexthop}
- Should Contain ${out} engine_type
- Should Contain ${out} engine_id
- Should Contain ${out} input=${int1}
- Should Contain ${out} output=${int2}
- ${out}= Query the Data from HBaseClient scan 'NETFLOW'
- Should Contain ${out} sysUpTime
- Should Contain ${out} flow_sequence
- Should Contain ${out} unix_nsecs
- Should Contain ${out} dPkts
- Should Contain ${out} tcpFlags
- Should Contain ${out} dstAS=0
- Should Contain ${out} srcAS=0
- Should Contain ${out} dstMask=0
- Should Contain ${out} srcMask=0
-
-Verification of Metric Record for Netflow Dumps
- [Documentation] Verify the Netflow Metric Record Hbase client
- ${out}= Query the Data from HBaseClient
- ... scan 'NETFLOW',{ COLUMNS => 'c1:dstAddr' , LIMIT => 10, FILTER => "ValueFilter( =, 'binaryprefix:${IP_1}' )" }
- Should Contain ${out} value=${IP_1}
- ${out}= Query the Data from HBaseClient
- ... scan 'NETFLOW',{ COLUMNS => 'c1:srcAddr' , LIMIT => 10, FILTER => "ValueFilter( =, 'binaryprefix:${IP_1}' )" }
- Should Contain ${out} value=${IP_1}
- ${out}= Query the Data from HBaseClient
- ... scan 'NETFLOW',{ COLUMNS => 'c1:dstAddr' , LIMIT => 10, FILTER => "ValueFilter( =, 'binaryprefix:${IP_2}' )" }
- Should Contain ${out} value=${IP_2}
- ${out}= Query the Data from HBaseClient
- ... scan 'NETFLOW',{ COLUMNS => 'c1:srcAddr' , LIMIT => 10, FILTER => "ValueFilter( =, 'binaryprefix:${IP_2}' )" }
- Should Contain ${out} value=${IP_2}
- ${out}= Query the Data from HBaseClient
- ... scan 'NETFLOW',{ COLUMNS => 'c1:input' , LIMIT => 10, FILTER => "ValueFilter( =, 'binaryprefix:${int1}' )" }
- Should Contain ${out} value=${int1}
- ${out}= Query the Data from HBaseClient
- ... scan 'NETFLOW',{ COLUMNS => 'c1:output' , LIMIT => 10, FILTER => "ValueFilter( =, 'binaryprefix:${int2}' )" }
- Should Contain ${out} value=${int2}
- ${out}= Query the Data from HBaseClient
- ... scan 'NETFLOW',{ COLUMNS => 'c1:input' , LIMIT => 10, FILTER => "ValueFilter( =, 'binaryprefix:${int2}' )" }
- Should Contain ${out} value=${int2}
- ${out}= Query the Data from HBaseClient
- ... scan 'NETFLOW',{ COLUMNS => 'c1:output' , LIMIT => 10, FILTER => "ValueFilter( =, 'binaryprefix:${int1}' )" }
- Should Contain ${out} value=${int1}
- ${out}= Query the Data from HBaseClient scan 'NETFLOW',{ COLUMNS => 'c1:flowDuration' , LIMIT => 10}
- Should Contain ${out} flowDuration
- ${out}= Query the Data from HBaseClient
- ... scan 'NETFLOW',{ COLUMNS => 'c1:nextHop' , LIMIT => 10, FILTER => "ValueFilter( =, 'binaryprefix:${nextHop}' )" }
- Should Contain ${out} value=${nextHop}
- ${out}= Query the Data from HBaseClient
- ... scan 'NETFLOW',{ COLUMNS => 'c1:version' , LIMIT => 10, FILTER => "ValueFilter( =, 'binaryprefix:${version}' )" }
- Should Contain ${out} value=${version}
- ${out}= Query the Data from HBaseClient
- ... scan 'NETFLOW',{ COLUMNS => 'c1:protocol' , LIMIT => 10, FILTER => "ValueFilter( =, 'binaryprefix:${protocol}' )" }
- Should Contain ${out} value=${protocol}
-
-
-*** Keywords ***
-Initialize Netflow
- [Documentation] Initialize Netflow setup and start collecting the netflow samples.
- Query the Data from HBaseClient truncate 'NETFLOW'
- Bringup Netflow
- Wait Until Keyword Succeeds 36x 5 sec Ping Pair Hosts Hbase \\d{2} row
+++ /dev/null
-#!/bin/bash
-
-# Installation of Hbase
-cat > ${WORKSPACE}/hbasestartup.sh <<EOF
-cd /tmp/Hbase
-echo "Start the HBase Server"
-export JAVA_HOME=/usr
-/tmp/Hbase/hbase-0.94.27/bin/start-hbase.sh
-
-EOF
-echo "Copy the Hbase startup script to ${ODL_SYSTEM_IP}"
-scp ${WORKSPACE}/hbasestartup.sh ${ODL_SYSTEM_IP}:/tmp
-ssh ${ODL_SYSTEM_IP} 'sudo bash /tmp/hbasestartup.sh'
-# vim: ts=4 sw=4 sts=4 et ft=sh :
+++ /dev/null
-*** Settings ***
-Documentation Test suite for HSQLDB DataStore InterfaceMetrics Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/CompareStream.robot
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Start Tsdr Suite
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-@{INTERFACE_METRICS}
-... TransmittedPackets
-... TransmittedBytes
-... TransmitErrors
-... TransmitDrops
-... ReceivedPackets
-... ReceivedBytes
-... ReceiveOverRunError
-... ReceiveFrameError
-... ReceiveErrors
-... ReceiveDrops
-... ReceiveCrcError
-... CollisionCount
-
-
-*** Test Cases ***
-Init Variables
- [Documentation] Initialize ODL version specific variables
- Init Variables Master
-
-Verification of TSDR HSQLDB Feature Installation
- [Documentation] Install and Verify the TSDR HSQLDB Datastore and JDBC
- COMMENT Install a Feature odl-tsdr-hsqldb ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 60
- COMMENT
- ... Install a Feature
- ... odl-tsdr-openflow-statistics-collector
- ... ${ODL_SYSTEM_IP}
- ... ${KARAF_SHELL_PORT}
- ... 60
- Verify Feature Is Installed ${HSQLDB_INSTALL}
- Verify Feature Is Installed odl-tsdr-core
-
-Verification TSDR Command exists in Help
- [Documentation] Verify the TSDR List command on Help
- ${output}= Issue Command On Karaf Console tsdr\t
- Should Contain ${output} tsdr:list
- ${output}= Issue Command On Karaf Console tsdr:list\t\t
- FOR ${list} IN @{CATEGORY}
- Should Contain ${output} ${list}
- END
- Wait Until Keyword Succeeds 60s 1s Verify the Metric is Collected? ${TSDR_PORTSTATS} openflow
-
-Verify PortStats On Karaf console
- [Documentation] Verify the InterfaceMetrics(PortStats),attributes using ${TSDR_PORTSTATS}
- FOR ${list} IN @{INTERFACE_METRICS}
- ${tsdr_cmd}= Concatenate the String ${TSDR_PORTSTATS} | grep ${list} | head
- ${output}= Issue Command On Karaf Console ${tsdr_cmd} ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 30
- Should Contain ${output} ${list}
- END
-
-
-*** Keywords ***
-Init Variables Master
- [Documentation] Sets variables specific to latest(master) version
- Set Suite Variable @{CATEGORY} FLOWGROUPSTATS FLOWMETERSTATS FLOWSTATS FLOWTABLESTATS PORTSTATS
- ... QUEUESTATS
- Set Suite Variable ${TSDR_PORTSTATS} tsdr:list PORTSTATS
- Set Suite Variable ${HSQLDB_INSTALL} odl-tsdr-hsqldb
+++ /dev/null
-*** Settings ***
-Documentation Test suite for HSQLDB DataStore Flow Metrics Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/CompareStream.robot
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Start Tsdr Suite
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-@{FLOW_METRICS} PacketCount ByteCount
-
-
-*** Test Cases ***
-Init Variables
- [Documentation] Initialize ODL version specific variables
- Init Variables Master
-
-Verification of TSDR FlowMetrics
- [Documentation] Verify the TSDR FLOWSTATS
- Wait Until Keyword Succeeds 60s 1s Verify the Metric is Collected? ${TSDR_FLOWSTATS} PacketCount
- ${output}= Issue Command On Karaf Console ${TSDR_FLOWSTATS} ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 30
- FOR ${list} IN @{FLOW_METRICS}
- Should Contain ${output} ${list}
- END
-
-
-*** Keywords ***
-Init Variables Master
- [Documentation] Sets variables specific to latest(master) version
- Set Suite Variable ${TSDR_FLOWSTATS} tsdr:list FLOWSTATS
+++ /dev/null
-*** Settings ***
-Documentation Test suite for HSQLDB DataStore Flow Table Metrics Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/CompareStream.robot
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Start Tsdr Suite
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-@{FLOWTABLE_METRICS} ActiveFlows PacketLookup PacketMatch
-
-
-*** Test Cases ***
-Init Variables
- [Documentation] Initialize ODL version specific variables
- Init Variables Master
-
-Verification of TSDR FLOWTABLESTATS
- [Documentation] Verify the TSDR FlowiTableStats
- Wait Until Keyword Succeeds
- ... 60s
- ... 1s
- ... Verify the Metric is Collected?
- ... ${TSDR_FLOWTABLE_STATS}| grep ActiveFlow | grep openflow:1
- ... FLOWTABLESTATS
- ${output}= Issue Command On Karaf Console
- ... ${TSDR_FLOWTABLE_STATS}| grep openflow:1 | head
- ... ${ODL_SYSTEM_IP}
- ... ${KARAF_SHELL_PORT}
- ... 180
- FOR ${list} IN @{FLOWTABLE_METRICS}
- Should Contain ${output} ${list}
- END
-
-
-*** Keywords ***
-Init Variables Master
- [Documentation] Sets variables specific to latest(master) version
- Set Suite Variable ${TSDR_FLOWTABLE_STATS} tsdr:list FLOWTABLESTATS
+++ /dev/null
-*** Settings ***
-Documentation Test suite for HSQLDB DataStore Queue Metrics Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/CompareStream.robot
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Run Keywords Start Tsdr Suite Configuration of Queue on Switch
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-@{QUEUE_METRICS} TransmittedPackets TransmittedBytes TransmissionErrors
-
-
-*** Test Cases ***
-Init Variables
- [Documentation] Initialize ODL version specific variables
- Init Variables Master
-
-Verify the QueueStats attributes exist thru Karaf console
- [Documentation] Verify the QueueMetrics attributes exist on Karaf Console
- Wait Until Keyword Succeeds 60s 1s Verify the Metric is Collected? ${TSDR_QUEUE_STATS} Transmitted
- ${output}= Issue Command On Karaf Console
- ... ${TSDR_QUEUE_STATS}
- ... ${ODL_SYSTEM_IP}
- ... ${KARAF_SHELL_PORT}
- ... 30
- FOR ${list} IN @{QUEUE_METRICS}
- Should Contain ${output} ${list}
- END
-
-
-*** Keywords ***
-Configuration of Queue on Switch
- [Documentation] Queue configuration on openvswitch
- Configure the Queue on Switch s2-eth2
-
-Init Variables Master
- [Documentation] Sets variables specific to latest(master) version
- Set Suite Variable ${TSDR_QUEUE_STATS} tsdr:list QUEUESTATS
+++ /dev/null
-*** Settings ***
-Documentation Test suite for HSQLDB DataStore Syslog Stats Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-
-*** Test Cases ***
-Verification of TSDR HSQLDB Feature Installation
- [Documentation] Install and Verify the TSDR Cassandra Syslog Features
- COMMENT Install a Feature odl-tsdr-hsqldb-all ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 60
- COMMENT Install a Feature odl-tsdr-syslog-collector ${ODL_SYSTEM_IP} ${KARAF_SHELL_PORT} 60
- Wait Until Keyword Succeeds 24x 10 sec Check Karaf Log Has Messages tsdr.syslog
- Verify Feature Is Installed odl-tsdr-hsqldb
- Verify Feature Is Installed odl-tsdr-syslog-collector
-
-Sending syslog to ODL Syslog collector using Logger command
- [Documentation] Verifying if syslogs is getting generated.
- FOR ${key} IN ZIP &{syslog_facility}
- ${value}= Get From Dictionary ${syslog_facility} ${key}
- ${f_value}= Evaluate ${value} * 8
- Generate Syslog ${f_value}
- END
- Wait Until Keyword Succeeds 24x 10 sec Check HSQLDB 1 SYSLOG | grep SYSLOG | wc -l
-
-Verifying TSDR Data Store For Syslog Entries
- [Documentation] Verifying if syslogs is getting stored.
- ${output}= Issue Command On Karaf Console tsdr:list SYSLOG
- Should Contain X Times ${output} SYSLOG 1
- Should Contain ${output} ${MESSAGE_PATTERN}
+++ /dev/null
-*** Settings ***
-Documentation Test suite for HSQLDB DataStore NetFlow Stats Verification
-
-Library SSHLibrary
-Library Collections
-Library String
-Library ../../../libraries/Common.py
-Resource ../../../libraries/KarafKeywords.robot
-Resource ../../../libraries/TsdrUtils.robot
-Variables ../../../variables/Variables.py
-
-Suite Setup Initialize Netflow
-Suite Teardown Stop Tsdr Suite
-
-
-*** Variables ***
-${IP_1} 10.0.0.1
-${IP_2} 10.0.0.2
-${NODE_ID} 127.0.0.1
-${engine_type} 11
-${engine_id} 11
-${nexthop} 0
-${port} 0
-${prot} 1
-${int1} 1
-${int2} 2
-${version} 5
-
-
-*** Test Cases ***
-Verification of Full Record Text for Netflow Dumps
- [Documentation] Verify the Netflow Record Text Hbase client
- ${out}= Issue Command On Karaf Console tsdr:list NETFLOW | grep srcAddr=${IP_2}
- Should Contain ${out} srcPort=${port}
- Should Contain ${out} srcAddr=${IP_2}
- Should Contain ${out} dstAddr=${IP_1}
- Should Contain ${out} srcPort=${port}
- Should Contain ${out} protocol=${prot}
- Should Contain ${out} nextHop=${nexthop}
- Should Contain ${out} engine_type
- Should Contain ${out} engine_id
- Should Contain ${out} input=${int2}
- Should Contain ${out} output=${int1}
- ${out}= Issue Command On Karaf Console tsdr:list NETFLOW | grep srcAddr=${IP_1}
- Should Contain ${out} srcAddr=${IP_1}
- Should Contain ${out} dstAddr=${IP_2}
- Should Contain ${out} dstPort=${port}
- Should Contain ${out} protocol=${prot}
- Should Contain ${out} nextHop=${nexthop}
- Should Contain ${out} engine_type
- Should Contain ${out} engine_id
- Should Contain ${out} input=${int1}
- Should Contain ${out} output=${int2}
- Should Contain ${out} sysUpTime
- Should Contain ${out} flow_sequence
- Should Contain ${out} unix_nsecs
- Should Contain ${out} dPkts
- Should Contain ${out} dOctets
- Should Contain ${out} tcpFlags
- Should Contain ${out} dstAS=0
- Should Contain ${out} srcAS=0
- Should Contain ${out} dstMask=0
- Should Contain ${out} srcMask=0
-
-
-*** Keywords ***
-Initialize Netflow
- [Documentation] Initialize Mininet topology and check if netflow data is getting collected
- Bringup Netflow
- Wait Until Keyword Succeeds 36x 5 sec Ping Pair Hosts HSQLDB 2\\d+
+++ /dev/null
-# Place the suites in run order:
-integration/test/csit/suites/tsdr/Cassandra
+++ /dev/null
-# Place the suites in run order:
-integration/test/csit/suites/tsdr/Elasticsearch
+++ /dev/null
-# Place the suites in run order:
-integration/test/csit/suites/tsdr/HBase
+++ /dev/null
-# Place the suites in run order:
-integration/test/csit/suites/tsdr/HSQLDB