Suite Teardown Teardown_Everything
Test Setup SetupUtils.Setup_Test_With_Logging_And_Fast_Failing
Test Teardown SetupUtils.Teardown_Test_Show_Bugs_And_Start_Fast_Failing_If_Test_Failed
-Library DateTime
Library RequestsLibrary
Library OperatingSystem
Library SSHLibrary timeout=10s
Resource ${CURDIR}/../../../libraries/NetconfKeywords.robot
-Resource ${CURDIR}/../../../libraries/NetconfViaRestconf.robot
Resource ${CURDIR}/../../../libraries/NexusKeywords.robot
+Resource ${CURDIR}/../../../libraries/RestPerfClient.robot
Resource ${CURDIR}/../../../libraries/SetupUtils.robot
+Resource ${CURDIR}/../../../libraries/TemplatedRequests.robot
Resource ${CURDIR}/../../../libraries/Utils.robot
Variables ${CURDIR}/../../../variables/Variables.py
*** Variables ***
${DIRECTORY_WITH_TEMPLATE_FOLDERS} ${CURDIR}/../../../variables/netconf/RestPerfClient
-${REQUEST_COUNT} 65536
+${REQUEST_COUNT} 16384
+${device_type} full-uri-device
+${test_device} odl-mdsal-northbound-via-netconf-connector
*** Test Cases ***
Create_Test_Data_For_Direct_Access
[Documentation] Send some sample test data into the device and check that the request went OK.
- NetconfViaRestconf.Post_Xml_Template_Folder_Via_Restconf ${DIRECTORY_WITH_TEMPLATE_FOLDERS}${/}cars {}
+ TemplatedRequests.Post_As_Xml_Templated ${DIRECTORY_WITH_TEMPLATE_FOLDERS}${/}cars {}
Run_RestPerfClient_Directly_On_MDSAL
[Documentation] Deploy and execute restperfclient, asking it to send the specified amount of requests to the MDSAL via Restconf.
- [Timeout] ${DIRECT_MDSAL_TIMEOUT_FOR_TESTCASE}
- ${restperfclientlog}= Utils.Get_Log_File_Name restperfclient direct
- BuiltIn.Set_Suite_Variable ${restperfclientlog} ${restperfclientlog}
- SSHLibrary.Switch_Connection ${restperfclient}
- SSHLibrary.Put_File ${CURDIR}/../../../variables/netconf/RestPerfClient/request1.json
- ${filename}= NexusKeywords.Deploy_Test_Tool netconf netconf-testtool rest-perf-client
- SSHLibrary.Set_Client_Configuration timeout=${DIRECT_MDSAL_TIMEOUT}
- ${options}= BuiltIn.Set_Variable --ip ${ODL_SYSTEM_IP} --port ${RESTCONFPORT} --edits ${REQUEST_COUNT}
- ${options}= BuiltIn.Set_Variable ${options} --edit-content request1.json --async-requests false
- ${options}= BuiltIn.Set_Variable ${options} --auth ${ODL_RESTCONF_USER} ${ODL_RESTCONF_PASSWORD}
- ${options}= BuiltIn.Set_Variable ${options} --destination
- ${prefix}= NexusKeywords.Compose_Full_Java_Command -Xmx1G -XX:MaxPermSize=256M -jar ${filename} ${options}
- BuiltIn.Set_Suite_Variable ${command_prefix} ${prefix}
- ${command} BuiltIn.Set_Variable ${command_prefix} /restconf/config/car:cars
- BuiltIn.Log Running restperfclient: ${command}
- Set_Known_Bug_Id 5413
- Execute_Command_Passes ${command} >${restperfclientlog} 2>&1
- Set_Unknown_Bug_Id
- ${result}= SSHLibrary.Execute_Command grep "thread timed out" ${restperfclientlog}
- BuiltIn.Should_Be_Equal '${result}' ''
- ${result}= SSHLibrary.Execute_Command grep "FINISHED. Execution time:" ${restperfclientlog}
- BuiltIn.Should_Not_Be_Equal '${result}' ''
+ ${url}= BuiltIn.Set_Variable /rests/data/car:cars
+ RestPerfClient.Invoke_Restperfclient ${DIRECT_MDSAL_TIMEOUT} ${url} testcase=direct
Check_For_Failed_Direct_MDSAL_Requests
[Documentation] Make sure there are no failed requests in the restperfclient log.
... failure and failed requests. Failed requests are rejected because
... we don't want to test performance of ODL rejecting our requests.
[Setup] SetupUtils.Setup_Test_With_Logging_And_Without_Fast_Failing
- ${result}= SSHLibrary.Execute_Command grep "Request failed" ${restperfclientlog}
+ ${result}= RestPerfClient.Grep_Restperfclient_Log thread timed out
+ BuiltIn.Should_Be_Equal '${result}' ''
+ ${result}= RestPerfClient.Grep_Restperfclient_Log Request failed
BuiltIn.Should_Be_Equal '${result}' ''
- ${result}= SSHLibrary.Execute_Command grep "Status code" ${restperfclientlog}
+ ${result}= RestPerfClient.Grep_Restperfclient_Log Status code
BuiltIn.Should_Be_Equal '${result}' ''
Cleanup_And_Collect_For_Direct_Access
[Documentation] Cleanup the test data produced by the direct MDSAL access.
[Setup] SetupUtils.Setup_Test_With_Logging_And_Without_Fast_Failing
- NetconfViaRestconf.Delete_Xml_Template_Folder_Via_Restconf ${DIRECTORY_WITH_TEMPLATE_FOLDERS}${/}cars-delete {}
- SSHLibrary.Get_File ${restperfclientlog}
+ RestPerfClient.Collect_From_Restperfclient
+ TemplatedRequests.Delete_Templated ${DIRECTORY_WITH_TEMPLATE_FOLDERS}${/}cars-delete {}
Create_Test_Data_For_Connector_Access
[Documentation] Create the test data container again so it is ready for the netconf connector test.
[Setup] SetupUtils.Setup_Test_With_Logging_And_Without_Fast_Failing
- NetconfViaRestconf.Post_Xml_Template_Folder_Via_Restconf ${DIRECTORY_WITH_TEMPLATE_FOLDERS}${/}cars {}
+ TemplatedRequests.Post_As_Xml_Templated ${DIRECTORY_WITH_TEMPLATE_FOLDERS}${/}cars {}
Configure_ODL_As_A_Device_On_Netconf
[Documentation] Configure ODL MDSAL Northbound as a Netconf device on a Netconf connector.
- NetconfKeywords.Configure_Device_In_Netconf odl-mdsal-northbound-via-netconf-connector device_address=${ODL_SYSTEM_IP} device_port=${ODL_NETCONF_MDSAL_PORT} device_user=${ODL_NETCONF_USER} device_password=${ODL_NETCONF_PASSWORD}
- NetconfKeywords.Wait_Device_Connected odl-mdsal-northbound-via-netconf-connector
+ NetconfKeywords.Configure_Device_In_Netconf ${test_device} device_type=${device_type} device_address=${ODL_SYSTEM_IP} device_port=${ODL_NETCONF_MDSAL_PORT} device_user=${ODL_NETCONF_USER} device_password=${ODL_NETCONF_PASSWORD}
+ NetconfKeywords.Wait_Device_Connected ${test_device}
Run_RestPerfClient_Through_Netconf_Connector
- [Documentation] Ask RestPerfClient to send the requests to the MDSAL mapped via a netconf connector.
- [Timeout] ${NETCONF_CONNECTOR_MDSAL_TIMEOUT_FOR_TESTCASE}
- ${restperfclientlog}= Utils.Get_Log_File_Name restperfclient netconf-connector
- BuiltIn.Set_Suite_Variable ${restperfclientlog} ${restperfclientlog}
- SSHLibrary.Switch_Connection ${restperfclient}
- SSHLibrary.Set_Client_Configuration timeout=${NETCONF_CONNECTOR_MDSAL_TIMEOUT}
- ${command} BuiltIn.Set_Variable ${command_prefix} /restconf/config/network-topology:network-topology/topology/topology-netconf/node/odl-mdsal-northbound-via-netconf-connector/yang-ext:mount/car:cars
- BuiltIn.Log Running restperfclient: ${command}
- Set_Known_Bug_Id 5413
- Execute_Command_Passes ${command} >${restperfclientlog} 2>&1
- Set_Known_Bug_Id 5581
- ${result}= SSHLibrary.Execute_Command grep "thread timed out" ${restperfclientlog}
- BuiltIn.Should_Be_Equal '${result}' ''
- Set_Unknown_Bug_Id
- ${result}= SSHLibrary.Execute_Command grep "FINISHED. Execution time:" ${restperfclientlog}
- BuiltIn.Should_Not_Be_Equal '${result}' ''
+ [Documentation] Ask RestPerfClient to send the requests to the MDSAL mapped via netconf topology device.
+ ${url}= BuiltIn.Set_Variable /rests/data/network-topology:network-topology/topology\=topology-netconf/node\=${test_device}/yang-ext:mount/car:cars
+ RestPerfClient.Invoke_Restperfclient ${NETCONF_CONNECTOR_MDSAL_TIMEOUT} ${url} testcase=netconf-connector
Check_For_Failed_Netconf_Connector_Requests
[Documentation] Make sure there are no failed requests in the restperfclient log.
... failure and failed requests. Failed requests are rejected because
... we don't want to test performance of ODL rejecting our requests.
[Setup] SetupUtils.Setup_Test_With_Logging_And_Without_Fast_Failing
- ${result}= SSHLibrary.Execute_Command grep "Request failed" ${restperfclientlog}
+ Set_Known_Bug_Id 5581
+ ${result}= RestPerfClient.Grep_Restperfclient_Log thread timed out
+ BuiltIn.Should_Be_Equal '${result}' ''
+ Set_Unknown_Bug_Id
+ ${result}= RestPerfClient.Grep_Restperfclient_Log Request failed
BuiltIn.Should_Be_Equal '${result}' ''
- ${result}= SSHLibrary.Execute_Command grep "Status code" ${restperfclientlog}
+ ${result}= RestPerfClient.Grep_Restperfclient_Log Status code
BuiltIn.Should_Be_Equal '${result}' ''
Deconfigure_ODL_From_Netconf
[Documentation] Deconfigure the ODL MDSAL Northbound attached to a Netconf connector.
[Setup] SetupUtils.Setup_Test_With_Logging_And_Without_Fast_Failing
- NetconfKeywords.Remove_Device_From_Netconf odl-mdsal-northbound-via-netconf-connector
+ NetconfKeywords.Remove_Device_From_Netconf ${test_device}
Cleanup_And_Collect_For_Connector_Access
[Documentation] Delete the test data produced by the Netconf connector MDSAL access.
[Setup] SetupUtils.Setup_Test_With_Logging_And_Without_Fast_Failing
- NetconfViaRestconf.Delete_Xml_Template_Folder_Via_Restconf ${DIRECTORY_WITH_TEMPLATE_FOLDERS}${/}cars-delete {}
- SSHLibrary.Get_File ${restperfclientlog}
+ RestPerfClient.Collect_From_Restperfclient
+ TemplatedRequests.Delete_Templated ${DIRECTORY_WITH_TEMPLATE_FOLDERS}${/}cars-delete {}
*** Keywords ***
Setup_Everything
# Setup resources used by the suite.
SetupUtils.Setup_Utils_For_Setup_And_Teardown
NetconfKeywords.Setup_Netconf_Keywords
- # Connect to the tools system (rest-perf-client)
- ${restperfclient}= SSHKeywords.Open_Connection_To_Tools_System
- BuiltIn.Set_Suite_Variable ${restperfclient} ${restperfclient}
- # Initialize artifact deployment infrastructure.
- ${testtool}= SSHLibrary.Get Connection
- BuiltIn.Set_Suite_Variable ${testtool} ${testtool.index}
+ RestPerfClient.Setup_Restperfclient
+ ${device_type}= BuiltIn.Set_Variable_If ${USE_NETCONF_CONNECTOR}==${True} default ${device_type}
+ BuiltIn.Set_Suite_Variable ${device_type}
# Calculate timeouts
${value}= BuiltIn.Evaluate ${REQUEST_COUNT}/50+10
Utils.Set_User_Configurable_Variable_Default DIRECT_MDSAL_TIMEOUT ${value} s
- ${value}= DateTime.Add_Time_To_Time ${DIRECT_MDSAL_TIMEOUT} 60s result_format=compact
- Utils.Set_User_Configurable_Variable_Default DIRECT_MDSAL_TIMEOUT_FOR_TESTCASE ${value}
- ${value}= BuiltIn.Evaluate ${REQUEST_COUNT}/10+10
+ ${value}= BuiltIn.Evaluate ${REQUEST_COUNT}/10+20
Utils.Set_User_Configurable_Variable_Default NETCONF_CONNECTOR_MDSAL_TIMEOUT ${value} s
- ${value}= DateTime.Add_Time_To_Time ${NETCONF_CONNECTOR_MDSAL_TIMEOUT} 60s result_format=compact
- Utils.Set_User_Configurable_Variable_Default NETCONF_CONNECTOR_MDSAL_TIMEOUT_FOR_TESTCASE ${value}
Teardown_Everything
[Documentation] Teardown the test infrastructure, perform cleanup and release all resources.
- Teardown_Netconf_Via_Restconf
RequestsLibrary.Delete_All_Sessions
- SSHLibrary.Switch_Connection ${testtool}
- SSHLibrary.Close_Connection
+ RestPerfClient.Teardown_Restperfclient
Code Review / integration / test.git / blobdiff