2 Documentation Suite mixing basic operations with restart of car Leader.
4 ... Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.
6 ... This program and the accompanying materials are made available under the
7 ... terms of the Eclipse Public License v1.0 which accompanies this distribution,
8 ... and is available at http://www.eclipse.org/legal/epl-v10.html
11 ... This test kills the current leader of the "car" shard and then executes CRD
12 ... operations on the new leader and a new follower. The killed member is brought back.
13 ... This suite uses 3 different car sets, same size but different starting ID.
15 ... Other models and shards (people, car-people) are not accessed by this suite.
17 ... All data is deleted at the end of the suite.
18 ... This suite expects car module to have a separate Shard.
20 Test Setup SetupUtils.Setup_Test_With_Logging_And_Without_Fast_Failing
21 Default Tags clustering carpeople critical
23 Resource ${CURDIR}/../../../libraries/CarPeople.robot
24 Resource ${CURDIR}/../../../libraries/ClusterManagement.robot
25 Resource ${CURDIR}/../../../libraries/SetupUtils.robot
26 Resource ${CURDIR}/../../../libraries/TemplatedRequests.robot
27 Variables ${CURDIR}/../../../variables/Variables.py
31 ${FOLLOWER_2NODE_START_I} 300
32 ${LEADER_2NODE_START_I} 200
33 ${MEMBER_START_TIMEOUT} 300s
34 ${ORIGINAL_START_I} 100
35 @{SHARD_NAME_LIST} car
36 ${VAR_DIR} ${CURDIR}/../../../variables/carpeople/crud
39 Add_Original_Cars_On_Old_Leader_And_Verify
40 [Documentation] Add initial cars on car Leader.
41 TemplatedRequests.Put_As_Json_Templated folder=${VAR_DIR}/cars session=${car_leader_session} iterations=${CAR_ITEMS} iter_start=${ORIGINAL_START_I}
42 : FOR ${session} IN @{ClusterManagement__session_list}
43 \ TemplatedRequests.Get_As_Json_Templated folder=${VAR_DIR}/cars session=${session} verify=True iterations=${CAR_ITEMS} iter_start=${ORIGINAL_START_I}
45 Kill_Original_Car_Leader
46 [Documentation] Kill the car Leader to cause a new leader to get elected.
47 ClusterManagement.Kill_Single_Member ${car_leader_index} confirm=True
50 [Documentation] Wait until new car Leader is elected.
51 BuiltIn.Wait_Until_Keyword_Succeeds 30s 2s Set_Variables_For_Less_Nodes member_index_list=${car_follower_indices}
53 See_Original_Cars_On_New_Leader
54 [Documentation] GET cars from new Leader, should be the initial ones.
55 TemplatedRequests.Get_As_Json_Templated folder=${VAR_DIR}/cars session=${new_leader_session} verify=True iterations=${CAR_ITEMS} iter_start=${ORIGINAL_START_I}
57 See_Original_Cars_On_New_Followers
58 [Documentation] The same check on other existing member(s).
59 : FOR ${session} IN @{new_follower_sessions}
60 \ TemplatedRequests.Get_As_Json_Templated folder=${VAR_DIR}/cars session=${session} verify=True iterations=${CAR_ITEMS} iter_start=${ORIGINAL_START_I}
62 Delete_Original_Cars_On_New_Leader
63 [Documentation] Delete cars on the new Leader.
64 TemplatedRequests.Delete_Templated folder=${VAR_DIR}/cars session=${new_leader_session}
66 Add_Leader_Cars_On_New_Leader
67 [Documentation] Add cars on the new Leader.
68 TemplatedRequests.Put_As_Json_Templated folder=${VAR_DIR}/cars session=${new_leader_session} iterations=${CAR_ITEMS} iter_start=${LEADER_2NODE_START_I}
70 See_Leader_Cars_On_New_Leader
71 [Documentation] GET cars from new Leader, should be the new ones.
72 TemplatedRequests.Get_As_Json_Templated folder=${VAR_DIR}/cars session=${new_leader_session} verify=True iterations=${CAR_ITEMS} iter_start=${LEADER_2NODE_START_I}
74 See_Leader_Cars_On_New_Followers
75 [Documentation] The same check on other existing members.
76 : FOR ${session} IN @{new_follower_sessions}
77 \ TemplatedRequests.Get_As_Json_Templated folder=${VAR_DIR}/cars session=${session} verify=True iterations=${CAR_ITEMS} iter_start=${LEADER_2NODE_START_I}
79 Delete_Leader_Cars_On_New_First_Follower
80 [Documentation] Delete cars in new first Follower.
81 TemplatedRequests.Delete_Templated folder=${VAR_DIR}/cars session=${new_first_follower_session}
83 Add_Follower_Cars_On_New_First_Follower
84 [Documentation] Add cars on the new first Follower.
85 TemplatedRequests.Put_As_Json_Templated folder=${VAR_DIR}/cars session=${new_first_follower_session} iterations=${CAR_ITEMS} iter_start=${FOLLOWER_2NODE_START_I}
87 See_Folower_Cars_On_New_Leader
88 [Documentation] Get cars from the new Leader, should be the ones added on follower.
89 TemplatedRequests.Get_As_Json_Templated folder=${VAR_DIR}/cars session=${new_leader_session} verify=True iterations=${CAR_ITEMS} iter_start=${FOLLOWER_2NODE_START_I}
91 See_Follower_Cars_On_New_Followers
92 [Documentation] The same check on other existing members.
93 : FOR ${session} IN @{new_follower_sessions}
94 \ TemplatedRequests.Get_As_Json_Templated folder=${VAR_DIR}/cars session=${session} verify=True iterations=${CAR_ITEMS} iter_start=${FOLLOWER_2NODE_START_I}
97 [Documentation] Start the killed member without deleting the persisted data.
98 ClusterManagement.Start_Single_Member ${car_leader_index} wait_for_sync=True timeout=${MEMBER_START_TIMEOUT}
99 BuiltIn.Wait_Until_Keyword_Succeeds 30s 2s ClusterManagement.Verify_Leader_Exists_For_Each_Shard shard_name_list=${SHARD_NAME_LIST} shard_type=config
101 See_Folower_Cars_On_Old_Leader
102 [Documentation] GET cars from the restarted member, should be the ones added on follower.
103 TemplatedRequests.Get_As_Json_Templated folder=${VAR_DIR}/cars session=${car_leader_session} verify=True iterations=${CAR_ITEMS} iter_start=${FOLLOWER_2NODE_START_I}
105 Delete_Follower_Cars_On_New_Leader
106 [Documentation] Delete cars on the last Leader.
107 TemplatedRequests.Delete_Templated folder=${VAR_DIR}/cars session=${new_leader_session}
111 [Documentation] Initialize resources, memorize car shard leader and followers.
112 SetupUtils.Setup_Utils_For_Setup_And_Teardown
113 CarPeople.Set_Variables_For_Shard shard_name=car
115 Set_Variables_For_Less_Nodes
116 [Arguments] ${member_index_list}
117 [Documentation] Get current leader and followers for car shard, set additional suite variables.
118 ${leader} ${follower_list} = ClusterManagement.Get_Leader_And_Followers_For_Shard shard_name=car shard_type=config member_index_list=${member_index_list}
119 ${leader_session} = ClusterManagement.Resolve_Http_Session_For_Member member_index=${leader}
120 BuiltIn.Set_Suite_Variable \${new_leader_session} ${leader_session}
121 ${sessions} = BuiltIn.Create_List
122 : FOR ${follower_index} IN @{follower_list}
123 \ ${follower_session} = ClusterManagement.Resolve_Http_Session_For_Member member_index=${follower_index}
124 \ Collections.Append_To_List ${sessions} ${follower_session}
125 BuiltIn.Set_Suite_Variable \${new_follower_sessions} ${sessions}
126 ${first_follower_session} = Collections.Get_From_List ${sessions} 0
127 BuiltIn.Set_Suite_Variable \${new_first_follower_session} ${first_follower_session}