X-Git-Url: https://git.opendaylight.org/gerrit/gitweb?a=blobdiff_plain;f=docs%2Fcluster%2Fcarbon%2Fsandbox.rst;fp=docs%2Fcluster%2Fcarbon%2Fsandbox.rst;h=de29fe338dbd08207b8554c487ef46eed6804d6e;hb=da742259340ba2e8ab61276f05e0263d6ed0ba39;hp=0000000000000000000000000000000000000000;hpb=2d7361d890b17d772f5e26564b17c0f5949b9efd;p=integration%2Ftest.git diff --git a/docs/cluster/carbon/sandbox.rst b/docs/cluster/carbon/sandbox.rst new file mode 100644 index 0000000000..de29fe338d --- /dev/null +++ b/docs/cluster/carbon/sandbox.rst @@ -0,0 +1,102 @@ + +Permanent draft, inaccessible: Sandbox test report +^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ + +Test Case Summary +----------------- + +RelEng stability summary. + ++ tba: Recent failures to be analyzed yet: 0. ++ test: Recent failures caused by wrong assumptions in test: 0. ++ akka: Recent failures related to pure UnreachableMember: 4. ++ tell: Recent failures not clearly caused by UnreachableMember: 6. ++ few: Tests passing unless low frequency failure happens: 2 (1 without duplication). + (Low frequency means UnreachableMemeber or similar, + related to Akka where Controller code has not real control.) ++ pass: Tests passing consistently: 41 (39 without duplication). ++ Total: 53 (50 without duplication). ++ Total minus akka: 49 (46 without duplication). ++ Total minus akka passing always or mostly: 43 (40 without duplication). ++ Acceptance rate: 43/49=87.75% (40/46=86.95% without duplication). + +Table +----- + +S017 instead of 2017 means Sandbox run (includes changes not merged to stable/carbon yet). + +Last fail is date of last failure not caused by infra +(or by a typo in test or by netconf/bgp failing to initialize properly). + +"S 17" or "2 17" in Last run means the documented run was superseded by a newer one, but not analyzed yet. + +"no sr3" means this test was not run on Sandbox, SR2 result is reported instead. +"few" status from SR2 is not inherited (such tests are marked as "pass"). +"long ago" means the last real test failue happened somewhere before SR2 release (or never). + +TODO: Copy formatting from sr2 page. + +.. table:: Releng stability results (pre-SR2) + :widths: 30,10,20,20,10,10 + + ================== ===== ========== ========== ============================================================= ========== + Scenario name Type Last fail Last run Bugs Robot link + ================== ===== ========== ========== ============================================================= ========== + bgp-1n-1m-a pass no sr3 no sr3 no sr3 + bgp-1n-300k-t pass no sr3 no sr3 no sr3 + bgp-3n-300k-ll-t akka no sr3 no sr3 `8318 `__ no sr3 + bgp-3n-300k-lr-t akka no sr3 no sr3 `8318 `__ no sr3 + ddb-cls-ms-ll-t pass long ago S017-08-24 no fail this week + ddb-cls-ms-lr-t pass long ago S017-08-24 no fail this week + ddb-cls-ps-ll-t pass long ago S017-08-24 no fail this week + ddb-cls-ps-lr-t pass long ago S017-08-24 no fail this week + ddb-elm-ms-lr-t pass long ago S017-08-24 no fail this week + ddb-elm-ms-rr-t pass long ago S017-08-24 no fail this week + ddb-elm-ms-rl-t pass long ago S017-08-24 no fail this week + ddb-elm-ps-lr-t pass long ago S017-08-24 no fail this week + ddb-elm-ps-rr-t pass long ago S017-08-24 no fail this week + ddb-elm-ps-rl-t pass long ago S017-08-24 no fail this week + ddb-li-ms-st-t pass long ago S017-08-24 no fail this week + ddb-li-ms-dt-t pass long ago S017-08-24 no fail this week + ddb-li-ps-st-t pass long ago S017-08-24 no fail this week + ddb-li-ps-dt-t tell S017-08-24 S017-08-24 `8845 `__ `link `__ + ddb-ci-ms-ll-ct-t pass long ago S017-08-24 no fail this week + ddb-ci-ms-ll-st-t pass long ago S017-08-24 no fail this week + ddb-ci-ms-lr-ct-t pass long ago S017-08-24 no fail this week + ddb-ci-ms-lr-st-t pass long ago S017-08-24 no fail this week + ddb-ci-ps-ll-ct-t pass long ago S017-08-24 no fail this week + ddb-ci-ps-ll-st-t pass long ago S017-08-24 no fail this week + ddb-ci-ps-lr-ct-t pass long ago S017-08-24 no fail this week + ddb-ci-ps-lr-st-t pass long ago S017-08-24 no fail this week + ddb-ls-ms-lr-t pass long ago S017-08-24 no fail this week + ddb-ls-ms-rr-t pass long ago S017-08-24 no fail this week + ddb-ls-ms-rl-t pass long ago S017-08-24 no fail this week + ddb-ls-ps-lr-t tell S017-08-24 S017-08-24 `8733 `__ `link `__ + ddb-ls-ps-rr-t tell S017-08-24 S017-08-24 `8733 `__ `link `__ + ddb-ls-ps-rl-t pass long ago S017-08-24 no fail this week + drb-rpp-ms-a pass long ago S017-08-24 no fail this week + drb-rph-ms-a pass long ago S017-08-24 no fail this week + drb-app-ms-a pass long ago S017-08-24 no fail this week + drb-aph-ms-a pass long ago S017-08-24 no fail this week + dnb-1n-60k-a pass no sr3 no sr3 no sr3 + ss-ms-ms-a pass long ago S017-08-24 no fail this week + ss-ph-ms-a few S017-08-24 S017-08-24 `8420 `__ `link `__ + ss-cl-ms-a pass long ago S017-08-24 no fail this week + ss-ms-ms-t pass long ago S017-08-24 no fail this week + ss-ph-ms-t few S017-08-24 S017-08-24 `8420 `__ `link `__ + ss-cl-ms-t pass long ago S017-08-24 no fail this week + netconf-ba-ms-a pass no sr3 no sr3 no fail this week + netconf-ok-ms-a tell no sr3 no sr3 `9027 `__ no fail this week + netconf-rr-ms-a tell no sr3 no sr3 `9027 `__ no fail this week + bgp-3n-300k-t-long akka no sr3 no sr3 `8318 `__ no sr3 + ddb-elm-mc-t-long pass no sr3 no sr3 no sr3 + drb-rpp-ms-a-long pass no sr3 no sr3 no sr3 + drb-rph-ms-a-long pass no sr3 no sr3 `8430 `__ no sr3 + dnb-1n-60k-a-long pass no sr3 no sr3 no sr3 + ss-ph-ms-a-long akka no sr3 no sr3 `8420 `__ no sr3 + ss-cl-ms-a-long tell S017-08-23 S017-08-23 `9054 `__ `link `__ + ================== ===== ========== ========== ============================================================= ========== + +For descriptions of test cases, see `description page `_. +Note that the link contains current description, +the details might have been implemented differently at SR1 release.