How does iteration summary report calculate step and testcase average duration
This article illustrates why the summary of individual steps average duration is not equal to the reported test-case average duration.
Appvance IQ takes only success transactions into account for average duration or sizes calculation.
If there is any failures that is encountered during any iteration, that will not be considered in the calculation.
Please consider below example for better understanding.
Scenario has 1 test case which has about 5 steps.
Number of Execution = 4
|
Test-case 1 4 Iterations |
Execution 1 (in seconds) | Execution 2 (in secods) | Execution 3 (in seconds) | Execution 4 (in seconds) |
|
Step Average Duration - as seen in APC Reports |
|
STEP 1 |
20 | 21 | Fail | 12 |
|
17.67 |
|
STEP 2 |
5 | 7 | 25 | 13 |
|
12.5 |
|
STEP 3 |
Fail | 8 | Fail | 7 |
|
7.5 |
|
STEP 4 |
Fail | 12 | 11 | 6 |
|
9.67 |
|
STEP 5 |
20 | 23 | 21 | 4 |
|
17 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| Transaction Duration | FAIL | 71 | FAIL | 42 |
|
Total from above = 64.34 |
|
|
|
|
|
|
|
|
From the above table, with the average duration that is displayed for all the steps, the total step average duration comes up to 64.34 which is what the user is expected to see.
How Appvance IQ works is it considers only the successful iteration, what AIQ will report is 71 + 42 / 2 = 56.5 seconds as the average step duration (as mentioned AIQ considers only the successful transactions)
Last updated: June 02, 2023
If you have any feedback on this topic, please contact us at documentation@appvance.ai