How does iteration summary report calculate step and testcase average duration
This article illustrates why the summary of individual steps average duration is not equal to the reported test-case average duration.
Appvance IQ takes only success transactions into account for average duration or sizes calculation.
If there is any failures that is encountered during any iteration, that will not be considered in the calculation.
Please consider below example for better understanding.
Scenario has 1 test case which has about 5 steps.
Number of Execution = 4
Test-case 1
4 Iterations
Execution 1 (in seconds)
Execution 2 (in secods)
Execution 3 (in seconds)
Execution 4 (in seconds)
Step Average Duration - as seen in APC Reports
STEP 1
20
21
Fail
12
17.67
STEP 2
5
7
25
13
12.5
STEP 3
Fail
8
Fail
7
7.5
STEP 4
Fail
12
11
6
9.67
STEP 5
20
23
21
4
17
Transaction Duration
FAIL
71
FAIL
42
Total from above = 64.34
From the above table, with the average duration that is displayed for all the steps, the total step average duration comes up to 64.34 which is what the user is expected to see.
How Appvance IQ works is it considers only the successful iteration, what AIQ will report is 71 + 42 / 2 = 56.5 seconds as the average step duration (as mentioned AIQ considers only the successful transactions)
Last updated: JuneOctober 02,15, 20232026
If you have any feedback on this topic, please contact us at documentation@appvance.ai