How does iteration summary report calculate step and testcase average duration

This article illustrates why the summary of individual steps average duration is not equal to the reported test-case average duration.

Appvance IQ takes only success transactions into account for average duration or sizes calculation.

If there is any failures that is encountered during any iteration, that will not be considered in the calculation.

Please consider below example for better understanding.

Scenario has 1 test case which has about 5 steps.

Number of Execution = 4

Test-case 1

4 Iterations

Execution 1 (in seconds) Execution 2 (in secods) Execution 3 (in seconds) Execution 4 (in seconds)
Step Average Duration - as seen in APC Reports

STEP 1

20 21 Fail 12
17.67

STEP 2

5 7 25 13
12.5

STEP 3

Fail 8 Fail 7
7.5

STEP 4

Fail 12 11 6
9.67

STEP 5

20 23 21 4
17

Transaction Duration FAIL 71 FAIL 42
Total from above = 64.34

From the above table, with the average duration that is displayed for all the steps, the total step average duration comes up to 64.34 which is what the user is expected to see.

How Appvance IQ works is it considers only the successful iteration, what AIQ will report is 71 + 42 / 2 = 56.5 seconds as the average step duration (as mentioned AIQ considers only the successful transactions)

Last updated: June 02, 2023

If you have any feedback on this topic, please contact us at documentation@appvance.ai