Determine if the Test System is a Performance Bottleneck

Unified Test PlatformAIQ is a distributed test environment where tests run remotely on TestNodesTestNodes. remotely.A TestNode is software running on a server that uses threads to operate multiple concurrentlyvirtual runningusers concurrently.

As the number of concurrent virtual users.users Soincreases, howthe doTestNode youconsumes knowadditional CPU, memory, and network resources. If the TestNode reaches its resource limits, it can become a performance bottleneck and affect the results of the test.

To determine how many virtual users a TestNode servercan runssupport before thereaching serverits runsresource out of resources (CPU, network, and memory)?limits, AIQ recommends using Calibration Testing.Testing.

The calibration testing methodology requiresconsists of three steps:

Identify the test use cases. 
A test use case contains the steps required to operate anthe app.

application.

Identify the optimal throughput of the appapplication and test environment.
Gradually increase the number of virtual users and monitor the application's performance and the resources consumed by the test environment.

Run the complete performance test and analyze the results.
Use the results

from the calibration testing to determine whether the TestNode or the application infrastructure becomes a bottleneck during the complete performance test.

ReadFor detailed instructions, see the Calibration Test Methodology chapter of the Unified Test PlatformAIQ User Guide for detailed instructions.Guide.

Estimating Server Resources ToRequired Serveto ASupport a User Population of Users

Performance testing usingwith the AIQ Monitor identifiescan be used to identify the server-side resources neededrequired to servesupport a population of appapplication users.

AIQ Monitor is an agent-based service tothat observeobserves CPU, network, and memory bandwidthutilization aswhile UnifiedAIQ Test Platform operatesexecutes a performance test. Unified Test PlatformAIQ stores the monitored values intoin the Results RepositoryRepository, (normally,normally using MySQL or Oracle.)

The Resource Utilization report correlates the application's performance of the app towith the resources neededconsumed onby the servermonitored side.servers. This helps identify whether application infrastructure becomes a bottleneck as the number of virtual users increases.

Use the Resource panel in the Scenario Editor to identify the AIQ Monitors from which you want to logcollect results. For example, run AIQ Monitor oncan yourbe configured on:

• Web servers,servers
• Application applicationservers
• Database servers,servers
• Load databasebalancers

servers,

Viewing and load balancer.

Resource Utilization

The Resource Utilization report is available from the Analyze buttonsection.

To view the resource utilization for a test execution:

1. Open Analyze from the AIQ Start Screen to view the test details. ChooseScreen.
2. Select the execution fromyou thewant list.to Clickanalyze.
3. Select Resource Utilization from the list on the left.

Use the report to compare application performance with CPU, memory, and network utilization. This information can help determine whether the TestNode or application infrastructure is limiting the number of concurrent virtual users that the environment can support.