Understanding the Tests

Understanding the Tests 

The Appvance Test Methodology includesdefines common test goals thatused arewhen encountered most often, however, with the fast pace oftesting Internet application services. Because application architectures and service buildingtechnologies toolscontinue thisto listevolve, the methodology is not exhaustive. Test Name and Test Benefit are self-explanatory, but Test Type and Parameters relatedlimited to thethese Scalabilitytest Index need an explanation:goals.

The following concepts are used to understand the tests defined in the methodology:

• Test Name identifies the test being performed.
• Test Benefit describes the primary benefit or objective of the test.
• Test Type determines whether the test is stateful or stateless. Each type is either stateful or stateless with each requiringrequires a different testing strategy and meetingaddresses different goalsperformance goals.

Stateless Testing: is for services responding to each request independently from all other requests and checks the impact of concurrent requests and message payload size on a service

Stateful Testing: this is similar to stateless testing, but the service provides data persistence, workflow transaction processing, message queuing, sessions, and/or data indexing

The parameters related to the Scalability Index Parameters define the test inputs showingused to measure the Scalability Index. These inputs represent expected usage patterns and help determine how service performance is expected to behave under production-like conditions.

Test Types

Stateless Testing

Stateless testing is used for services that process each request independently of other requests. The test evaluates how the service responds as factors such as concurrent requests and message payload size change.

Stateful Testing

Stateful testing is used for services that maintain state or depend on information from previous requests. This can include services that provide:

• Data persistence
• Workflow or transaction processing
• Message queuing
• User sessions
• Data indexing

Stateful testing evaluates how these state-dependent operations affect service performance and scalability under different workloads.

Scalability Index –Parameters

The parameters associated with the Scalability Index define the inputs used during the test, such as concurrency levels and payload sizes.

These parameters represent the expected usage pattern showingof the service in production and are used to determine how service performance expectationschanges whenas inthe productionworkload increases.

The Appvance methodTest requiresMethodology adefines the series of steps required to beplan, followed,execute, asand isanalyze detailedthese intests.

For more information, see The Appvance Test Methodology.