Identifying Service Performance Metrics

The business value of running scalability and performance tests becomes clear after a business formalizes a test method that includes the following:

Choose the right set of test cases. For instance, the test of a multiple-interface and high volume service will be different than a service that handles periodic requests with huge message sizes. The test needs to be oriented to address the end-user goals in using the service and delivery actionable knowledge

Accurate test runs. Understanding the scalability and performance of service requires dozens to hundreds of test case runs. Ad-hoc recording of test results is unsatisfactory. Test automation tools are plentiful and often free

Make the right conclusions when analyzing the results. Understanding the scalability and performance of service requires understanding how the throughput – measured as Transactions Per Second (TPS) at the service consumer – changes with increased message size and complexity and increased concurrent requests

All of this requires much more than an ad-hoc approach to reach useful and actionable knowledge. An understanding of the scalability and performance of SOA in multiple environments and configurations is necessary. Identifying use and test cases and test scenarios are used to understand the scalability and performance of the SOA application and analysis of the resulting data. The Appvance methodology is available in a set of developer scalability and performance kits. These kits are either available for free downloads under a commercial license or available as a commercially licensed product.