TPC-W e-commerce benchmark evaluation

Abstract

Correctly interpreting benchmark results requires a basic knowledge of the synthetic workload the benchmark uses to determine how well it represents diverse e-commerce applications' real-world workloads. Factors that influence these results include the characteristics of the system under test, the procedures used to execute the tests, and the performance metrics the benchmark generates. TPC-W performs server evaluation in a controlled Internet e-commerce environment that simulates the activities of a business-oriented transactional Web server. The authors used experimental results from their TPC-W implementation to assess the benchmark's behavior, including its granularity and sensitivity to changes in workload and system parameters.