Performance testing modeling

Abstract

Performance testing modeling is a relative new research field. Researches investigating how to apply models to document performance testing information essentially started to be reported in the last decade. Motivated by the lack of a standard to represent performance testing information, our research group, in collaboration with an IT company, proposed a UML approach and lately a Domain-Specific Language (DSL) to support performance testing modeling. The goal of this paper is to show how we support our partner company on the decision process to replace UML by a DSL, hence we designed and conducted an experimental study to provide evidence about the benefits and drawbacks when using UML or DSL for modeling performance testing. In this paper, we report an in vitro experiment, where the subjects designed UML models and DSL models, for the purpose of evaluation with respect to the effort and suitability, from the perspective of the performance testers and the performance engineers in the context of industry and academia for modeling performance testing. Our results indicate that, for performance modeling, effort using a DSL was lower than using UML. Our statistical analysis showed that the results were valid, i.e., that to design performance testing models using our DSL is better than using UML.