Strengthening the reporting of empirical simulation studies: Introducing the STRESS guidelines

Abstract

This study develops a standardised checklist approach to improve the reporting of discrete-event
\nsimulation, system dynamics and agent-based simulation models within the field of Operational
\nResearch and Management Science. Incomplete or ambiguous reporting means that many
\nsimulation studies are not reproducible, leaving other modellers with an incomplete picture of
\nwhat has been done and unable to judge the reliability of the results. Crucially, unclear reporting
\nmakes it difficult to reproduce or reuse findings. In this paper, we review the evidence on the quality
\nof model reporting and consolidate previous work. We derive general good practice principles
\nand three 20-item checklists aimed at Strengthening The Reporting of Empirical Simulation
\nStudies (STRESS): STRESS-DES, STRESS-ABS and STRESS-SD for discrete-event simulation, agentbased
\nsimulation and system dynamics, respectively. Given the variety of simulation projects, we
\nprovide usage and troubleshooting advice to cover a wide range of situations.