Using performance profiles to analyze the results of the 2006 CEC constrained optimization competition

Hélio J. C. Barbosa, Heder S. Bernardino, André M. S. Barreto

2010 · 58 citations · 17 references

Concepts

TL;DR

Performance profiles are an analytical tool for visualizing and interpreting benchmark experiment results. The paper discusses the explanatory power of performance profiles, argues for their broader use in evolutionary computation, and introduces novel performance measures derived from them. The authors illustrate the potential of these measures by applying the performance profiles to analyze the CEC 2006 constrained optimization competition results. The analysis corroborates some results, uncovers new facts, and yields additional conclusions.

Abstract

Performance profiles are an analytical tool for the visualization and interpretation of the results of benchmark experiments. In this paper we discuss their explanatory power, and argue that they should be more widely used by the evolutionary computation community. We also introduce some novel performance measures which can be extracted from the performance profiles. In order to illustrate their potential, we apply the referred profiles to the analysis of the results of the CEC 2006 constrained optimization competition. While some of the results are corroborated, some new facts are pointed out and additional conclusions are drawn.

References

17