ACM SIGARCH Computer Architecture News · 2007 · 153 citations · 1 references
ComputingComputer ScienceHigh-performance ComputingCompilersExperimental PerformancePerformance MeasurementBenchmarkingPerformance TuningBenchmark AnalysisBenchmarking FrameworksBenchmarking TestingMicroarchitecture Performance EvaluationPerformance BenchmarkingReportingSoftware BenchmarkingSpreadsheet Programming
The benchmarks that make up the SPEC CPU2006 benchmark suite are set-up, run, timed, and scored by the CPU tools harness. The tools have evolved over time from a collection of edit-it-yourself makefiles, scripts, and an Excel spreadsheet to the current Perl-based suite. The basic purpose of the tools is to make life easier for the benchmarker; they make it easier to tweak compilation settings, easier to keep track of those settings, and most importantly, they make it easier to follow the run and reporting rules.
1