2009 · 50 citations · 8 references
ComputingComputer ScienceExperimental PerformancePerformance MeasurementSoftware EngineeringBenchmarkingQuality MetricsSoftware MetricsSoftware TestingBenchmark DatasetsBenchmarking MetricsBenchmarking TestingFalse Positive Rate AnalysisFalse Positive Rate EvaluationPerformance BenchmarkingSoftware BenchmarkingStatic Bug Detection
Benchmarks for bug detection tools are still in their infancy. Though in recent years various tools and techniques were introduced, little effort has been spent on creating a benchmark suite and a harness for a consistent quantitative and qualitative performance measurement. For assessing the performance of a bug detection tool and determining which tool is better than another for the type of code to be looked at, the following questions arise: 1) how many bugs are correctly found, 2) what is the tool's average false positive rate, 3) how many bugs are missed by the tool altogether, and 4) does the tool scale.
8
Improving security using extensible lightweight static analysis
David Evans, David Larochelle · IEEE Software · 2002 · 470 citations
Vulnerability Type Distributions in CVE
Steve Christey, Robert A. Martin · 2007 · 165 citations