2008 · 17 citations · 14 references
ComputingComputer EngineeringComputer ScienceOperating SystemsQuality AssuranceSoftware EngineeringDependability AnalysisFailure DetectionReliabilityReliability ModelingSoftware MaintenanceSystem MonitoringAutomated MonitoringMonitoring ReliabilityReliability AssessmentSoftware ReliabilitySoftware Reliability AssessmentSoftware Reliability EngineeringSystem ReliabilitySystem Reliability Assessment
Assessing the reliability of mass-market software (MMS), such as the Windows <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">reg</sup> operating system, presents many challenges. In this paper, we share insights gained from the Windows Vista <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">reg</sup> and Windows Vista <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">reg</sup> SP1 operating systems. First, we find that the automated reliability monitoring approach, which periodically reports reliability status, provides higher quality data and requires less effort compared to other approaches available today. We describe one instance in detail: the Windows reliability analysis component, and illustrate its advantages using data from Windows Vista. Second, we show the need to account for usage scenarios during reliability assessments. For pre-release versions of Windows Vista and Vista SP1, usage scenarios differ by 2-4X for Microsoft internal and external samples; corresponding reliability assessments differ by 2-3X. Our results help motivate and guide further research in reliability assessment.
14
Operational profiles in software-reliability engineering
Donald Musa · IEEE Software · 1993 · 770 citations
Thomas J. Ostrand, Elaine J. Weyuker, Robert M. Bell · 2004 · 273 citations
Empirical evaluation of defect projection models for widely-deployed production software systems
Paul Luo Li, Mary Shaw, Jim Herbsleb et al. · 2004 · 101 citations · Full text