2015 · 97 citations · 37 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningPredictive AnalyticsOverfittingUnderfittingAccuracyBlack Box ModelingPerformance PredictionPerformance Prediction ModelsPredictive Performance AnalyticsPredictive Performance EvaluationRobustnessTraining
Classical approaches to performance prediction rely on two, typically antithetic, techniques: Machine Learning (ML) and Analytical Modeling (AM). ML takes a black box approach, whose accuracy strongly depends on the representativeness of the dataset used during the initial training phase. Specifically, it can achieve very good accuracy in areas of the features' space that have been sufficiently explored during the training process. Conversely, AM techniques require no or minimal training, hence exhibiting the potential for supporting prompt instantiation of the performance model of the target system. However, in order to ensure their tractability, they typically rely on a set of simplifying assumptions. Consequently, AM's accuracy can be seriously challenged in scenarios (e.g., workload conditions) in which such assumptions are not matched.
37
Pattern Recognition and Machine Learning
Journal of Electronic Imaging · 2007 · 22.1K citations
Jerome H. Friedman · Computational Statistics & Data Analysis · 2002 · 7.1K citations
Benchmarking cloud serving systems with YCSB
Brian F. Cooper, Adam Silberstein, Erwin Tam et al. · 2010 · 3.6K citations
The Lack of A Priori Distinctions Between Learning Algorithms
David H. Wolpert · Neural Computation · 1996 · 1.6K citations