International Journal of Managing Information Technology · 2021 · 71 citations · 24 references
ComputingComputer ScienceMachine LearningPerformance AssessmentPerformance MeasurementClassificationEnsemble LearningMetric LearningPattern RecognitionPerformance EvaluationAlgorithm Performance EvaluationClassification AccuracyClassification Accuracy MetricsClassification PrecisionMachine Learning ClassificationMachine Learning-based ClassificationModel Evaluation MetricsModel Performance Evaluation
Machine learning models have been widely used in numerous classification problems and performance measures play a critical role in machine learning model development, selection, and evaluation. This paper covers a comprehensive overview of performance measures in machine learning classification. Besides, we proposed a framework to construct a novel evaluation metric that is based on the voting results of three performance measures, each of which has strengths and limitations. The new metric can be proved better than accuracy in terms of consistency and discriminancy.
24
Scikit-learn: Machine Learning in Python
Fabián Pedregosa, Gaël Varoquaux, Alexandre Gramfort et al. · arXiv (Cornell University) · 2012 · 63.7K citations · Full text
An introduction to ROC analysis
Tom Fawcett · Pattern Recognition Letters · 2005 · 21.3K citations
The relationship between Precision-Recall and ROC curves
Jesse Davis, Mark Goadrich · 2006 · 6.3K citations · Full text