ACM Transactions on Knowledge Discovery from Data · 2019 · 341 citations · 23 references
BusinessInformation SystemsBusiness Process ManagementForecastingPredictive AnalyticsBusiness Process AnalysisProcess AnalysisProcess EvaluationProcess ModelingBusiness Process MonitoringComparative EvaluationPredictive MonitoringProcess Monitoring
Predictive business process monitoring uses incomplete execution traces and historical logs to forecast future states of ongoing cases, and has attracted extensive research, particularly for outcome‑oriented tasks such as predicting customer complaints or order status. This study aims to address the comparability gap by providing a systematic review, taxonomy, and comparative evaluation of outcome‑oriented predictive process monitoring methods. The authors performed a systematic review, developed a taxonomy, and experimentally compared eleven representative methods across 24 tasks derived from nine real‑life event logs. The study reveals that prior work suffers from inconsistent datasets, settings, and metrics, leading to poor comparability and an unclear assessment of method performance.
Predictive business process monitoring refers to the act of making predictions about the future state of ongoing cases of a business process, based on their incomplete execution traces and logs of historical (completed) traces. Motivated by the increasingly pervasive availability of fine-grained event data about business process executions, the problem of predictive process monitoring has received substantial attention in the past years. In particular, a considerable number of methods have been put forward to address the problem of outcome-oriented predictive process monitoring, which refers to classifying each ongoing case of a process according to a given set of possible categorical outcomes—e.g., Will the customer complain or not? Will an order be delivered, canceled, or withdrawn? Unfortunately, different authors have used different datasets, experimental settings, evaluation measures, and baselines to assess their proposals, resulting in poor comparability and an unclear picture of the relative merits and applicability of different methods. To address this gap, this article presents a systematic review and taxonomy of outcome-oriented predictive process monitoring methods, and a comparative experimental evaluation of eleven representative methods using a benchmark covering 24 predictive process monitoring tasks based on nine real-life event logs.
23
Leo Breiman · Machine Learning · 2001 · 126.2K citations · Full text
Greedy function approximation: A gradient boosting machine.
Jerome H. Friedman · The Annals of Statistics · 2001 · 29K citations · Full text
Statistical Comparisons of Classifiers over Multiple Data Sets
Janez Demšar · 2006 · 11.2K citations
Scikit-learn: Machine Learning in Python
PedregosaFabian, VaroquauxGaël, GramfortAlexandre et al. · Journal of Machine Learning Research · 2011 · 8.2K citations