Credibility assessment of patient-specific computational modeling using patient-specific cardiac modeling as an exemplar

Suran K. Galappaththige, Richard A. Gray, Caroline Mendonça Costa, Steven Niederer, Pras Pathmanathan

PLoS Computational Biology · 2022 · 40 citations · 50 references

DOIFull text

Open access

Concepts

TL;DR

Patient‑specific models (PSMs) are emerging as digital twins for clinical decision‑making, yet systematic credibility assessment methods for PSMs remain largely undeveloped compared to generic models. This study aims to demonstrate a credibility assessment workflow for cardiac electrophysiology PSMs as a representative exemplar. We review cardiac PSM generation and VVUQ practices, then conduct two simulation studies on a virtual cohort of 24 ventricular models—one multi‑patient verification and one uncertainty analysis of personalized versus non‑personalized inputs. The analysis identifies key PSM attributes—inter‑ and intra‑user variability, multi‑patient and every‑patient error estimation, input uncertainty, and clinical validation—that should be considered under the ASME V&V40 standard, providing a practical guide for developers of cardiac and other image‑based PSMs.

Abstract

Reliable and robust simulation of individual patients using patient-specific models (PSMs) is one of the next frontiers for modeling and simulation (M&S) in healthcare. PSMs, which form the basis of digital twins, can be employed as clinical tools to, for example, assess disease state, predict response to therapy, or optimize therapy. They may also be used to construct virtual cohorts of patients, for in silico evaluation of medical product safety and/or performance. Methods and frameworks have recently been proposed for evaluating the credibility of M&S in healthcare applications. However, such efforts have generally been motivated by models of medical devices or generic patient models; how best to evaluate the credibility of PSMs has largely been unexplored. The aim of this paper is to understand and demonstrate the credibility assessment process for PSMs using patient-specific cardiac electrophysiological (EP) modeling as an exemplar. We first review approaches used to generate cardiac PSMs and consider how verification, validation, and uncertainty quantification (VVUQ) apply to cardiac PSMs. Next, we execute two simulation studies using a publicly available virtual cohort of 24 patient-specific ventricular models, the first a multi-patient verification study, the second investigating the impact of uncertainty in personalized and non-personalized inputs in a virtual cohort. We then use the findings from our analyses to identify how important characteristics of PSMs can be considered when assessing credibility with the approach of the ASME V&V40 Standard, accounting for PSM concepts such as inter- and intra-user variability, multi-patient and “every-patient” error estimation, uncertainty quantification in personalized vs non-personalized inputs, clinical validation, and others. The results of this paper will be useful to developers of cardiac and other medical image based PSMs, when assessing PSM credibility.

References

50