Investigation of the Inter‐ and Intrascanner Reproducibility and Repeatability of Radiomics Features in <scp>T1</scp>‐Weighted Brain <scp>MRI</scp>

Abstract

BACKGROUND: Radiomics is the high throughput analysis of medical images using computer algorithms, which specifically assess textural features. It has increasingly been proposed as a tool for the development of imaging biomarkers. However, an important acknowledged limitation of radiomics is the lack of reproducibility of features produced. PURPOSE: To assess reproducibility and repeatability of radiomics variables in brain MRI through a multivisit, multicenter study. STUDY TYPE: Retrospective. POPULATION: Fourteen individuals visiting three institutions twice, 10 males with the mean age of 36.3 years and age range 25-51. FIELD STRENGTH: 3D T1W inversion recovery on three 1.5-T General Electric scanners. ASSESSMENT: Radiomics analysis by a consultant radiologist performed on the T1W images of the whole brain on all visits. All possible radiomics features were generated. STATISTICAL TEST: Concordance correlation coefficient (CCC) and dynamic range (DR) for all variables were calculated to assess the test-retest repeatability. Intraclass correlation coefficients (ICCs) were calculated to investigate the reproducibility of features across centers. RESULTS: Of 1596 features generated, 57 from center 1, 15 from center 2, and 22 from center 3 had a CCC > 0.9 and DR > 0.9. Eight variables had CCC > 0.9 and DR > 0.9 in all centers. Forty-one variables had an ICC of >0.9. No variables had CCC > 0.9, DR > 0.9, and ICC > 0.9. DATA CONCLUSION: Repeatability and reproducibility of variables is a significant limitation of radiomics analysis in 3DT1W brain MRI. Careful selection of radiomic features is required. LEVEL OF EVIDENCE: 4 TECHNICAL EFFICACY STAGE: 2.