medRxiv · 2021 · 14 citations · 34 references
MedicineImmunologyOncologyImmunotherapyPrecision MedicinePrecision OncologyCancer BiomarkersCancer ImmunotherapyCancer Survival AnalysisComputational OncologyLung CancerTherapy Response AssessmentCancer Prognostic ModelingNon-small Cell Lung Cancer ImmunotherapyNon-small Cell Lung Cancer TherapyNon-small Cell Lung Cancer TreatmentPredictive Biomarker ModelingResponse Prediction ModelsTransformer TheoryTumor Biomarker Modeling
Abstract In this paper, we introduce the “Clinical Transformer” - a recasting of the widely used transformer architecture as a method for precision medicine to model relations between molecular and clinical measurements, and the survival of cancer patients. Although the emergence of immunotherapy offers a new hope for cancer patients with dramatic and durable responses having been reported, only a subset of patients demonstrate benefit. Such treatments do not directly target the tumor but recruit the patient’s immune system to fight the disease. Therefore, the response to therapy is more complicated to understand as it is affected by the patient’s physical condition, immune system fitness and the tumor. As in text, where the semantics of a word is dependent on the context of the sentence it belongs to, in immuno-therapy a biomarker may have limited meaning if measured independent of other clinical or molecular features. Hence, we hypothesize that the transformer-inspired model may potentially enable effective modelling of the semantics of different biomarkers with respect to patients’ survival time. Herein, we demonstrate that this approach can offer an attractive alternative to the survival models utilized in current practices as follows: (1) We formulate an embedding strategy applied to molecular and clinical data obtained from the patients. (2) We propose a customized objective function to predict patient survival. (3) We show the applicability of our proposed method to bioinformatics and precision medicine. Applying the clinical transformer to several immuno-oncology clinical studies, we demonstrate how the clinical transformer outperforms other linear and non-linear methods used in current practice for survival prediction. We also show that when initializing the weights of a domain-specific transformer by the weights of a cross-domain transformer, we further improve the predictions. Lastly, we show how the attention mechanism successfully captures some of the known biology behind these therapies.
34
WGCNA: an R package for weighted correlation network analysis
Peter Langfelder, Steve Horvath · BMC Bioinformatics · 2008 · 29.1K citations · Full text
Ror2 signaling regulates Golgi structure and transport through IFT20 for tumor invasiveness
Michiru Nishita, Seung‐Yeol Park, Tadashi Nishio et al. · Scientific Reports · 2017 · 16.1K citations · Full text
Tumor mutational load predicts survival after immunotherapy across multiple cancer types
Robert Samstein, Chung‐Han Lee, Alexander N. Shoushtari et al. · Nature Genetics · 2019 · 4.4K citations · Full text
Medicine, Cancer Biology, Oncology +14