2015 · 256 citations · 33 references
ComputingComputer ScienceHealth InformaticsComputational PhenotypingFeature EngineeringMachine LearningDeep LearningDisease PhenotypingNeural NetworksClinical Time Series AnalysisConvolutional Neural NetworksDeep Learning-based DetectionDeep Learning-based PhenotypingMedical Data ModelingOntologiesOntology-guided PhenotypingPrior Related Knowledge
We apply deep learning to the problem of discovery and detection of characteristic patterns of physiology in clinical time series data. We propose two novel modifications to standard neural net training that address challenges and exploit properties that are peculiar, if not exclusive, to medical data. First, we examine a general framework for using prior knowledge to regularize parameters in the topmost layers. This framework can leverage priors of any form, ranging from formal ontologies (e.g., ICD9 codes) to data-derived similarity. Second, we describe a scalable procedure for training a collection of neural networks of different sizes but with partially shared architectures. Both of these innovations are well-suited to medical applications, where available data are not yet Internet scale and have many sparse outputs (e.g., rare diagnoses) but which have exploitable structure (e.g., temporal order and relationships between labels). However, both techniques are sufficiently general to be applied to other problems and domains. We demonstrate the empirical efficacy of both techniques on two real-world hospital data sets and show that the resulting neural nets learn interpretable and clinically relevant features.
33
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 61.8K citations
A Fast Learning Algorithm for Deep Belief Nets
Geoffrey E. Hinton, Simon Osindero, Yee‐Whye Teh · Neural Computation · 2006 · 16.4K citations
PhysioBank, PhysioToolkit, and PhysioNet
Ary L. Goldberger, Luı́s A. Nunes Amaral, Leon Glass et al. · Circulation · 2000 · 14.5K citations · Full text
Extracting and composing robust features with denoising autoencoders
Pascal Vincent, Hugo Larochelle, Yoshua Bengio et al. · 2008 · 7.3K citations