2021 · 10 citations · 13 references
ComputingComputer ScienceDistributed SystemsMachine LearningParallel ComputingData ParallelismDeep LearningDistributed ComputingScalable Machine LearningStream ProcessingStreaming AlgorithmsDeep Learning For Big DataDistributed Machine LearningDistributed Streaming AlgorithmsGenerative Adversarial NetworksParallel Machine LearningPipelinesStreaming LearningStreaming Machine Learning
Our goals are to address challenges such as latency, scalability, throughput and heterogeneous data sources of streaming analytics and deep learning pipelines in science sensors and medical imaging applications. We present a prototype Intelligent Parallel Distributed Streaming Framework (IPDSF) that is capable of distributed streaming processing as well as performing distributed deep training in batch mode. IPDSF is designed to run streaming Artificial Intelligent (AI) analytic tasks using data parallelism including partitions of multiple streams of short time sensing data and high-resolution 3D medical images, and fine grain tasks distribution. We will show the implementation of IPDSF for two real world applications, (i) an Air Quality Index based on near real time streaming of aerosol Lidar backscatter and (ii) data generation of Covid-19 Computing Tomography (CT) scans using deep learning. We evaluate the latency, throughput, scalability, and quantitative evaluation of training and prediction compared against a baseline single instance. As the results, IPDSF scales to process thousands of streaming science sensors in parallel for Air Quality Index application. IPDSF uses novel 3D conditional Generative Adversarial Network (cGAN) training using parallel distributed Graphic Processing Units (GPU) nodes to generate realistic 3D high resolution Computed Tomography scans of Covid-19 patient lungs. We will show that IPDSF can reduce cGAN training time linearly with the number of GPUs.
13
2003 International Geoscience and Remote Sensing Symposium IGARSS
2003 · 367 citations
Evaluating Two-Stream CNN for Video Classification
Hao Ye, Zuxuan Wu, Rui-Wei Zhao et al. · 2015 · 111 citations · Full text
CT-GAN: Malicious Tampering of 3D Medical Imagery using Deep Learning
Yisroel Mirsky, Tom Mahler, Ilan Shelef et al. · arXiv (Cornell University) · 2019 · 108 citations · Full text