Deep Learning Convolutional Neural Networks with Dropout - A Parallel Approach

Abstract

In the big data era, image processing for large dataset becomes an issue that requires immediate solution. We proposed an effective solution for training a deep convolutional neural network on Apache Spark, successfully reduced the processing time by nearly a half also retained a high recognition accuracy at the meantime. This network model could also prevent overfitting by applying dropout algorithm. Experiments are performed on MNIST dataset to make comparisons with different Convolutional Neural Networks (CNN) architectures in multiple dimensions thoroughly.