Journal of Parallel and Distributed Computing · 2019 · 10 citations · 21 references
Artificial IntelligenceConvolutional Neural NetworkEngineeringMachine LearningMachine Learning ToolFlying RobotIntelligent SystemsVirtual SensorSystems EngineeringEmbedded Machine LearningRobot LearningMachine VisionMachine Learning ModelComputer EngineeringComputer ScienceDeep LearningNeural Architecture SearchDeep RegressionDeep Neural NetworkDeep Neural NetworksAerial RoboticsEvolutionary Genetic AlgorithmAerospace EngineeringRaw Sensor Data
Raw sensor data containing high-fidelity information is highly desirable for valuable post-processing. We developed a machine learning model that performs deep regression to infer rotorcraft component vibration spectra from a few flight conditional indicators (CI). The model consists of a deep neural network of fully connected layers (DNN) that performs high-dimensional and non-linear multivariate regression to reconstruct raw accelerometer data. The network architecture hyperparameters were optimized using an evolutionary genetic algorithm (GA) that was more effective than random and manual search methods. The best GA design was further tuned to achieve spectrum reconstruction accuracies above 95% on validation datasets. An automated model generator workflow was developed to train and evaluate thousands of DNN designs using parallel asynchronous execution on a Cray XC50, which were monitored and studied. Finally, as a verification step of the DNN inference model operation and performance, a detailed sensitivity analysis was performed using a modified Sobol sampling technique to understand response behavior and limitations. The sensitivity analysis method utilized Dask-distributed across multiple nodes on our HPC to evaluate millions of generated samples in parallel.
21
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky et al. · 2014 · 34.2K citations
Proceedings of IEEE International Conference on Computer Vision
1995 · 12.9K citations
TensorFlow: A system for large-scale machine learning
Martı́n Abadi, Paul Barham, Jianmin Chen et al. · arXiv (Cornell University) · 2016 · 8.8K citations · Full text
Random search for hyper-parameter optimization
James Bergstra, Yoshua Bengio · 2012 · 7.9K citations