International Journal of Modern Education and Computer Science · 2021 · 52 citations · 12 references
ComputingComputer EngineeringComputer ScienceArtificial IntelligenceMachine LearningPerformance AssessmentClassificationNeural NetworksPattern RecognitionClassification AccuracyNeural Network ClassificationTrainingTraining Evaluation CriteriaTraining Verification
One of the trends in information technologies is implementing neural networks in modern software packages The fact that neural networks cannot be directly programmed (but trained) is their distinctive feature. In this regard, the urgent task is to ensure sufficient speed and quality of neural network training procedures. The process of neural network training can differ significantly depending on the problem. There are verification methods that correspond to the task's constraints; they are used to assess the training results. Verification methods provide an estimate of the entire cardinal set of examples but do not allow to estimate which subset of those causes a significant error. This fact leads to neural networks' failure to perform with the given set of hyperparameters, making training a new one time-consuming.
12
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Deep Learning using Rectified Linear Units (ReLU)
Abien Fred Agarap · arXiv (Cornell University) · 2018 · 2.5K citations · Full text