Deep Residual Networks with Exponential Linear Unit

A. Ulah Shah, Eashan Kadam, Hena Shah, Sameer Shinde, Sandip Shingade

2016 · 116 citations · 34 references

DOIFull text

Open access

Concepts

Abstract

The depth of convolutional neural networks is a crucial ingredient for reduction in test errors on benchmarks like ImageNet and COCO. However, training a neural network becomes difficult with increasing depth. Problems like vanishing gradient and diminishing feature reuse are quite trivial in very deep convolutional neural networks.

References

34