A New Activation Function for Deep Neural Network

Abstract

Following machine learning, deep learning is a new emerging field of research in data science. The accuracy of deep learning models is high as compared to machine learning models due to the concept of hidden layers, activation functions, changing associated weights, decay functions. In this paper the focus is specifically at activation functions. Along with the introspection of different activation functions, a new function is also being introduced and explored experimentally.