Efficient implementation of piecewise linear activation function for digital VLSI neural networks

Abstract

A piecewise linear approximation to the sigmoidal neuron activation function is proposed, which maps compactly into a digital integrated circuit realisation.