Boosting the Performance of RBF Networks with Dynamic Decay Adjustment

Michael R. Berthold, J. Diamond

KOPS (University of Konstanz) · 1994 · 118 citations · 11 references

Full text

Open access

Concepts

Abstract

Radial Basis Function (RBF) Networks, also known as networks of locally--tuned processing units (see [6]) are well known for their ease of use. Most algorithms used to train these types of networks, however, require a fixed architecture, in which the number of units in the hidden layer must be determined before training starts. The RCE training algorithm, introduced by Reilly, Cooper and Elbaum (see [8]), and its probabilistic extension, the P--RCE algorithm, take advantage of a growing structure in which hidden units are only introduced when necessary. The nature of these algorithms allows training to reach stability much faster than is the case for gradient--descent based methods. Unfortunately P--RCE networks do not adjust the standard deviation of their prototypes individually, using only one global value for this parameter. This paper introduces the Dynamic Decay Adjustment (DDA) algorithm which utilizes the constructive nature of the P--RCE algorithm together with independent ada...

References

11