Recent advances in radial basis function networks

Abstract

In 1996 an Introduction to Radial Basis Function Networks was published on the web 2 along with a package of Matlab functions 3 . The emphasis was on the linear character of RBF networks and two techniques borrowed from statistics: forward selection and ridge regression. This document 4 is an update on developments between 1996 and 1999 and is associated with a second version of the Matlab package 5 . Improvements have been made to the forward selection and ridge regression methods and a new method, which is a cross between regression trees and RBF networks, has been developed. 1 [e-mail] 2 www.anc.ed.ac.uk/mjo/papers/intro.ps 3 www.anc.ed.ac.uk/mjo/software/rbf.zip 4 www.anc.ed.ac.uk/mjo/papers/recad.ps 5 www.anc.ed.ac.uk/mjo/software/rbf2.zip 2 CONTENTS Contents 1 Introduction 3 1.1 MacKay's Hermite Polynomial . . . . . . . . . . . . . . . . . . . . . 3 1.2 Friedman's Simulated Circuit . . . . . . . . . . . . . . . . . . . . . . 4 2 Maximum Margina...