Reduced-size neural networks through singular value decomposition and subset selection

Abstract

Singular value decomposition (SVD) can lead to compaction of information, and along with QR with column pivoting (QRcp) factorisation can be used for subset selection. The Letter proposes an application of SVD and subset selection for optimising the size of feedforward neural networks; the Mackey Glass (MG) series is used as an example.