IEEE Transactions on Circuits and Systems · 1989 · 173 citations · 14 references
ComputingComputer ScienceMachine LearningStatistical LearningTime Series AnalysisDigital Signal ProcessingSignal ProcessingAdaptive FilteringAdaptive FiltersAdaptive Signal ProcessingComputational Complexity Of DecompositionConvergenceFiltersKarhunen-loève ExpansionSignals
It has been previously shown that a real-time decomposition of the incoming signal into a set of partially uncorrelated components via an orthogonal transform, and a subsequent adaptation on these individual components, leads to faster convergence rates. Here, transform domain processing is characterized by the effect of the transform on the shape of the mean-square error surface. It is shown that the effect of an ideal transform is to convert equal error contours that are initially hyperellipses in the parameter space into hyperspheres. Five specific real-valued orthogonal transforms are compared in terms of learning characteristics and computational complexity. Since the Karhunen-Loeve transform (KLT) is the ideal transform for this application, and since the KLT is defined in terms of the statistics of the input signal, it is certain that no fixed-parameter transform can deliver optimal learning characteristics for all input signals. However, the simulations suggest that transforms can be found which give much improved performance in a given situation.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">></ETX>
14
N. Ahmed, T. Natarajan, K.R. Rao · IEEE Transactions on Computers · 1974 · 5K citations
Natural Sciences, Computer Science, Electrical Engineering +16
R. Yarlagadda · IEEE Transactions on Acoustics Speech and Signal Processing · 1976 · 1.7K citations
Computer Graphics and Image Processing · 1978 · 1.3K citations
B.K. Marlow · Optica Acta International Journal of Optics · 1979 · 1K citations