IEEE Transactions on Signal Processing · 2006 · 434 citations · 18 references
Natural SciencesDecision SciencesEnergy ManagementOptimizationTime Series AnalysisConvex AnalysisDigital Signal ProcessingKalman FilteringSignal ProcessingAdaptive FilteringAdaptive FiltersFilter Performance EvaluationFilteringFiltering TheoryFiltersLeast Mean Squares FilteringStochastic Gradient Descent
Combination approaches provide an interesting way to improve adaptive filter performance. In this paper, we study the mean-square performance of a convex combination of two transversal filters. The individual filters are independently adapted using their own error signals, while the combination is adapted by means of a stochastic gradient algorithm in order to minimize the error of the overall structure. General expressions are derived that show that the method is universal with respect to the component filters, i.e., in steady-state, it performs at least as well as the best component filter. Furthermore, when the correlation between the a priori errors of the components is low enough, their combination is able to outperform both of them. Using energy conservation relations, we specialize the results to a combination of least mean-square filters operating both in stationary and in nonstationary scenarios. We also show how the universality of the scheme can be exploited to design filters with improved tracking performance.
18
A variable step size LMS algorithm
R.H. Kwong, E.W. Johnston · IEEE Transactions on Signal Processing · 1992 · 1.1K citations
Neri Merhav, Meir Feder · IEEE Transactions on Information Theory · 1998 · 457 citations