IEEE Transactions on Circuits and Systems I Regular Papers · 2010 · 135 citations · 50 references
EngineeringSystems EngineeringInformation TheorySeparation ProcessesSeparation ScienceDimensionality ReductionSource SeparationBivariate DistributionsComputational EfficiencyComputational Efficiency AnalysisDensity MatchingElliptical DistributionsEntropy MinimizationIndependent Component AnalysisMaximum Entropy Estimation
We first present a new (differential) entropy estimator for complex random variables by approximating the entropy estimate using a numerically computed maximum entropy bound. The associated maximum entropy distributions belong to the class of weighted linear combinations and elliptical distributions, and together, they provide a rich array of bivariate distributions for density matching. Next, we introduce a new complex independent component analysis (ICA) algorithm, complex ICA by entropy-bound minimization (complex ICA-EBM), using this new entropy estimator and a line search optimization procedure. We present simulation results to demonstrate the superior separation performance and computational efficiency of complex ICA-EBM in separation of complex sources that come from a wide range of bivariate distributions.
50
Advances in neural information processing systems 7
Krzysztof J. Cios, Mark E. Shields · Neurocomputing · 1997 · 22.3K citations
Information Theory and Statistical Mechanics
E. T. Jaynes · Physical Review · 1957 · 12.9K citations
Independent component analysis: algorithms and applications
Aapo Hyvärinen, Erkki Oja · Neural Networks · 2000 · 8.8K citations
Independent component analysis, A new concept?
Pierre Comon · Signal Processing · 1994 · 8.2K citations · Full text