IEEE Transactions on Signal Processing · 2014 · 291 citations · 65 references
ComputingComputer ScienceAlgorithmsDistributed SystemsOptimizationDistributed AlgorithmsDistributed ComputingDistributed SensingDistributed Sensor NetworksSensor NetworksWireless Sensor NetworksDecentralized EstimationDistributed EstimationDistributed Machine LearningDistributed OptimizationDistributed State EstimationHyperspectral Data ProcessingMultitask Learning
Adaptive networks support decentralized inference, yet most prior work focuses on single‑parameter estimation, whereas many real‑world problems require simultaneous inference of multiple optimal parameter vectors across the network. The paper develops diffusion‑based distributed algorithms that jointly estimate multiple optimal parameter vectors by minimizing a mean‑square error criterion with ℓ2 regularization. The authors theoretically analyze the algorithm’s mean‑ and mean‑square‑error stability and performance. Simulations confirm the theoretical analysis and demonstrate that the distributed strategy effectively supports target localization and hyperspectral data unmixing.
Adaptive networks are suitable for decentralized inference tasks. Recent works have intensively studied distributed optimization problems in the case where the nodes have to estimate a single optimum parameter vector collaboratively. However, there are many important applications that are multitask-oriented in the sense that there are multiple optimum parameter vectors to be inferred simultaneously, in a collaborative manner, over the area covered by the network. In this paper, we employ diffusion strategies to develop distributed algorithms that address multitask problems by minimizing an appropriate mean-square error criterion with l2-regularization. The stability and performance of the algorithm in the mean and mean-square error sense are analyzed. Simulations are conducted to verify the theoretical findings, and to illustrate how the distributed strategy can be used in several useful applications related to target localization and hyperspectral data unmixing.
65
Fast linear iterations for distributed averaging
Lin Xiao, Stephen Boyd · Systems & Control Letters · 2004 · 2.8K citations