Multitask Diffusion Adaptation Over Networks

Jie Chen, Cédric Richard, Ali H. Sayed

IEEE Transactions on Signal Processing · 2014 · 291 citations · 65 references

DOIFull text

Open access

Concepts

TL;DR

Adaptive networks support decentralized inference, yet most prior work focuses on single‑parameter estimation, whereas many real‑world problems require simultaneous inference of multiple optimal parameter vectors across the network. The paper develops diffusion‑based distributed algorithms that jointly estimate multiple optimal parameter vectors by minimizing a mean‑square error criterion with ℓ2 regularization. The authors theoretically analyze the algorithm’s mean‑ and mean‑square‑error stability and performance. Simulations confirm the theoretical analysis and demonstrate that the distributed strategy effectively supports target localization and hyperspectral data unmixing.

Abstract

Adaptive networks are suitable for decentralized inference tasks. Recent works have intensively studied distributed optimization problems in the case where the nodes have to estimate a single optimum parameter vector collaboratively. However, there are many important applications that are multitask-oriented in the sense that there are multiple optimum parameter vectors to be inferred simultaneously, in a collaborative manner, over the area covered by the network. In this paper, we employ diffusion strategies to develop distributed algorithms that address multitask problems by minimizing an appropriate mean-square error criterion with l2-regularization. The stability and performance of the algorithm in the mean and mean-square error sense are analyzed. Simulations are conducted to verify the theoretical findings, and to illustrate how the distributed strategy can be used in several useful applications related to target localization and hyperspectral data unmixing.

References

65