English
Related papers

Related papers: Partial Diffusion Recursive Least-Squares for Dist…

200 papers

The goal of this paper is to propose novel strategies for adaptive learning of signals defined over graphs, which are observed over a (randomly time-varying) subset of vertices. We recast two classical adaptive algorithms in the graph…

Machine Learning · Computer Science 2018-08-01 Paolo Di Lorenzo , Paolo Banelli , Elvin Isufi , Sergio Barbarossa , Geert Leus

Recent research works on distributed adaptive networks have intensively studied the case where the nodes estimate a common parameter vector collaboratively. However, there are many applications that are multitask-oriented in the sense that…

Systems and Control · Computer Science 2013-11-04 Jie Chen , Cédric Richard , Ali Sayed

In this work, we propose adaptive link selection strategies for distributed estimation in diffusion-type wireless networks. We develop an exhaustive search-based link selection algorithm and a sparsity-inspired link selection algorithm that…

Information Theory · Computer Science 2014-01-17 Songcen Xu , Rodrigo C. de Lamare , H. Vincent Poor

Broadband wireless channels usually have the sparse nature. Based on the assumption of Gaussian noise model, adaptive filtering algorithms for reconstruction sparse channels were proposed to take advantage of channel sparsity. However,…

Information Theory · Computer Science 2015-02-20 Guan Gui , Li Xu , Wentao Ma , Badong Chen

We propose an efficient online dictionary learning algorithm for kernel-based sparse representations. In this framework, input signals are nonlinearly mapped to a high-dimensional feature space and represented sparsely using a virtual…

Machine Learning · Computer Science 2025-07-03 Ghasem Alipoor , Karl Skretting

In this paper we consider the issue of reliability of measurements in distributed adaptive estimation problem. To this aim, we assume a sensor network with different observation noise variance among the sensors and propose new estimation…

Systems and Control · Computer Science 2015-07-27 Wael M. Bazzi , Amir Rastegarnia , Azam Khalili

Functional partial least squares (FPLS) is commonly used for fitting scalar-on-function regression models. For the sake of accuracy, FPLS demands that each realization of the functional predictor is recorded as densely as possible over the…

Methodology · Statistics 2020-07-14 Zhiyang Zhou , Richard A. Lockhart

Adaptive networks rely on in-network and collaborative processing among distributed agents to deliver enhanced performance in estimation and inference tasks. Information is exchanged among the nodes, usually over noisy links. The…

Optimization and Control · Mathematics 2015-06-03 Xiaochuan Zhao , Sheng-Yuan Tu , Ali H. Sayed

We develop a Recursive $\mathcal{L}_1$-Regularized Least Squares (SPARLS) algorithm for the estimation of a sparse tap-weight vector in the adaptive filtering setting. The SPARLS algorithm exploits noisy observations of the tap-weight…

Information Theory · Computer Science 2009-01-08 Behtash Babadi , Nicholas Kalouptsidis , Vahid Tarokh

Performance analysis of $l_0$ norm constrained Recursive least Squares (RLS) algorithm is attempted in this paper. Though the performance pretty attractive compared to its various alternatives, no thorough study of theoretical analysis has…

Information Theory · Computer Science 2016-02-11 Samrat Mukhopadhyay , Bijit Kumar Das , Mrityunjoy Chakraborty

The rapid development of signal processing on graphs provides a new perspective for processing large-scale data associated with irregular domains. In many practical applications, it is necessary to handle massive data sets through complex…

Information Theory · Computer Science 2023-07-19 Xiaohan Wang , Mengdi Wang , Yuantao Gu

The dichotomous coordinate descent (DCD) algorithm has been successfully used for significant reduction in the complexity of recursive least squares (RLS) algorithms. In this work, we generalize the application of the DCD algorithm to RLS…

Machine Learning · Computer Science 2019-08-20 Y. Yu , L. Lu , Z. Zheng , W. Wang , Y. Zakharov , R. C. de Lamare

Federated learning (FL) faces critical challenges, particularly in heterogeneous environments where non-independent and identically distributed data across clients can lead to unfair and inefficient model performance. In this work, we…

Machine Learning · Computer Science 2025-05-22 Mounssif Krouka , Chaouki Ben Issaid , Mehdi Bennis

Distributionally robust supervised learning (DRSL) is emerging as a key paradigm for building reliable machine learning systems for real-world applications -- reflecting the need for classifiers and predictive models that are robust to the…

Machine Learning · Computer Science 2022-01-26 Yaodong Yu , Tianyi Lin , Eric Mazumdar , Michael I. Jordan

In this paper, we consider the distributed filtering problem over sensor networks such that all sensors cooperatively track unknown time-varying parameters by using local information. A distributed forgetting factor least squares (FFLS)…

Systems and Control · Electrical Eng. & Systems 2023-10-11 Die Gan , Siyu Xie , Zhixin Liu , Jinhu Lv

Denoising diffusion probabilistic models (DDPMs) have achieved impressive performance on various image generation tasks, including image super-resolution. By learning to reverse the process of gradually diffusing the data distribution into…

Image and Video Processing · Electrical Eng. & Systems 2023-07-25 Kai Zhao , Alex Ling Yu Hung , Kaifeng Pang , Haoxin Zheng , Kyunghyun Sung

The computational properties of neural systems are often thought to be implemented in terms of their network dynamics. Hence, recovering the system dynamics from experimentally observed neuronal time series, like multiple single-unit (MSU)…

Neurons and Cognition · Quantitative Biology 2017-07-05 Daniel Durstewitz

Traditional recursive least square (RLS) adaptive filtering is widely used to estimate the impulse responses (IR) of an unknown system. Nevertheless, the RLS estimator shows poor performance when tracking rapidly time-varying systems. In…

Signal Processing · Electrical Eng. & Systems 2021-10-25 Mohammad Towliat , Zheng Guo , Leonard J. Cimini , Xiang-Gen Xia , Aijun Song

In this paper, we consider a recursive estimation problem for linear regression where the signal to be estimated admits a sparse representation and measurement samples are only sequentially available. We propose a convergent parallel…

Optimization and Control · Mathematics 2017-12-12 Yang Yang , Mengyi Zhang , Marius Pesavento , Daniel P. Palomar

Many real world data sets exhibit an embedding of low-dimensional structure in a high-dimensional manifold. Examples include images, videos and internet traffic data. It is of great significance to reduce the storage requirements and…

Methodology · Statistics 2015-06-05 Yuejie Chi , Yonina C. Eldar , Robert Calderbank