English
Related papers

Related papers: Diffusion probabilistic LMS algorithm

200 papers

We consider the problem of making nonparametric inference in a class of multi-dimensional diffusions in divergence form, from low-frequency data. Statistical analysis in this setting is notoriously challenging due to the intractability of…

Methodology · Statistics 2025-01-23 Matteo Giordano , Sven Wang

This paper proposes distributed adaptive algorithms based on the conjugate gradient (CG) method and the diffusion strategy for parameter estimation over sensor networks. We present sparsity-aware conventional and modified distributed CG…

Information Theory · Computer Science 2015-11-23 Rodrigo C. de Lamare

This paper studies the problem of distributed weighted least-squares (WLS) estimation for an interconnected linear measurement network with additive noise. Two types of measurements are considered: self measurements for individual nodes,…

Systems and Control · Electrical Eng. & Systems 2020-02-27 Qiqi Yang , Zhaorong Zhang , Minyue Fu

We study the problem of distributed estimation over adaptive networks where communication delays exist between nodes. In particular, we investigate the diffusion Least-Mean- Square (LMS) strategy where delayed intermediate estimates (due to…

Signal Processing · Electrical Eng. & Systems 2020-06-24 Fei Hua , Roula Nassif , Cédric Richard , Haiyan Wang , Ali H. Sayed

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

Machine Learning · Statistics 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

This paper presents a class of new algorithms for distributed statistical estimation that exploit divide-and-conquer approach. We show that one of the key benefits of the divide-and-conquer strategy is robustness, an important…

Statistics Theory · Mathematics 2018-08-29 Stanislav Minsker , Nate Strawn

We present a new algorithm to optimize distributions defined implicitly by parameterized stochastic diffusions. Doing so allows us to modify the outcome distribution of sampling processes by optimizing over their parameters. We introduce a…

In this paper, an algorithm for estimation and compensation of second-order nonlinearity in wireless sensor setwork (WSN) in distributed estimation framework is proposed. First, the effect of second-order nonlinearity on the performance of…

Signal Processing · Electrical Eng. & Systems 2024-03-19 Hadi Zayyani , Mehdi Korki

In this paper, a new family of proportionate normalized least mean square (PNLMS) adaptive algorithms that improve the performance of identifying block-sparse systems is proposed. The main proposed algorithm, called block-sparse PNLMS…

Information Theory · Computer Science 2015-12-01 Jianming Liu , Steven L. Grant

Deep generative models offer a powerful alternative to conventional channel estimation by learning the complex prior distribution of wireless channels. Capitalizing on this potential, this paper proposes a novel channel estimation algorithm…

Information Theory · Computer Science 2025-10-27 Xiaotian Fan , Xingyu Zhou , Le Liang , Shi Jin

Recently, diffusion probabilistic models (DPMs) have achieved promising results in diverse generative tasks. A typical DPM framework includes a forward process that gradually diffuses the data distribution and a reverse process that…

Machine Learning · Computer Science 2023-10-31 Tianyu Pang , Cheng Lu , Chao Du , Min Lin , Shuicheng Yan , Zhijie Deng

The diffusion LMS algorithm has been extensively studied in recent years. This efficient strategy allows to address distributed optimization problems over networks in the case where nodes have to collaboratively estimate a single parameter…

Systems and Control · Computer Science 2016-11-17 Jie Chen , Cédric Richard , Ali H. Sayed

In this paper we provide a new efficient algorithm for approximately computing the profile maximum likelihood (PML) distribution, a prominent quantity in symmetric property estimation. We provide an algorithm which matches the previous best…

Data Structures and Algorithms · Computer Science 2020-11-06 Nima Anari , Moses Charikar , Kirankumar Shiragur , Aaron Sidford

In this paper we consider the issue of reliability of measurements in distributed adaptive estimation problem. To this aim, we assume a sensor network with different observation noise variance among the sensors and propose new estimation…

Systems and Control · Computer Science 2015-07-27 Wael M. Bazzi , Amir Rastegarnia , Azam Khalili

Decision-focused learning (DFL) integrates predictive modeling and optimization by training predictors to optimize the downstream decision target rather than merely minimizing prediction error. To date, existing DFL methods typically rely…

Machine Learning · Computer Science 2025-10-14 Zihao Zhao , Christopher Yeh , Lingkai Kong , Kai Wang

This work presents joint iterative power allocation and interference suppression algorithms for DS-CDMA networks which employ multiple relays and the amplify and forward cooperation strategy. We propose a joint constrained optimization…

Information Theory · Computer Science 2013-04-10 R. C. de Lamare , S. Li

Despite the recent visually-pleasing results achieved, the massive computational cost has been a long-standing flaw for diffusion probabilistic models (DPMs), which, in turn, greatly limits their applications on resource-limited platforms.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Xingyi Yang , Daquan Zhou , Jiashi Feng , Xinchao Wang

Probabilistic regression models the entire predictive distribution of a response variable, offering richer insights than classical point estimates and directly allowing for uncertainty quantification. While diffusion-based generative models…

Machine Learning · Computer Science 2025-10-07 Carlo Kneissl , Christopher Bülte , Philipp Scholl , Gitta Kutyniok

Robust diffusion adaptive estimation algorithms based on the maximum correntropy criterion (MCC), including adaptation to combination MCC and combination to adaptation MCC, are developed to deal with the distributed estimation over network…

Machine Learning · Statistics 2016-02-04 Wentao Ma , Badong Chen , Jiandong Duan , Haiquan Zhao

Distributed adaptive signal processing has attracted much attention in the recent decade owing to its effectiveness in many decentralized real-time applications in networked systems. Because many natural signals are highly sparse with most…

Optimization and Control · Mathematics 2017-11-22 Xuanyu Cao , K. J. Ray Liu