English
Related papers

Related papers: Partial-Diffusion Least Mean-Square Estimation Ove…

200 papers

Distributed multichannel active noise control (DMCANC), which utilizes multiple individual processors to achieve a global noise reduction performance comparable to conventional centralized multichannel active noise control (MCANC), has…

Systems and Control · Electrical Eng. & Systems 2025-03-25 Junwei Ji , Dongyuan Shi , Woon-Seng Gan

This paper focuses on the problem of recursive nonlinear least squares parameter estimation in multi-agent networks, in which the individual agents observe sequentially over time an independent and identically distributed (i.i.d.)…

Optimization and Control · Mathematics 2016-10-20 Anit Kumar Sahu , Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

The partial least squares algorithm for dependent data realisations is considered. Consequences of ignoring the dependence for the algorithm performance are studied both theoretically and in simulations. It is shown that ignoring certain…

Statistics Theory · Mathematics 2016-03-07 Marco Singer , Tatyana Krivobokova , Bert L. de Groot , Axel Munk

This work considers the problem of Distributed Mean Estimation (DME) over networks with intermittent connectivity, where the goal is to learn a global statistic over the data samples localized across distributed nodes with the help of a…

Information Theory · Computer Science 2023-03-02 Rajarshi Saha , Mohamed Seif , Michal Yemini , Andrea J. Goldsmith , H. Vincent Poor

This paper studies the problem of estimation from relative measurements in a graph, in which a vector indexed over the nodes has to be reconstructed from pairwise measurements of differences between its components associated to nodes…

Systems and Control · Computer Science 2018-07-27 Chiara Ravazzi , Nelson P. K. Chan , Paolo Frasca

Large language models (LLMs) have achieved remarkable success across various artificial intelligence tasks. However, their enormous sizes and computational demands pose significant challenges for the deployment on edge devices. To address…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-19 Kai Zhang , Hengtao He , Shenghui Song , Jun Zhang , Khaled B. Letaief

Due to the limited generation and finite inertia, microgrid suffers from the large frequency and voltage deviation which can lead to system collapse. Thus, reliable load shedding to keep frequency stable is required. Wireless network,…

Systems and Control · Computer Science 2018-07-24 Qimin Xu , Bo Yang , Cailian Chen , Feilong Lin , Xinping Guan

The trimming scheme with a prefixed cutoff portion is known as a method of improving the robustness of statistical models such as multivariate Gaussian mixture models (MG- MMs) in small scale tests by alleviating the impacts of outliers.…

Computation and Language · Computer Science 2014-05-20 Dalei Wu , Haiqing Wu

Diffusion models are widely used in applications ranging from image generation to inverse problems. However, training diffusion models typically requires clean ground-truth images, which are unavailable in many applications. We introduce…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Chicago Y. Park , Shirin Shoushtari , Hongyu An , Ulugbek S. Kamilov

We provide a general framework for learning diffusion bridges that transport prior to target distributions. It includes existing diffusion models for generative modeling, but also underdamped versions with degenerate diffusion matrices,…

Machine Learning · Computer Science 2025-08-14 Denis Blessing , Julius Berner , Lorenz Richter , Gerhard Neumann

Recent years have witnessed an increasing popularity of algorithm design for distributed data, largely due to the fact that massive datasets are often collected and stored in different locations. In the distributed setting communication…

Data Structures and Algorithms · Computer Science 2017-06-06 Sudipto Guha , Yi Li , Qin Zhang

Alternating Direction Method of Multipliers (ADMM) is a popular convex optimization algorithm, which can be employed for solving distributed consensus optimization problems. In this setting agents locally estimate the optimal solution of an…

Signal Processing · Electrical Eng. & Systems 2019-03-27 Layla Majzoobi , Farshad Lahouti , Vahid Shah-Mansouri

Some system identification problems impose nonnegativity constraints on the parameters to estimate due to inherent physical characteristics of the unknown system. The nonnegative least-mean-square (NNLMS) algorithm and its variants allow to…

Numerical Analysis · Computer Science 2015-08-25 Jingen Ni , Jian Yang , Jie Chen , Cédric Richard , José Carlos M. Bermudez

Diffusion models have become fundamental tools for modeling data distributions in machine learning. Despite their success, these models face challenges when generating data with extreme brightness values, as evidenced by limitations…

Machine Learning · Statistics 2026-04-10 Takuro Kutsuna

Diffusion models (DM) can gradually learn to remove noise, which have been widely used in artificial intelligence generated content (AIGC) in recent years. The property of DM for removing noise leads us to wonder whether DM can be applied…

Information Theory · Computer Science 2023-05-17 Tong Wu , Zhiyong Chen , Dazhi He , Liang Qian , Yin Xu , Meixia Tao , Wenjun Zhang

Accurately modeling power distribution grids is crucial for designing effective monitoring and decision making algorithms. This paper addresses the partial observability issue of data-driven distribution modeling in order to improve the…

Signal Processing · Electrical Eng. & Systems 2021-10-08 Shanny Lin , Hao Zhu

This paper considers an orthogonal frequency division multiplexing (OFDM) downlink point-to-point system with simultaneous wireless information and power transfer. It is assumed that the receiver is able to harvest energy from noise,…

Information Theory · Computer Science 2016-11-18 Derrick Wing Kwan Ng , Ernest S. Lo , Robert Schober

Decentralized LLM inference distributes computation among heterogeneous nodes across the internet, offering a performant and cost-efficient solution, alternative to traditional centralized inference. However, the low cross-node network…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-06 Jiu Chen , Shuangyan Yang , Xu Xiong , Hexiao Duan , Xinran Zhang , Jie Ren , Dong Li

Driven by the need to solve increasingly complex optimization problems in signal processing and machine learning, there has been increasing interest in understanding the behavior of gradient-descent algorithms in non-convex environments.…

Optimization and Control · Mathematics 2019-07-04 Stefan Vlaski , Ali H. Sayed

In the era of big data, it is necessary to split extremely large data sets across multiple computing nodes and construct estimators using the distributed data. When designing distributed estimators, it is desirable to minimize the amount of…

Statistics Theory · Mathematics 2022-04-25 Azeem Zaman , Botond Szabó