English
Related papers

Related papers: Decentralized Generalized Approximate Message-Pass…

200 papers

Approximate message passing (AMP) is a low-cost iterative signal recovery algorithm for linear system models. When the system transform matrix has independent identically distributed (IID) Gaussian entries, the performance of AMP can be…

Information Theory · Computer Science 2017-01-25 Junjie Ma , Li Ping

Quantitative Acoustic Microscopy (QAM) is an imaging technology utilising high frequency ultrasound to produce quantitative two-dimensional (2D) maps of acoustical and mechanical properties of biological tissue at microscopy scale.…

Image and Video Processing · Electrical Eng. & Systems 2024-09-23 Odysseas Pappas , Jonathan Mamou , Adrian Basarab , Denis Kouame , Alin Achim

Decentralized optimization is a powerful paradigm that finds applications in engineering and learning design. This work studies decentralized composite optimization problems with non-smooth regularization terms. Most existing gradient-based…

Optimization and Control · Mathematics 2019-10-29 Sulaiman A. Alghunaim , Kun Yuan , Ali H. Sayed

This paper considers the low-observability state estimation problem in power distribution networks and develops a decentralized state estimation algorithm leveraging the matrix completion methodology. Matrix completion has been shown to be…

Optimization and Control · Mathematics 2019-10-14 April Sagan , Yajing Liu , Andrey Bernstein

Representation learning is a widely adopted framework for learning in data-scarce environments, aiming to extract common features from related tasks. While centralized approaches have been extensively studied, decentralized methods remain…

Machine Learning · Computer Science 2025-12-30 Donghwa Kang , Shana Moothedath

We consider decentralized machine learning over a network where the training data is distributed across $n$ agents, each of which can compute stochastic model updates on their local data. The agent's common goal is to find a model that…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-09 Anastasia Koloskova , Tao Lin , Sebastian U. Stich

In this paper, we present a communication-efficient federated learning framework inspired by quantized compressed sensing. The presented framework consists of gradient compression for wireless devices and gradient reconstruction for a…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-01 Yongjeong Oh , Namyoon Lee , Yo-Seb Jeon , H. Vincent Poor

In this paper, we consider the problem of multi-resolution compressed sensing (MR-CS) reconstruction, which has received little attention in the literature. Instead of always reconstructing the signal at the original high resolution (HR),…

Information Theory · Computer Science 2016-01-21 Xing Wang , Jie Liang

This chapter deals with decentralized learning algorithms for in-network processing of graph-valued data. A generic learning problem is formulated and recast into a separable form, which is iteratively minimized using the…

Optimization and Control · Mathematics 2015-04-01 Georgios B. Giannakis , Qing Ling , Gonzalo Mateos , Ioannis D. Schizas , Hao Zhu

This paper addresses the problem of approximate MAP-MRF inference in general graphical models. Following [36], we consider a family of linear programming relaxations of the problem where each relaxation is specified by a set of nested pairs…

Computer Vision and Pattern Recognition · Computer Science 2015-03-20 Vladimir Kolmogorov , Thomas Schoenemann

We propose efficient and low-complexity multiuser detection (MUD) algorithms for Gaussian multiple access channel (G-MAC) for short-packet transmission in massive machine type communications. To do so, we first formulate the G-MAC MUD…

Information Theory · Computer Science 2024-03-26 Mostafa Mohammadkarimi , Masoud Ardakani

We consider a distributed learning problem in a wireless network, consisting of N distributed edge devices and a parameter server (PS). The objective function is a sum of the edge devices' local loss functions, who aim to train a shared…

Machine Learning · Computer Science 2021-10-11 Raz Paul , Yuval Friedman , Kobi Cohen

Conformal prediction has emerged as a powerful tool for building prediction intervals that are valid in a distribution-free way. However, its evaluation may be computationally costly, especially in the high-dimensional setting where the…

Machine Learning · Statistics 2025-11-13 Lucas Clarté , Lenka Zdeborová

Generalized Vector Approximate Message Passing (GVAMP) is an efficient iterative algorithm for approximately minimum-mean-squared-error estimation of a random vector $\mathbf{x}\sim p_{\mathbf{x}}(\mathbf{x})$ from generalized linear…

Information Theory · Computer Science 2018-06-27 Christopher A. Metzler , Philip Schniter , Richard G. Baraniuk

We provide a general framework for learning diffusion bridges that transport prior to target distributions. It includes existing diffusion models for generative modeling, but also underdamped versions with degenerate diffusion matrices,…

Machine Learning · Computer Science 2025-08-14 Denis Blessing , Julius Berner , Lorenz Richter , Gerhard Neumann

A variety of problems in distributed control involve a networked system of autonomous agents cooperating to carry out some complex task in a decentralized fashion, e.g., orienting a flock of drones, or aggregating data from a network of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-01 Bernadette Charron-Bost , Patrick Lambein-Monette

The decentralized optimization paradigm assumes that each term of a finite-sum objective is privately stored by the corresponding agent. Agents are only allowed to communicate with their neighbors in the communication graph. We consider the…

Optimization and Control · Mathematics 2023-09-07 Demyan Yarmoshik , Alexander Rogozin , Alexander Gasnikov

In this paper, we present a general, multistage framework for graphical model approximation using a cascade of models such as trees. In particular, we look at the problem of covariance matrix approximation for Gaussian distributions as…

Information Theory · Computer Science 2018-08-13 Navid Tafaghodi Khajavi , Anthony Kuh

Testing a covariance matrix following a Gaussian graphical model (GGM) is considered in this paper based on observations made at a set of distributed sensors grouped into clusters. Ordered transmissions are proposed to achieve the same…

Signal Processing · Electrical Eng. & Systems 2019-10-23 Yicheng Chen , Rick S. Blum , Brian M. Sadler , Jiangfan Zhang

We study decentralized optimization where multiple agents minimize the average of their (strongly) convex, smooth losses over a communication graph. Convergence of the existing decentralized methods generally hinges on an apriori, proper…

Optimization and Control · Mathematics 2025-08-01 Ilya Kuruzov , Xiaokai Chen , Gesualdo Scutari , Alexander Gasnikov
‹ Prev 1 8 9 10 Next ›