English
Related papers

Related papers: Communication-Efficient Accurate Statistical Estim…

200 papers

Distributed Mean Estimation (DME) is a central building block in federated learning, where clients send local gradients to a parameter server for averaging and updating the model. Due to communication constraints, clients often use lossy…

Machine Learning · Computer Science 2022-06-16 Shay Vargaftik , Ran Ben Basat , Amit Portnoy , Gal Mendelson , Yaniv Ben-Itzhak , Michael Mitzenmacher

Estimation of Distribution Algorithms (EDAs) and Innovation Method are recognized methods for solving global optimization problems and for the estimation of parameters in diffusion processes, respectively. Well known is also that the…

Numerical Analysis · Mathematics 2018-04-10 Zochil González Arenas , Juan Carlos Jimenez , Li-Vang Lozada-Chang , Roberto Santana

Score-based generative models (SGMs) have gained prominence in sparse-view CT reconstruction for their precise sampling of complex distributions. In SGM-based reconstruction, data consistency in the score-based diffusion model ensures close…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Weiwen Wu , Yanyang Wang

This paper considers a distributed stochastic strongly convex optimization, where agents connected over a network aim to cooperatively minimize the average of all agents' local cost functions. Due to the stochasticity of gradient estimation…

Optimization and Control · Mathematics 2020-02-17 Jinlong Lei , Peng Yi , Jie Chen , Yiguang Hong

We consider large scale distributed optimization over a set of edge devices connected to a central server, where the limited communication bandwidth between the server and edge devices imposes a significant bottleneck for the optimization…

Optimization and Control · Mathematics 2021-12-28 Yujie Tang , Vikram Ramanathan , Junshan Zhang , Na Li

Methods for distributed optimization have received significant attention in recent years owing to their wide applicability in various domains. A distributed optimization method typically consists of two key components: communication and…

Optimization and Control · Mathematics 2018-06-04 Albert S. Berahas , Raghu Bollapragada , Nitish Shirish Keskar , Ermin Wei

We study the fundamental problem of Principal Component Analysis in a statistical distributed setting in which each machine out of $m$ stores a sample of $n$ points sampled i.i.d. from a single unknown distribution. We study algorithms for…

Machine Learning · Computer Science 2017-02-28 Dan Garber , Ohad Shamir , Nathan Srebro

Distributed Mean Estimation (DME), in which $n$ clients communicate vectors to a parameter server that estimates their average, is a fundamental building block in communication-efficient federated learning. In this paper, we improve on…

Machine Learning · Computer Science 2023-06-13 Ran Ben Basat , Shay Vargaftik , Amit Portnoy , Gil Einziger , Yaniv Ben-Itzhak , Michael Mitzenmacher

Generating keys and keeping them secret is critical in secure communications. Due to the "open-air" nature, key distribution is more susceptible to attacks in wireless communications. An ingenious solution is to generate common secret keys…

Cryptography and Security · Computer Science 2012-08-06 Jizhong Zhao , Wei Xi , Jinsong Han , Shaojie Tang , Xiangyang Li , Yunhao Liu , Yihong Gong , Zehua Zhou

To bridge the gap between idealised communication models and the stochastic reality of networked systems, we introduce a framework for embedding asynchronous communication directly into algorithm dynamics using stochastic differential…

Optimization and Control · Mathematics 2025-11-11 Marc Weber , John Paul Strachan , Christian Ebenbauer

We consider the problem of regularized regression in a network of communication-constrained devices. Each node has local data and objectives, and the goal is for the nodes to optimize a global objective. We develop a distributed…

Optimization and Control · Mathematics 2016-03-22 Neil McGlohon , Stacy Patterson

In this paper, we propose a distributed algorithm for stochastic smooth, non-convex optimization. We assume a worker-server architecture where $N$ nodes, each having $n$ (potentially infinite) number of samples, collaborate with the help of…

Optimization and Control · Mathematics 2020-11-09 Pranay Sharma , Swatantra Kafle , Prashant Khanduri , Saikiran Bulusu , Ketan Rajawat , Pramod K. Varshney

Discrete choice experiments (DCEs) investigate the attributes that influence individuals' choices when selecting among various options. To enhance the quality of the estimated choice models, researchers opt for Bayesian optimal designs that…

Methodology · Statistics 2025-04-01 Yicheng Mao , Roselinde Kessels , Tom van der Zanden

We consider the data-aided channel estimation (CE) problem in a reconfigurable intelligent surface (RIS)-assisted wireless communication system, where the channel and information symbols are estimated jointly during the CE phase,…

Signal Processing · Electrical Eng. & Systems 2025-06-17 Amarilton Lopes Magalhães , André Lima Férrer de Almeida , Gilderlan Tavares de Araújo

We study the optimal design of a heterogeneous coded elastic computing (CEC) network where machines have varying relative computation speeds. CEC introduced by Yang {\it et al.} is a framework which mitigates the impact of elastic events,…

Information Theory · Computer Science 2020-01-14 Nicholas Woolsey , Rong-Rong Chen , Mingyue Ji

Modern large scale machine learning applications require stochastic optimization algorithms to be implemented on distributed computational architectures. A key bottleneck is the communication overhead for exchanging information such as…

Machine Learning · Computer Science 2017-10-31 Jianqiao Wangni , Jialei Wang , Ji Liu , Tong Zhang

This paper considers distributed optimization problems, where each agent cooperatively minimizes the sum of local objective functions through the communication with its neighbors. The widely adopted distributed gradient method in solving…

Optimization and Control · Mathematics 2025-08-19 Yeming Xu , Ziyuan Guo , Kaihong Lu , Huanshui Zhang

Traditionally, systems governed by linear Partial Differential Equations (PDEs) are spatially discretized to exploit their algebraic structure and reduce the computational effort for controlling them. Due to beneficial insights of the PDEs,…

Systems and Control · Computer Science 2016-04-05 Saber Jafarizadeh

Modern applied optimization problems become more and more complex every day. Due to this fact, distributed algorithms that can speed up the process of solving an optimization problem through parallelization are of great importance. The main…

Optimization and Control · Mathematics 2023-12-14 Svetlana Tkachenko , Artem Andreev , Aleksandr Beznosikov , Alexander Gasnikov

Distributed adaptive stochastic gradient methods have been widely used for large-scale nonconvex optimization, such as training deep learning models. However, their communication complexity on finding $\varepsilon$-stationary points has…

Machine Learning · Computer Science 2023-08-25 Congliang Chen , Li Shen , Wei Liu , Zhi-Quan Luo