English
Related papers

Related papers: Geometric Lower Bounds for Distributed Parameter E…

200 papers

Modern applied optimization problems become more and more complex every day. Due to this fact, distributed algorithms that can speed up the process of solving an optimization problem through parallelization are of great importance. The main…

Optimization and Control · Mathematics 2023-12-14 Svetlana Tkachenko , Artem Andreev , Aleksandr Beznosikov , Alexander Gasnikov

We consider the problem of reducing the dimensions of parameters and data in non-Gaussian Bayesian inference problems. Our goal is to identify an "informed" subspace of the parameters and an "informative" subspace of the data so that a…

Computation · Statistics 2022-07-19 Ricardo Baptista , Youssef Marzouk , Olivier Zahm

In this paper, the problem of distributed optimization is studied via a network of agents. Each agent only has access to a stochastic gradient of its own objective function in the previous time, and can communicate with its neighbors via a…

Optimization and Control · Mathematics 2024-01-29 Yuchen Yang , Kaihong Lu , Long Wang

This paper presents distributed conjugate gradient algorithms for distributed parameter estimation and spectrum estimation over wireless sensor networks. In particular, distributed conventional conjugate gradient (CCG) and modified…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-19 R. C. de Lamare

We revisit the problem of Gaussian mean testing in a distributed, communication constrained setting, where each of $n$ users independently observes samples from an unknown $d$-dimensional spherical Gaussian distribution…

Data Structures and Algorithms · Computer Science 2026-05-29 Clément L. Canonne , Nimitt

We consider the problem of communication efficient distributed optimization where multiple nodes exchange important algorithm information in every iteration to solve large problems. In particular, we focus on the stochastic variance-reduced…

Machine Learning · Computer Science 2020-03-16 Hossein S. Ghadikolaei , Sindri Magnusson

The focus of this work is on the analysis of transmit beamforming schemes with a low-rate feedback link in wireless sensor/relay networks, where nodes in the network need to implement beamforming in a distributed manner. Specifically, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-07-14 C. Lin , V. V. Veeravalli , S. Meyn

We consider optimization problems with uncertain constraints that need to be satisfied probabilistically. When data are available, a common method to obtain feasible solutions for such problems is to impose sampled constraints, following…

Optimization and Control · Mathematics 2020-07-09 Henry Lam , Fengpei Li

We study distributed estimation of a high-dimensional static parameter vector through a group of sensors whose communication network is modeled by a fixed directed graph. Different from existing time-triggered communication schemes, an…

Systems and Control · Electrical Eng. & Systems 2021-08-10 Xingkang He , Yu Xing , Junfeng Wu , Karl H. Johansson

Given a positive integer $k$, $k$-set agreement is the distributed task in which each process $i\in [n]$ in a group of $n$ processing nodes starts with an input value $x_i$ in the set $\{0,\dots,k\}$, and must output a value $y_i$ such that…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-14 Pierre Fraigniaud , Minh Hang Nguyen , Ami Paz

We prove an \Omega(n/k+k) communication lower bound on (k-1)-round distributional complexity of the k-step pointer chasing problem under uniform input distribution, improving the \Omega(n/k - k log n) lower bound due to Yehudayoff…

Computational Complexity · Computer Science 2024-11-19 Xinyu Mao , Guangxu Yang , Jiapeng Zhang

In this paper, we study the communication and (sub)gradient computation costs in distributed optimization and give a sharp complexity analysis for the proposed distributed accelerated gradient methods. We present two algorithms based on the…

Optimization and Control · Mathematics 2020-08-19 Huan Li , Cong Fang , Wotao Yin , Zhouchen Lin

Motivated by multi-center biomedical studies that cannot share individual data due to privacy and ownership concerns, we develop communication-efficient iterative distributed algorithms for estimation and inference in the high-dimensional…

Methodology · Statistics 2024-06-25 Pierre Bayle , Jianqing Fan , Zhipeng Lou

Many algorithms in machine learning and computational geometry require, as input, the intrinsic dimension of the manifold that supports the probability distribution of the data. This parameter is rarely known and therefore has to be…

Statistics Theory · Mathematics 2020-01-01 Jisu Kim , Alessandro Rinaldo , Larry Wasserman

Recent advances in distributed optimization and learning have shown that communication compression is one of the most effective means of reducing communication. While there have been many results on convergence rates under communication…

Machine Learning · Computer Science 2022-10-12 Xinmeng Huang , Yiming Chen , Wotao Yin , Kun Yuan

We propose a new weighted average estimator for the high dimensional parameters under the distributed learning system, in which the weight assigned to each coordinate is precisely proportional to the inverse of the variance of the local…

Methodology · Statistics 2025-02-06 Jun Lu , Xiaoyu Mao , Mengyao Li , Chenping Hou

We consider distributed online learning protocols that control the exchange of information between local learners in a round-based learning scenario. The learning performance of such a protocol is intuitively optimal if approximately the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-02 Michael Kamp , Mario Boley , Michael Mock , Daniel Keren , Assaf Schuster , Izchak Sharfman

In this paper, we consider the problem of distributed parameter estimation in sensor networks. Each sensor makes successive observations of an unknown $d$-dimensional parameter, which might be subject to Gaussian random noises. They aim to…

Systems and Control · Electrical Eng. & Systems 2023-03-22 Jiaqi Yan , Hideaki Ishii

We consider distributed optimization under communication constraints for training deep learning models. We propose a new algorithm, whose parameter updates rely on two forces: a regular gradient step, and a corrective direction dictated by…

Machine Learning · Computer Science 2022-04-29 Yunfei Teng , Wenbo Gao , Francois Chalus , Anna Choromanska , Donald Goldfarb , Adrian Weller

Establishing a low-dimensional representation of the data leads to efficient data learning strategies. In many cases, the reduced dimension needs to be explicitly stated and estimated from the data. We explore the estimation of dimension in…

Methodology · Statistics 2022-02-10 Wei Q. Deng , Radu V. Craiu