English
Related papers

Related papers: Optimality guarantees for distributed statistical …

200 papers

We present DUAL-LOCO, a communication-efficient algorithm for distributed statistical estimation. DUAL-LOCO assumes that the data is distributed according to the features rather than the samples. It requires only a single round of…

Machine Learning · Statistics 2016-08-04 Christina Heinze , Brian McWilliams , Nicolai Meinshausen

In this paper, a distributed convex optimization algorithm, termed \emph{distributed coordinate dual averaging} (DCDA) algorithm, is proposed. The DCDA algorithm addresses the scenario of a large distributed optimization problem with…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-31 Milind Rao , Stefano Rini , Andrea Goldsmith

The problem of communicating sensor measurements over shared networks is prevalent in many modern large-scale distributed systems such as cyber-physical systems, wireless sensor networks, and the internet of things. Due to bandwidth…

Systems and Control · Electrical Eng. & Systems 2021-12-14 Marcos M. Vasconcelos

We consider distributed parameter estimation using interactive protocols subject to local information constraints such as bandwidth limitations, local differential privacy, and restricted measurements. We provide a unified framework…

Data Structures and Algorithms · Computer Science 2022-11-17 Jayadev Acharya , Clément L. Canonne , Ziteng Sun , Himanshu Tyagi

We consider the problem of estimating the arithmetic average of a finite collection of real vectors stored in a distributed fashion across several compute nodes subject to a communication budget constraint. Our analysis does not rely on any…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-24 Jakub Konečný , Peter Richtárik

In modern large-scale systems with sensor networks and IoT devices it is essential to collaboratively solve complex problems while utilizing network resources efficiently. In our paper we present three distributed optimization algorithms…

Systems and Control · Electrical Eng. & Systems 2025-04-24 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

This paper considers distributed nonconvex optimization with the cost functions being distributed over agents. Noting that information compression is a key tool to reduce the heavy communication load for distributed algorithms as agents…

Optimization and Control · Mathematics 2022-10-10 Xinlei Yi , Shengjun Zhang , Tao Yang , Tianyou Chai , Karl H. Johansson

We consider a private discrete distribution estimation problem with one-bit communication constraint. The privacy constraints are imposed with respect to the local differential privacy and the maximal leakage. The estimation error is…

Information Theory · Computer Science 2023-10-18 Seung-Hyun Nam , Vincent Y. F. Tan , Si-Hyeon Lee

Population protocols are a fundamental model in distributed computing, where many nodes with bounded memory and computational power have random pairwise interactions over time. This model has been studied in a rich body of literature aiming…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-05 Simina Branzei , Yuval Peres

We study distributed estimation and learning problems in a networked environment where agents exchange information to estimate unknown statistical properties of random variables from their privately observed samples. The agents can…

Machine Learning · Computer Science 2024-04-02 Marios Papachristou , M. Amin Rahimian

In distributed optimization and machine learning, multiple nodes coordinate to solve large problems. To do this, the nodes need to compress important algorithm information to bits so that it can be communicated over a digital channel. The…

Optimization and Control · Mathematics 2020-12-02 Sindri Magnússon , Hossein Shokri-Ghadikolaei , Na Li

We explore the connection between dimensionality and communication cost in distributed learning problems. Specifically we study the problem of estimating the mean $\vec{\theta}$ of an unknown $d$ dimensional gaussian distribution in the…

Machine Learning · Computer Science 2014-11-11 Ankit Garg , Tengyu Ma , Huy L. Nguyen

This paper deals with a distributed implementation of minimax adaptive control algorithm for networked dynamical systems modeled by a finite set of linear models. To hedge against the uncertainty arising out of finite number of possible…

Systems and Control · Electrical Eng. & Systems 2022-10-04 Venkatraman Renganathan , Anders Rantzer , Olle Kjellqvist

In this paper, we investigate the distributed shortest distance optimization problem for a multi-agent network to cooperatively minimize the sum of the quadratic distances from some convex sets, where each set is only associated with one…

Systems and Control · Computer Science 2016-02-04 Youcheng Lou , Yiguang Hong , Shouyang Wang

We study distribution testing with communication and memory constraints in the following computational models: (1) The {\em one-pass streaming model} where the goal is to minimize the sample complexity of the protocol subject to a memory…

Machine Learning · Computer Science 2019-06-12 Ilias Diakonikolas , Themis Gouleakis , Daniel M. Kane , Sankeerth Rao

Distributed optimization finds many applications in machine learning, signal processing, and control systems. In these real-world applications, the constraints of communication networks, particularly limited bandwidth, necessitate…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Mohammadreza Doostmohammadian , Sérgio Pequito

We study the problem of tracking multiple moving targets using a team of mobile robots. Each robot has a set of motion primitives to choose from in order to collectively maximize the number of targets tracked or the total quality of…

Robotics · Computer Science 2019-05-31 Yoonchang Sung , Ashish Kumar Budhiraja , Ryan K. Williams , Pratap Tokekar

The paper investigates the distributed estimation problem under low bit rate communications. Based on the signal-comparison (SC) consensus protocol under binary-valued communications, a new consensus+innovations type distributed estimation…

Systems and Control · Electrical Eng. & Systems 2025-03-25 Jieming Ke , Xiaodong Lu , Yanlong Zhao , Ji-Feng Zhang

A protocol for distributed estimation of discrete distributions is proposed. Each agent begins with a single sample from the distribution, and the goal is to learn the empirical distribution of the samples. The protocol is based on a simple…

Optimization and Control · Mathematics 2014-06-06 Anand D. Sarwate , Tara Javidi

Distributed computing models typically assume reliable communication between processors. While such assumptions often hold for engineered networks, e.g., due to underlying error correction protocols, their relevance to biological systems,…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-29 Ofer Feinerman , Bernhard Haeupler , Amos Korman