English
Related papers

Related papers: Generalized Geometric Programming for Rate Allocat…

200 papers

Distributed averaging of agent initial conditions is a well-studied problem in context of networked systems where coordination amongst the agents is of paramount importance. The asymptotic nature of convergence of distributed averaging…

Optimization and Control · Mathematics 2017-04-28 Mangal Prakash , Saurav Talukdar , Sandeep Attree , Sourav Patel , Murti V. Salapaka

The aim of this paper is to propose diffusion strategies for distributed estimation over adaptive networks, assuming the presence of spatially correlated measurements distributed according to a Gaussian Markov random field (GMRF) model. The…

Systems and Control · Computer Science 2015-06-22 Paolo Di Lorenzo

The paper addresses large-scale, convex optimization problems that need to be solved in a distributed way by agents communicating according to a random time-varying graph. Specifically, the goal of the network is to minimize the sum of…

Optimization and Control · Mathematics 2020-10-28 Andrea Camisa , Francesco Farina , Ivano Notarnicola , Giuseppe Notarstefano

Solving a large-scale system of linear equations is a key step at the heart of many algorithms in machine learning, scientific computing, and beyond. When the problem dimension is large, computational and/or memory constraints make it…

Machine Learning · Computer Science 2017-12-12 Navid Azizan-Ruhi , Farshad Lahouti , Salman Avestimehr , Babak Hassibi

We introduce a universal quantization scheme based on random coding, and we analyze its performance. This scheme consists of a source-independent random codebook (typically_mismatched_ to the source distribution), followed by optimal…

Information Theory · Computer Science 2007-07-13 Ioannis Kontoyiannis , Rami Zamir

In this paper, we hope to bring closer graph theory and consensus algorithms. Firstly, we give a brief introduction to graph theory by listing a concise definition. Then we analyze and visualize some commonly used graphs. Secondly, we…

Discrete Mathematics · Computer Science 2021-01-27 Shen Zheng

The guesswork refers to the distribution of the minimum number of trials needed to guess a realization of a random variable accurately. In this study, a non-trivial generalization of the guesswork called guessing cost (also referred to as…

Information Theory · Computer Science 2023-12-11 Suayb S. Arslan , Elif Haytaoglu

Most algorithms for decentralized learning employ a consensus or diffusion mechanism to drive agents to a common solution of a global optimization problem. Generally this takes the form of linear averaging, at a rate of contraction…

Optimization and Control · Mathematics 2024-06-07 Aaron Fainman , Stefan Vlaski

We examine the coordinated and universal rate-efficient sampling of a subset of correlated discrete memoryless sources followed by lossy compression of the sampled sources. The goal is to reconstruct a predesignated subset of sources within…

Information Theory · Computer Science 2017-06-23 Vinay Praneeth Boda , Prakash Narayan

This paper discusses distributed approaches for the solution of random convex programs (RCP). RCPs are convex optimization problems with a (usually large) number N of randomly extracted constraints; they arise in several applicative areas,…

Optimization and Control · Mathematics 2012-07-27 Luca Carlone , Vaibhav Srivastava , Francesco Bullo , Giuseppe Calafiore

We study the problem of achieving average consensus between a group of agents over a network with erasure links. In the context of consensus problems, the unreliability of communication links between nodes has been traditionally modeled by…

Optimization and Control · Mathematics 2012-04-03 Ravi Teja Sukhavasi , Babak Hassibi

In this paper, we propose a distributed algorithm (herein called HARQ-QAC) that enables nodes to calculate the average of their initial states by exchanging quantized messages over a directed communication network. In our setting, we assume…

Systems and Control · Electrical Eng. & Systems 2025-04-15 Neofytos Charalampous , Evagoras Makridis , Apostolos I. Rikos , Themistoklis Charalambous

We consider distributed iterative algorithms for the averaging problem over time-varying topologies. Our focus is on the convergence time of such algorithms when complete (unquantized) information is available, and on the degradation of…

Optimization and Control · Mathematics 2009-01-14 Angelia Nedić , Alex Olshevsky , Asuman Ozdaglar , John Tsitsiklis

This paper aims at proposing a procedure to derive distributed algorithms for distributed consensus-based optimization by using distributed algorithms for network resource allocation and vice versa over switching networks with/without…

Optimization and Control · Mathematics 2022-08-04 Seyyed Shaho Alaviani , Atul Gajanan Kelkar , Umesh Vaidya

Motivated by broad applications in various fields of engineering, we study a network resource allocation problem where the goal is to optimally allocate a fixed quantity of resources over a network of nodes. We consider large scale networks…

Optimization and Control · Mathematics 2018-08-06 Thinh T. Doan , Carolyn L. Beck

It has been recently advocated that in large communication systems it is beneficial both for the users and for the network as a whole to store content closer to users. One particular implementation of such an approach is to co-locate caches…

Networking and Internet Architecture · Computer Science 2017-01-09 Konstantin Avrachenkov , Xinwei Bai , Jasper Goseling

We consider the problem of distributed learning, where a network of agents collectively aim to agree on a hypothesis that best explains a set of distributed observations of conditionally independent random processes. We propose a…

Optimization and Control · Mathematics 2017-04-12 Angelia Nedić , Alex Olshevsky , César A. Uribe

In learned image compression, probabilistic models play an essential role in characterizing the distribution of latent variables. The Gaussian model with mean and scale parameters has been widely used for its simplicity and effectiveness.…

Image and Video Processing · Electrical Eng. & Systems 2025-04-24 Haotian Zhang , Li Li , Dong Liu

This work presents a novel general regularized distributed solution for the state estimation problem in networked systems. Resting on the graph-based representation of sensor networks and adopting a multivariate least-squares approach, the…

Systems and Control · Electrical Eng. & Systems 2021-11-17 Marco Fabris , Giulia Michieletto , Angelo Cenedese

Existing works on distributed consensus explore linear iterations based on reversible Markov chains, which contribute to the slow convergence of the algorithms. It has been observed that by overcoming the diffusive behavior of reversible…

Information Theory · Computer Science 2016-11-18 Wenjun Li , Yanbing Zhang , Huaiyu Dai