English
Related papers

Related papers: Deterministic Annealing Based Optimization for Zer…

200 papers

Noisy network coding is recently proposed for the general multi-source network by Lim, Kim, El Gamal and Chung. This scheme builds on compress-forward (CF) relaying but involves three new ideas, namely no Wyner-Ziv binning, relaxed…

Information Theory · Computer Science 2011-11-14 Peng Zhong , Ahmad Abu Al Haija , Mai Vu

The combination of source coding with decoder side-information (Wyner-Ziv problem) and channel coding with encoder side-information (Gel'fand-Pinsker problem) can be optimally solved using the separation principle. In this work we show an…

Information Theory · Computer Science 2008-12-17 Yuval Kochman , Ram Zamir

We focus on a particular form of network coding, reverse carpooling, in a wireless network where the potentially coded transmitted messages are to be decoded immediately upon reception. The network is fixed and known, and the system…

Networking and Internet Architecture · Computer Science 2010-01-20 Ali ParandehGheibi , Asuman Ozdaglar , Michelle Effros , Muriel Medard

We investigate the problem of strategic point-to-point communication with side information at the decoder, in which the encoder and the decoder have mismatched distortion functions. The decoding process is not supervised, it returns the…

Information Theory · Computer Science 2020-09-18 Maël Le Treust , Tristan Tomala

We consider the task of minimizing the sum of convex functions stored in a decentralized manner across the nodes of a communication network. This problem is relatively well-studied in the scenario when the objective functions are smooth, or…

Optimization and Control · Mathematics 2024-05-29 Dmitry Kovalev , Ekaterina Borodich , Alexander Gasnikov , Dmitrii Feoktistov

This paper studies a distributed multi-agent convex optimization problem. The system comprises multiple agents in this problem, each with a set of local data points and an associated local cost function. The agents are connected to a…

Optimization and Control · Mathematics 2021-08-20 Kushal Chakrabarti , Nirupam Gupta , Nikhil Chopra

We examine the issue of separation and code design for networks that operate over finite fields. We demonstrate that source-channel (or source-network) separation holds for several canonical network examples like the noisy multiple access…

Information Theory · Computer Science 2007-07-13 Siddharth Ray , Michelle Effros , Muriel Medard , Ralf Koetter , Tracey Ho , David Karger , Jinane Abounadi

This paper considers the problem of distributed source coding for a large network. A major obstacle that poses an existential threat to practical deployment of conventional approaches to distributed coding is the exponential growth of the…

Information Theory · Computer Science 2013-01-08 Kumar Viswanatha , Sharadh Ramaswamy , Ankur Saxena , Emrah Akyol , Kenneth Rose

Throughput and per-packet delay can present strong trade-offs that are important in the cases of delay sensitive applications.We investigate such trade-offs using a random linear network coding scheme for one or more receivers in single hop…

Networking and Internet Architecture · Computer Science 2012-02-06 Weifei Zeng , Chris T. K. Ng , Muriel Medard

Distributed optimization requires nodes to coordinate, yet full synchronization scales poorly. When $n$ nodes collaborate through $m$ pairwise regularizers, standard methods demand $\mathcal{O}(m)$ communications per iteration. This paper…

Machine Learning · Computer Science 2025-09-19 Ying Lin , Yao Kuang , Ahmet Alacaoglu , Michael P. Friedlander

We consider a real-time communication system with noisy feedback consisting of a Markov source, a forward and a backward discrete memoryless channels, and a receiver with finite memory. The objective is to design an optimal communication…

Information Theory · Computer Science 2007-09-25 Aditya Mahajan , Demosthenis Teneketzis

Distributed source coding (DSC) addresses the compression of correlated sources without communication links among them. This paper is concerned with the Wyner-Ziv problem: coding of an information source with side information available only…

Information Theory · Computer Science 2011-11-08 Cong Ling , Su Gao , Jean-Claude Belfiore

Decentralized optimization is a common paradigm used in distributed signal processing and sensing as well as privacy-preserving and large-scale machine learning. It is assumed that several computational entities locally hold objective…

Optimization and Control · Mathematics 2023-01-12 Alexander Rogozin , Demyan Yarmoshik , Ksenia Kopylova , Alexander Gasnikov

Consensus is a common method for computing a function of the data distributed among the nodes of a network. Of particular interest is distributed average consensus, whereby the nodes iteratively compute the sample average of the data stored…

Information Theory · Computer Science 2021-12-06 Ryan Pilgrim

This paper investigates the problem of zero-delay joint source-channel coding of a vector Gauss-Markov source over a multiple-input multiple-output (MIMO) additive white Gaussian noise (AWGN) channel with feedback. In contrast to the…

Information Theory · Computer Science 2023-10-19 Barron Han , Oron Sabag , Victoria Kostina , Babak Hassibi

Inspired by recent advances in distributed algorithms for approximating Wasserstein barycenters, we propose a novel distributed algorithm for this problem. The main novelty is that we consider time-varying computational networks, which are…

Optimization and Control · Mathematics 2023-07-26 Olga Yufereva , Michael Persiianov , Pavel Dvurechensky , Alexander Gasnikov , Dmitry Kovalev

We develop algorithms that find and track the optimal solution trajectory of time-varying convex optimization problems which consist of local and network-related objectives. The algorithms are derived from the prediction-correction…

Optimization and Control · Mathematics 2016-11-08 Andrea Simonetto , Alec Koppel , Aryan Mokhtari , Geert Leus , Alejandro Ribeiro

We consider the problem of decentralized optimization where a collection of agents, each having access to a local cost function, communicate over a time-varying directed network and aim to minimize the sum of those functions. In practice,…

Systems and Control · Electrical Eng. & Systems 2021-09-01 Yiyue Chen , Abolfazl Hashemi , Haris Vikalo

The Wyner-Ahlswede-K\"orner (WAK) empirical-coordination problem where the encoders cooperate via a finite-capacity one-sided link is considered. The coordination-capacity region is derived by combining several source coding techniques,…

Information Theory · Computer Science 2016-11-18 Ziv Goldfeld , Haim H. Permuter , Gerhard Kramer

The paper studies decentralized optimization over networks, where agents minimize a composite objective consisting of the sum of smooth convex functions--the agents' losses--and an additional nonsmooth convex extended value function. We…

Optimization and Control · Mathematics 2025-08-05 Xiaokai Chen , Ilya Kuruzov , Gesualdo Scutari , Alexander Gasnikov