English
Related papers

Related papers: On the Binary Lossless Many-Help-One Problem with …

200 papers

We consider a rate-constrained contextual multi-armed bandit (RC-CMAB) problem, in which a group of agents are solving the same contextual multi-armed bandit (CMAB) problem. However, the contexts are observed by a remotely connected entity,…

Machine Learning · Computer Science 2022-04-28 Francesco Pase , Deniz Gündüz , Michele Zorzi

We present a general approach to the problem of determining tight asymptotic lower bounds for generalized central moments of the optimal alignment score of two independent sequences of i.i.d. random variables. At first, these are obtained…

Probability · Mathematics 2016-11-28 Ruoting Gong , Christian Houdré , Jüri Lember

We consider a multiterminal source coding problem in which a source is estimated at a central processing unit from lossy-compressed remote observations. Each lossy-encoded observation is produced by a remote sensor which obtains a noisy…

Information Theory · Computer Science 2016-05-13 Ruiyang Song , Stefano Rini , Alon Kipnis , Andrea J. Goldsmith

The optimization problem concerning the determination of the minimizer for the sum of convex functions holds significant importance in the realm of distributed and decentralized optimization. In scenarios where full knowledge of the…

Optimization and Control · Mathematics 2024-09-24 Kananart Kuwaranancharoen , Shreyas Sundaram

We consider a secure source coding problem with a rate-limited helper. In particular, Alice observes an independent and identically distributed (i.i.d.) source X and wishes to transmit this source losslessly to Bob over a rate-limited link.…

Information Theory · Computer Science 2012-12-10 Ravi Tandon , Sennur Ulukus , Kannan Ramchandran

We prove a tight lower bound (up to constant factors) on the sample complexity of any non-interactive local differentially private protocol for optimizing a linear function over the simplex. This lower bound also implies a tight lower bound…

Cryptography and Security · Computer Science 2021-05-17 Jonathan Ullman

We present a variational multi-label segmentation algorithm based on a robust Huber loss for both the data and the regularizer, minimized within a convex optimization framework. We introduce a novel constraint on the common areas, to bias…

Computer Vision and Pattern Recognition · Computer Science 2017-02-28 Byung-Woo Hong , Ja-Keoung Koo , Stefano Soatto

Decentralized optimization methods enable on-device training of machine learning models without a central coordinator. In many scenarios communication between devices is energy demanding and time consuming and forms the bottleneck of the…

Optimization and Control · Mathematics 2020-11-04 Dmitry Kovalev , Anastasia Koloskova , Martin Jaggi , Peter Richtarik , Sebastian U. Stich

We consider a multi-agent network where each node has a stochastic (local) cost function that depends on the decision variable of that node and a random variable, and further the decision variables of neighboring nodes are pairwise…

Optimization and Control · Mathematics 2021-12-24 Navjot Singh , Xuanyu Cao , Suhas Diggavi , Tamer Basar

A recent line of work has focused on the use of low-density generator matrix (LDGM) codes for lossy source coding. In this paper, wedevelop a generic technique for deriving lower bounds on the rate-distortion functions of binary linear…

Information Theory · Computer Science 2008-08-18 A. G. Dimakis , M. J. Wainwright , K. Ramchandran

The multiple-input multiple-output interference channel is considered with perfect channel information at the transmitters and single-user decoding receivers. With all transmissions restricted to single stream beamforming, we consider the…

Information Theory · Computer Science 2023-07-19 Rami Mochaourab , Pan Cao , Eduard Jorswieck

The support recovery problem consists of determining a sparse subset of a set of variables that is relevant in generating a set of observations, and arises in a diverse range of settings such as compressive sensing, and subset selection in…

Information Theory · Computer Science 2016-08-31 Jonathan Scarlett , Volkan Cevher

This paper considers weighted sum rate maximization of multiuser multiple-input single-output interference channel (MISO-IFC) under outage constraints. The outage-constrained weighted sum rate maximization problem is a nonconvex…

Information Theory · Computer Science 2010-10-25 Wei-Chiang Li , Tsung-Hui Chang , Che Lin , Chong-Yung Chi

An index code for broadcast channel with receiver side information is locally decodable if each receiver can decode its demand by observing only a subset of the transmitted codeword symbols instead of the entire codeword. Local decodability…

Information Theory · Computer Science 2020-07-31 Lakshmi Natarajan , Prasad Krishnan , V. Lalitha , Hoang Dau

This work proposes deep network models and learning algorithms for unsupervised and supervised binary hashing. Our novel network design constrains one hidden layer to directly output the binary codes. This addresses a challenging issue in…

Computer Vision and Pattern Recognition · Computer Science 2016-07-19 Thanh-Toan Do , Anh-Dzung Doan , Ngai-Man Cheung

Many problems of interest for cyber-physical network systems can be formulated as Mixed Integer Linear Programs in which the constraints are distributed among the agents. In this paper we propose a distributed algorithm to solve this class…

Optimization and Control · Mathematics 2017-12-06 Andrea Testa , Alessandro Rucco , Giuseppe Notarstefano

Upper bounds are given for the weight distribution of binary weakly self-dual codes. To get these new bounds, we introduce a novel method of utilizing unitary operations on Hilbert spaces. This method is motivated by recent progress on…

Combinatorics · Mathematics 2007-07-16 Vwani P. Roychowdhury , Farrokh Vatan

Consider the following information theoretic setup wherein independent codebooks of N correlated random variables are generated according to their respective marginals. The problem of determining the conditions on the rates of codebooks to…

Information Theory · Computer Science 2012-05-08 Kumar Viswanatha , Emrah Akyol , Kenneth Rose

Communication networks often rely on some form of local failover rules for fast forwarding decisions upon link failures. While on undirected networks, up to two failures can be tolerated, when just matching packet origin and destination, on…

Data Structures and Algorithms · Computer Science 2026-03-02 Erik van den Akker , Klaus-Tycho Foerster

In this paper, we focus on solving a class of constrained non-convex non-concave saddle point problems in a decentralized manner by a group of nodes in a network. Specifically, we assume that each node has access to a summand of a global…

Optimization and Control · Mathematics 2019-11-01 Weijie Liu , Aryan Mokhtari , Asuman Ozdaglar , Sarath Pattathil , Zebang Shen , Nenggan Zheng