English
Related papers

Related papers: On the Binary Lossless Many-Help-One Problem with …

200 papers

Local branching is an improvement heuristic, developed within the context of branch-and-bound algorithms for MILPs, which has proved to be very effective in practice. For the binary case, it is based on defining a neighbourhood of the…

Combinatorics · Mathematics 2008-12-12 Giacomo Nannicini , Pietro Belotti , Leo Liberti

In transfer learning, we wish to make inference about a target population when we have access to data both from the distribution itself, and from a different but related source distribution. We introduce a flexible framework for transfer…

Machine Learning · Statistics 2021-09-03 Henry W. J. Reeve , Timothy I. Cannings , Richard J. Samworth

We consider the distributed optimization problem for the sum of convex functions where the underlying communications network connecting agents at each time is drawn at random from a collection of directed graphs. Building on an earlier work…

Optimization and Control · Mathematics 2020-09-16 Pouya Rezaeinia , Bahman Gharesifard

The muti-layer information bottleneck (IB) problem, where information is propagated (or successively refined) from layer to layer, is considered. Based on information forwarded by the preceding layer, each stage of the network is required…

Machine Learning · Statistics 2017-11-15 Qianqian Yang , Pablo Piantanida , Deniz Gündüz

In this paper we consider the separate coding problem for $L+1$ correlated Gaussian memoryless sources. We deal with the case where $L$ separately encoded data of sources work as side information at the decoder for the reconstruction of the…

Information Theory · Computer Science 2024-08-29 Yasutada Oohama

We consider the one helper source coding problem posed and investigated by Ahlswede, K\"orner and Wyner. In this system, the error probability of decoding goes to one as the source block length $n$ goes to infinity. This implies that we…

Information Theory · Computer Science 2019-01-18 Yasutada Oohama

In this paper, we study the problem of coordinating two nodes which can only exchange information via a relay at limited rates. The nodes are allowed to do a two-round interactive two-way communication with the relay, after which they…

Information Theory · Computer Science 2012-03-06 Farzin Haddadpour , Mohammad Hossein Yassaee , Amin Gohari , Mohammad Reza Aref

We consider the discrete memoryless degraded broadcast channels with feedback. We prove that the error probability of decoding tends to one exponentially for rates outside the capacity region and derive an explicit lower bound of this…

Information Theory · Computer Science 2015-04-24 Yasutada Oohama

We consider the problem of designing an overlay network and routing mechanism that permits finding resources efficiently in a peer-to-peer system. We argue that many existing approaches to this problem can be modeled as the construction of…

Data Structures and Algorithms · Computer Science 2007-05-23 James Aspnes , Zoe Diamadi , Gauri Shah

Consider a set of N agents seeking to solve distributively the minimization problem $\inf_{x} \sum_{n = 1}^N f_n(x)$ where the convex functions $f_n$ are local to the agents. The popular Alternating Direction Method of Multipliers has the…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-12-30 Franck Iutzeler , Pascal Bianchi , Philippe Ciblat , Walid Hachem

This paper concerns sub-channel allocation in multi-user wireless networks with a view to increasing the network throughput. It is assumed there are some sub-channels to be equally divided among active links, such that the total sum rate…

Information Theory · Computer Science 2016-01-21 Mohammadreza Darabi , Amin Roustaei

We consider the problem of decomposing a higher-order tensor with binary entries. Such data problems arise frequently in applications such as neuroimaging, recommendation system, topic modeling, and sensor network localization. We propose a…

Machine Learning · Statistics 2020-09-22 Miaoyan Wang , Lexin Li

Conventional distributed approaches to coverage control may suffer from lack of convergence and poor performance, due to the fact that agents have limited information, especially in non-convex discrete environments. To address this issue,…

Computer Science and Game Theory · Computer Science 2024-04-09 Tatsuya Iwase , Aurélie Beynier , Nicolas Bredeche , Nicolas Maudet , Jason R. Marden

We consider regression problems with binary weights. Such optimization problems are ubiquitous in quantized learning models and digital communication systems. A natural approach is to optimize the corresponding Lagrangian using variants of…

Machine Learning · Computer Science 2020-12-01 Nisan Chiprut , Amir Globerson , Ami Wiesel

Advancing over up-to-date information theoretic results that assume symmetric correlation models, in this work we consider the problem of lossy binary source coding with side information, where the correlation is expressed by a generic…

Information Theory · Computer Science 2016-11-17 Andrei Sechelea , Samuel Cheng , Adrian Munteanu , Nikos Deligiannis

We study a tight Bennett-type concentration inequality for sums of heterogeneous and independent variables, defined as a one-dimensional minimization. We show that this refinement, which outperforms the standard known bounds, remains…

Optimization and Control · Mathematics 2022-11-23 Quentin Jacquet , Riadh Zorgati

We consider the problem of binary classification with abstention in the relatively less studied \emph{bounded-rate} setting. We begin by obtaining a characterization of the Bayes optimal classifier for an arbitrary input-label distribution…

Machine Learning · Computer Science 2019-05-24 Shubhanshu Shekhar , Mohammad Ghavamzadeh , Tara Javidi

We consider a distributed function computation problem in which parties observing noisy versions of a remote source facilitate the computation of a function of their observations at a fusion center through public communication. The…

Information Theory · Computer Science 2022-03-30 Onur Günlü , Matthieu Bloch , Rafael F. Schaefer

It is well known that lossless compression of a discrete memoryless source with near-uniform encoder output is possible at a rate above its entropy if and only if the encoder is randomized. This work focuses on deriving conditions for…

Information Theory · Computer Science 2016-07-12 Badri N Vellambi , Joerg Kliewer , Matthieu Bloch

This paper considers a variation of the full-information secretary problem where the random variables to be observed are independent but not necessary identically distributed. The main result is a sharp lower bound for the optimal win…

Probability · Mathematics 2018-12-12 Pieter C. Allaart , Jose A. Islas