English
Related papers

Related papers: Inference under Information Constraints I: Lower B…

200 papers

We consider the disclosure problem of a sender with a large data set of hard evidence who wants to persuade a receiver to take higher actions. Because the receiver will make inferences based on the distribution of the data they see, the…

Theoretical Economics · Economics 2023-11-03 Ying Gao

The problem of statistical inference in its various forms has been the subject of decades-long extensive research. Most of the effort has been focused on characterizing the behavior as a function of the number of available samples, with far…

Machine Learning · Computer Science 2024-11-12 Tomer Berg , Or Ordentlich , Ofer Shayevitz

Many experiments can be interpreted in terms of random processes operating according to some internal protocols. When experiments are costly or cannot be repeated only one or a few finite samples are available. In this paper we study data…

Data Analysis, Statistics and Probability · Physics 2016-02-02 Marian Kupczynski , Hans De Raedt

We derive information-theoretic converses (i.e., lower bounds) for the minimum time required by any algorithm for distributed function computation over a network of point-to-point channels with finite capacity, where each node of the…

Information Theory · Computer Science 2017-01-04 Aolin Xu , Maxim Raginsky

Kernel two-sample testing is a useful statistical tool in determining whether data samples arise from different distributions without imposing any parametric assumptions on those distributions. However, raw data samples can expose sensitive…

Machine Learning · Statistics 2018-08-02 Anant Raj , Ho Chung Leon Law , Dino Sejdinovic , Mijung Park

The distributed inference framework comprises of a group of spatially distributed nodes which acquire observations about a phenomenon of interest. Due to bandwidth and energy constraints, the nodes often quantize their observations into a…

Cryptography and Security · Computer Science 2015-02-20 Bhavya Kailkhura , V. Sriram Siddhardh Nadendla , Pramod K. Varshney

Given a dataset of $n$ i.i.d. samples from an unknown distribution $P$, we consider the problem of generating a sample from a distribution that is close to $P$ in total variation distance, under the constraint of differential privacy (DP).…

Data Structures and Algorithms · Computer Science 2023-06-23 Badih Ghazi , Xiao Hu , Ravi Kumar , Pasin Manurangsi

It is known that given the real sum of two independent uniformly distributed lattice points from the same nested lattice codebook, the eavesdropper can obtain at most 1 bit of information per channel regarding the value of one of the…

Information Theory · Computer Science 2009-10-15 Xiang He , Aylin Yener

Prior information often takes the form of parameter constraints. Bayesian methods include such information through prior distributions having constrained support. By using posterior sampling algorithms, one can quantify uncertainty without…

Methodology · Statistics 2018-09-25 Leo L Duan , Alexander L Young , Akihiko Nishimura , David B Dunson

This paper resolves two open problems from a recent paper, arXiv:2403.16981, concerning the sample complexity of distributed simple binary hypothesis testing under information constraints. The first open problem asks whether interaction…

Information Theory · Computer Science 2025-06-18 Hadi Kazemi , Ankit Pensia , Varun Jog

Rodrigo de Miguel et al 2007 J. Phys. A: Math. Theor. 40 5241-5260: A noisy vector channel operating under a strict complexity constraint at the receiver is introduced. According to this constraint, detected bits, obtained by performing…

Information Theory · Computer Science 2009-11-11 Rodrigo de Miguel , Ori Shental , Ralf R. Muller , Ido Kanter

We consider the discrete-time intersymbol interference (ISI) channel model, with additive Gaussian noise and fixed i.i.d. inputs. In this setting, we investigate the expression put forth by Shamai and Laroia as a conjectured lower bound for…

Information Theory · Computer Science 2014-01-08 Yair Carmon , Shlomo Shamai

We consider the problem of distributed inference where agents in a network observe a stream of private signals generated by an unknown state, and aim to uniquely identify this state from a finite set of hypotheses. We focus on scenarios…

Systems and Control · Electrical Eng. & Systems 2021-09-01 Aritra Mitra , John A. Richards , Saurabh Bagchi , Shreyas Sundaram

We study the problem of synthesising a two-user broadcast channel using a common message, where each output terminal shares an independent source of randomness with the input terminal. This generalises two problems studied in the literature…

Information Theory · Computer Science 2024-05-09 Malhar A. Managoli , Vinod M. Prabhakaran

Cut-set bounds on achievable rates for network communication protocols are not in general tight. In this paper we introduce a new technique for proving converses for the problem of transmission of correlated sources in networks, that…

Information Theory · Computer Science 2011-05-31 Amin Aminzadeh Gohari , Shenghao Yang , Sidharth Jaggi

This paper studies the problem of secure communication over the broadcast channel with receiver side information under the lens of individual secrecy constraints. That is, the transmitter wants to send two independent messages to two…

Information Theory · Computer Science 2015-02-26 Yanling Chen , O. Ozan Koyluoglu , Aydin Sezgin

We show that external randomization may enforce the convergence of test statistics to their limiting distributions in particular cases. This results in a sharper inference. Our approach is based on a central limit theorem for weighted sums.…

Statistics Theory · Mathematics 2022-11-17 Nikita Puchkin , Vladimir Ulyanov

It is crucial for robots to be aware of the presence of constraints in order to acquire safe policies. However, explicitly specifying all constraints in an environment can be a challenging task. State-of-the-art constraint inference…

Robotics · Computer Science 2024-03-06 Dimitris Papadimitriou , Daniel S. Brown

Secure multi-party computation is a central problem in modern cryptography. An important sub-class of this are problems of the following form: Alice and Bob desire to produce sample(s) of a pair of jointly distributed random variables. Each…

Information Theory · Computer Science 2010-02-10 Vinod Prabhakaran , Manoj Prabhakaran

The communication scenario under consideration in this paper corresponds to a multiuser channel with side information and consists of a broadcast channel with two legitimate receivers and an eavesdropper. Mainly, the results obtained are as…

Information Theory · Computer Science 2012-10-24 Maël Le Treust , Abdellatif Zaidi , Samson Lasaulce