English
Related papers

Related papers: Fundamental Limits on Data Acquisition: Trade-offs…

200 papers

Over decades traditional information theory of source and channel coding advances toward learning and effective extraction of information from data. We propose to go one step further and offer a theoretical foundation for learning classical…

Quantum Physics · Physics 2021-07-15 Mohsen Heidari , Arun Padakandla , Wojciech Szpankowski

Shannon's sampling theorem is one of the cornerstone topics that is well understood and explored, both mathematically and algorithmically. That said, practical realization of this theorem still suffers from a severe bottleneck due to the…

Information Theory · Computer Science 2020-12-02 Ayush Bhandari , Felix Krahmer , Ramesh Raskar

We are often interested in identifying the feasible subset of a decision space under multiple constraints to permit effective design exploration. If determining feasibility required computationally expensive simulations, the cost of…

Machine Learning · Computer Science 2020-06-25 Alma Rahat , Michael Wood

Consider a linear [n,k,d]_q code C. We say that that i-th coordinate of C has locality r, if the value at this coordinate can be recovered from accessing some other r coordinates of C. Data storage applications require codes with small…

Information Theory · Computer Science 2011-06-21 Parikshit Gopalan , Cheng Huang , Huseyin Simitci , Sergey Yekhanin

The common way to optimize auction and pricing systems is to set aside a small fraction of the traffic to run experiments. This leads to the question: how can we learn the most with the smallest amount of data? For truthful auctions, this…

Computer Science and Game Theory · Computer Science 2021-11-09 Renato Paes Leme , Balasubramanian Sivan , Yifeng Teng , Pratik Worah

There has been a surge of progress in recent years in developing algorithms for testing and learning quantum states that achieve optimal copy complexity. Unfortunately, they require the use of entangled measurements across many copies of…

Quantum Physics · Physics 2020-04-20 Sebastien Bubeck , Sitan Chen , Jerry Li

We provide high probability finite sample complexity guarantees for hidden non-parametric structure learning of tree-shaped graphical models, whose hidden and observable nodes are discrete random variables with either finite or countable…

Machine Learning · Statistics 2021-04-01 Konstantinos E. Nikolakakis , Dionysios S. Kalogerias , Anand D. Sarwate

A large number of services for research data management strive to adhere to the FAIR guiding principles for scientific data management and stewardship. To evaluate these services and to indicate possible improvements, use-case-centric…

Computers and Society · Computer Science 2019-02-01 Tobias Weber , Dieter Kranzlmüller

The reliable fraction of information is an attractive score for quantifying (functional) dependencies in high-dimensional data. In this paper, we systematically explore the algorithmic implications of using this measure for optimization. We…

Artificial Intelligence · Computer Science 2018-09-17 Panagiotis Mandros , Mario Boley , Jilles Vreeken

A general notion of information-related complexity applicable to both natural and man-made systems is proposed. The overall approach is to explicitly consider a rational agent performing a certain task with a quantifiable degree of success.…

Data Analysis, Statistics and Probability · Physics 2013-01-18 Eugene Perevalov , David Grace

We design new algorithms for the combinatorial pure exploration problem in the multi-arm bandit framework. In this problem, we are given $K$ distributions and a collection of subsets $\mathcal{V} \subset 2^{[K]}$ of these distributions, and…

Machine Learning · Statistics 2019-05-29 Tongyi Cao , Akshay Krishnamurthy

This paper investigates, from information theoretic grounds, a learning problem based on the principle that any regularity in a given dataset can be exploited to extract compact features from data, i.e., using fewer bits than needed to…

Machine Learning · Statistics 2018-11-14 Matías Vera , Leonardo Rey Vega , Pablo Piantanida

This paper studies the sample complexity of searching over multiple populations. We consider a large number of populations, each corresponding to either distribution P0 or P1. The goal of the search problem studied here is to find one…

Information Theory · Computer Science 2016-11-17 Matthew L. Malloy , Gongguo Tang , Robert D. Nowak

Studying the computational complexity of problems is one of the - if not the - fundamental questions in computer science. Yet, surprisingly little is known about the computational complexity of many central problems in data mining. In this…

Computational Complexity · Computer Science 2017-09-05 Stefan Neumann , Pauli Miettinen

We study the problem of recovering an unknown compactly-supported multivariate function from samples of its Fourier transform that are acquired nonuniformly, i.e. not necessarily on a uniform Cartesian grid. Reconstruction problems of this…

Numerical Analysis · Mathematics 2022-05-04 Ben Adcock , Milana Gataric , José Luis Romero

We are interested in the nonparametric estimation of the probability density of price returns, using the kernel approach. The output of the method heavily relies on the selection of a bandwidth parameter. Many selection methods have been…

Statistical Finance · Quantitative Finance 2023-05-23 Matthieu Garcin

In the private information retrieval (PIR) problem a user wishes to retrieve, as efficiently as possible, one out of $K$ messages from $N$ non-communicating databases (each holds all $K$ messages) while revealing nothing about the identity…

Information Theory · Computer Science 2017-02-28 Hua Sun , Syed A. Jafar

Query complexity is a model of computation in which we have to compute a function $f(x_1, \ldots, x_N)$ of variables $x_i$ which can be accessed via queries. The complexity of an algorithm is measured by the number of queries that it makes.…

Quantum Physics · Physics 2017-12-19 Andris Ambainis

Suppose, we are given a set of $n$ elements to be clustered into $k$ (unknown) clusters, and an oracle/expert labeler that can interactively answer pair-wise queries of the form, "do two elements $u$ and $v$ belong to the same cluster?".…

Machine Learning · Statistics 2017-06-26 Arya Mazumdar , Barna Saha

We explicitly calculate information, fidelity, and reversibility of an arbitrary single-qubit measurement on a completely unknown state. These quantities are expressed as functions of a single parameter, which is the ratio of the two…

Quantum Physics · Physics 2011-03-21 Hiroaki Terashima