English
Related papers

Related papers: Trading information complexity for error II: the c…

200 papers

Let S be a finite, ordered alphabet, and let x = x_1 x_2 ... x_n be a string over S. A "secondary index" for x answers alphabet range queries of the form: Given a range [a_l,a_r] over S, return the set I_{[a_l;a_r]} = {i |x_i \in [a_l;…

Databases · Computer Science 2008-11-19 Rasmus Pagh , S. Srinivasa Rao

We study the problem of PAC learning $\gamma$-margin halfspaces with Random Classification Noise. We establish an information-computation tradeoff suggesting an inherent gap between the sample complexity of the problem and the sample…

Machine Learning · Computer Science 2023-06-29 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis

We show that a quantum architecture with an error correction procedure limited to geometrically local operations incurs an overhead that grows with the system size, even if arbitrary error-free classical computation is allowed. In…

Quantum Physics · Physics 2023-02-10 Nouédyn Baspin , Omar Fawzi , Ala Shayeghi

Physical systems are often simulated using a stochastic computation where different final states result from identical initial states. Here, we derive the minimum energy cost of simulating a complex data set of a general physical system…

Data Analysis, Statistics and Probability · Physics 2015-05-30 Karoline Wiesner , Mile Gu , Elisabeth Rieper , Vlatko Vedral

We study the complexity of high-dimensional approximation in the $L_2$-norm when different classes of information are available; we compare the power of function evaluations with the power of arbitrary continuous linear measurements. Here,…

Numerical Analysis · Mathematics 2023-03-23 David Krieg , Pawel Siedlecki , Mario Ullrich , Henryk Woźniakowski

Consensus is one of the most thoroughly studied problems in distributed computing, yet there are still complexity gaps that have not been bridged for decades. In particular, in the classical message-passing setting with processes' crashes,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-25 MohammadTaghi HajiAghayi , Dariusz R. Kowalski , Jan Olkowski

This monograph presents a unified treatment of single- and multi-user problems in Shannon's information theory where we depart from the requirement that the error probability decays asymptotically in the blocklength. Instead, the error…

Information Theory · Computer Science 2015-04-13 Vincent Y. F. Tan

Algorithmic efficiency is essential to reducing energy and time usage for computational problems. Optimizing efficiency is important for tasks involving multiple resources, for example in stochastic calculations where the size of the random…

Computational Physics · Physics 2025-07-09 Run Yan Teh , Manushan Thenabadu , Peter D Drummond

Symmetry of information states that $C(x) + C(y|x) = C(x,y) + O(\log C(x))$. We show that a similar relation for online Kolmogorov complexity does not hold. Let the even (online Kolmogorov) complexity of an n-bitstring $x_1x_2... x_n$ be…

Information Theory · Computer Science 2014-01-09 Bruno Bauwens

In this paper, we consider a zero-order stochastic oracle model of estimating definite integrals. In this model, integral estimation methods may query an oracle function for a fixed number of noisy values of the integrand function and use…

Numerical Analysis · Mathematics 2021-07-07 Donald Q. Adams , Adarsh Barik , Jean Honorio

Let $f : \{0,1\}^n \times \{0,1\}^n \rightarrow \{0,1\}$ be a 2-party function. For every product distribution $\mu$ on $\{0,1\}^n \times \{0,1\}^n$, we show that $$\mathsf{CC}^\mu_{0.49}(f) = O\left(\left(\log \mathsf{prt}_{1/8}(f) \cdot…

Computational Complexity · Computer Science 2020-05-08 Prahladh Harsha , Rahul Jain , Jaikumar Radhakrishnan

We consider Bayesian optimization of an expensive-to-evaluate black-box objective function, where we also have access to cheaper approximations of the objective. In general, such approximations arise in applications such as reinforcement…

Machine Learning · Statistics 2016-11-16 Matthias Poloczek , Jialei Wang , Peter I. Frazier

We prove a trade-off relation between the entanglement cost and classical communication complexity of causal order structure of a protocol in distributed quantum information processing. We consider an implementation of a class of two-qubit…

Quantum Physics · Physics 2019-05-22 Eyuri Wakakuwa , Akihito Soeda , Mio Murao

Numerical analysts might be expected to pay close attention to a branch of complexity theory called information-based complexity theory (IBCT), which produces an abundance of impressive results about the quest for approximate solutions to…

Numerical Analysis · Mathematics 2025-10-20 Beresford N. Parlett

We consider the fundamental tradeoff between the storage cost and the download cost in private information retrieval systems, without any explicit structural restrictions on the storage codes, such as maximum distance separable codes or…

Information Theory · Computer Science 2019-10-29 Chao Tian

In the unit-cost comparison model, a black box takes an input two items and outputs the result of the comparison. Problems like sorting and searching have been studied in this model, and it has been generalized to include the concept of…

Data Structures and Algorithms · Computer Science 2020-04-29 Michael A. Bender , Mayank Goswami , Dzejla Mededovic , Pablo Montes , Kostas Tsichlas

This paper deals with probabilistic upper bounds for the error in functional estimation defined on some interpolation and extrapolation designs, when the function to estimate is supposed to be analytic. The error pertaining to the estimate…

Statistics Theory · Mathematics 2011-01-26 Michel Broniatowski , Giorgio Celant , Marco Di Battista , Samuela Leoni-Aubin

We study the effect that the amount of correlation in a bipartite distribution has on the communication complexity of a problem under that distribution. We introduce a new family of complexity measures that interpolates between the two…

Computational Complexity · Computer Science 2015-08-25 Ralph C. Bottesch , Dmitry Gavinsky , Hartmut Klauck

How many bits of information are required to PAC learn a class of hypotheses of VC dimension $d$? The mathematical setting we follow is that of Bassily et al. (2018), where the value of interest is the mutual information…

Machine Learning · Computer Science 2018-04-20 Ido Nachum , Jonathan Shafer , Amir Yehudayoff

Quantum operations provide a general description of the state changes allowed by quantum mechanics. The reversal of quantum operations is important for quantum error-correcting codes, teleportation, and reversing quantum measurements. We…

Quantum Physics · Physics 2009-10-30 M. A. Nielsen , Carlton M. Caves , Benjamin Schumacher , Howard Barnum