English
Related papers

Related papers: Anti-concentration and the Exact Gap-Hamming Probl…

200 papers

Dependence among marginally constrained observations can break a finite-sample barrier. To formalize this phenomenon, we introduce the \emph{minimum list entropy coupling} $H(P\|Q_1,\dots,Q_m)$, the minimum conditional entropy…

Information Theory · Computer Science 2026-05-18 Shahab Asoodeh , Jun Chen

In the communication problem $\mathbf{UR}$ (universal relation) [KRW95], Alice and Bob respectively receive $x$ and $y$ in $\{0,1\}^n$ with the promise that $x\neq y$. The last player to receive a message must output an index $i$ such that…

Computational Complexity · Computer Science 2017-03-24 Jelani Nelson , Jakub Pachocki , Zhengyu Wang

Neural networks and other machine learning models compute continuous representations, while humans communicate with discrete symbols. Reconciling these two forms of communication is desirable to generate human-readable interpretations or to…

Machine Learning · Computer Science 2021-04-05 André F. T. Martins

We prove lower bounds for the direct sum problem for two-party bounded error randomised multiple-round communication protocols. Our proofs use the notion of information cost of a protocol, as defined by Chakrabarti, Shi, Wirth and Yao and…

Computational Complexity · Computer Science 2007-05-23 Rahul Jain , Jaikumar Radhakrishnan , Pranab Sen

Let $A$ be an $n \times n$ matrix, $X$ be an $n \times p$ matrix and $Y = AX$. A challenging and important problem in data analysis, motivated by dictionary learning and other practical problems, is to recover both $A$ and $X$, given $Y$.…

Probability · Mathematics 2015-04-02 Kyle Luh , Van Vu

We give a new, very general, formulation of the compressed sensing problem in terms of coordinate projections of an analytic variety, and derive sufficient sampling rates for signal reconstruction. Our bounds are linear in the coherence of…

Machine Learning · Computer Science 2013-11-05 Franz J. Király , Louis Theran

We investigate properties of the pseudo-Riemannian volume, entropy, and diameter for convex cocompact representations $\rho : \Gamma \to \mathrm{SO}(p,q+1)$ of closed $p$-manifold groups. In particular: We provide a uniform lower bound of…

Differential Geometry · Mathematics 2024-02-27 Filippo Mazzoli , Gabriele Viaggi

We prove a direct product theorem for the one-way entanglement-assisted quantum communication complexity of a general relation $f\subseteq\mathcal{X}\times\mathcal{Y}\times\mathcal{Z}$. For any $\varepsilon, \zeta > 0$ and any $k\geq1$, we…

Computational Complexity · Computer Science 2020-08-21 Rahul Jain , Srijita Kundu

This paper establishes the exact strong converse exponent of the soft covering problem in the classical setting. This exponent characterizes the slowest achievable convergence speed of the total variation to one when a code of rate below…

Information Theory · Computer Science 2026-04-01 Xingyi He , S. Sandeep Pradhan , Andreas Winter

We consider the communication complexity of the binary inner product function in a variation of the two-party scenario where the parties have an a priori supply of particles in an entangled quantum state. We prove linear lower bounds for…

Quantum Physics · Physics 2008-02-03 Richard Cleve , Wim van Dam , Michael Nielsen , Alain Tapp

In physical-layer security, one of the most fundamental issues is the secrecy capacity. The objective of this paper is to determine the secrecy capacity for an indoor visible light communication system consisting of a transmitter, a…

Information Theory · Computer Science 2021-09-24 Jin-Yuan Wang , Xian-Tao Fu , Jun-Bo Wang , Min Lin , Julian Cheng , Mohamed-Slim Alouini

In this paper, we derive variational formulas for the asymptotic exponents (i.e., convergence rates) of the concentration and isoperimetric functions in the product Polish probability space under certain mild assumptions. These formulas are…

Probability · Mathematics 2024-05-31 Lei Yu

Addressing questions raised in recent papers, we study the $r$-distance graph $H_r(n)$ on the Boolean cube $\{0,1\}^n$, where two vertices are adjacent if their Hamming distance is exactly $r$. For fixed integers $s \ge 2$ and even $r \ge…

Combinatorics · Mathematics 2026-04-08 József Balogh , Ce Chen , Bowen Li

Basing on recently developed convex programming framework in the paper [arXiv:2204.10626], we provide a proof for a long-standing conjecture on optimality of Gaussian encondings for the ultimate communication rate of generalized heterodyne…

Quantum Physics · Physics 2023-07-25 A. S. Holevo , S. N. Filippov

The relaxed maximum entropy problem is concerned with finding a probability distribution on a finite set that minimizes the relative entropy to a given prior distribution, while satisfying relaxed max-norm constraints with respect to a…

Machine Learning · Computer Science 2013-11-08 Moshe Dubiner , Matan Gavish , Yoram Singer

The communication complexity of many fundamental problems reduces greatly when the communicating parties share randomness that is independent of the inputs to the communication task. Natural communication processes (say between humans)…

Computational Complexity · Computer Science 2024-01-24 Clément L. Canonne , Venkatesan Guruswami , Raghu Meka , Madhu Sudan

Despite the apparent similarity between shared randomness and shared entanglement in the context of Communication Complexity, our understanding of the latter is not as good as of the former. In particular, there is no known "entanglement…

Quantum Physics · Physics 2022-03-29 Dmytro Gavinsky

Motivated by the problem of filtering candidate pairs in inner product similarity joins we study the following inner product estimation problem: Given parameters $d\in {\bf N}$, $\alpha>\beta\geq 0$ and unit vectors $x,y\in {\bf R}^{d}$…

Data Structures and Algorithms · Computer Science 2020-01-14 Rasmus Pagh , Johan Sivertsen

We show that the uniform distribution minimizes entropy among all one-dimensional symmetric log-concave distributions with fixed variance, as well as various generalizations of this fact to R\'enyi entropies of orders less than 1 and with…

Information Theory · Computer Science 2021-10-20 Mokshay Madiman , Piotr Nayar , Tomasz Tkocz

Fast distributed algorithms that output a feasible solution for constraint satisfaction problems, such as maximal independent sets, have been heavily studied. There has been much less research on distributed sampling problems, where one…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-07 Sriram V. Pemmaraju , Joshua Z. Sobel