English
Related papers

Related papers: Non-Uniform Attacks Against Pseudoentropy

200 papers

We study pseudorandomness properties of permutations on $\{0,1\}^n$ computed by random circuits made from reversible $3$-bit gates (permutations on $\{0,1\}^3$). Our main result is that a random circuit of depth $n \cdot \tilde{O}(k^2)$,…

Computational Complexity · Computer Science 2025-02-13 William He , Ryan O'Donnell

We calculate an achievable secret key rate for quantum key distribution with a finite number of signals, by evaluating the min-entropy explicitly. The min-entropy can be expressed in terms of the guessing probability, which we calculate for…

Quantum Physics · Physics 2011-03-22 Sylvia Bratzik , Markus Mertz , Hermann Kampermann , Dagmar Bruß

Two new information-theoretic methods are introduced for establishing Poisson approximation inequalities. First, using only elementary information-theoretic techniques it is shown that, when $S_n=\sum_{i=1}^nX_i$ is the sum of the (possibly…

Probability · Mathematics 2010-10-21 Ioannis Kontoyiannis , Peter Harremoes , Oliver Johnson

Maximum entropy distributions with discrete support in $m$ dimensions arise in machine learning, statistics, information theory, and theoretical computer science. While structural and computational properties of max-entropy distributions…

Data Structures and Algorithms · Computer Science 2019-06-04 Damian Straszak , Nisheeth K. Vishnoi

We are interested in testing properties of distributions with systematically mislabeled samples. Our goal is to make decisions about unknown probability distributions, using a sample that has been collected by a confused collector, such as…

Data Structures and Algorithms · Computer Science 2023-11-27 Renato Ferreira Pinto , Nathaniel Harms

In recent years, several hacking attacks have broken the security of quantum cryptography implementations by exploiting the presence of losses and the ability of the eavesdropper to tune detection efficiencies. We present a simple attack of…

Quantum Physics · Physics 2016-01-28 Antonio Acín , Daniel Cavalcanti , Elsa Passaro , Stefano Pironio , Paul Skrzypczyk

We identify a new notion of pseudorandomness for randomness sources, which we call the average bias. Given a distribution $Z$ over $\{0,1\}^n$, its average bias is: $b_{\text{av}}(Z) =2^{-n} \sum_{c \in \{0,1\}^n} |\mathbb{E}_{z \sim…

Computational Complexity · Computer Science 2019-05-31 Arnab Bhattacharyya , Philips George John , Suprovat Ghoshal , Raghu Meka

A novel, non-trivial, probabilistic upper bound on the entropy of an unknown one-dimensional distribution, given the support of the distribution and a sample from that distribution, is presented. No knowledge beyond the support of the…

Information Theory · Computer Science 2007-07-13 Joseph DeStefano , Erik Learned-Miller

We consider the problem of distilling uniform random bits from an unknown source with a given $p$-entropy using linear hashing. As our main result, we estimate the expected $p$-divergence from the uniform distribution over the ensemble of…

Information Theory · Computer Science 2025-06-06 Madhura Pathegama , Alexander Barg

In this paper, we identify a class of absolutely continuous probability distributions, and show that the differential entropy is uniformly convergent over this space under the metric of total variation distance. One of the advantages of…

Information Theory · Computer Science 2018-01-03 Hamid Ghourchian , Amin Gohari , Arash Amini

We study the problem of computing approximate minimum edge cuts by distributed algorithms. We use a standard synchronous message passing model where in each round, $O(\log n)$ bits can be transmitted over each edge (a.k.a. the CONGEST…

Data Structures and Algorithms · Computer Science 2013-11-21 Mohsen Ghaffari , Fabian Kuhn

Say that we are given samples from a distribution $\psi$ over an $n$-dimensional space. We expect or desire $\psi$ to behave like a product distribution (or a $k$-wise independent distribution over its marginals for small $k$). We propose…

Data Structures and Algorithms · Computer Science 2020-11-16 Parikshit Gopalan , Roie Levin , Udi Wieder

This paper investigates what can be inferred about an arbitrary continuous probability distribution from a finite sample of $N$ observations drawn from it. The central finding is that the $N$ sorted sample points partition the real line…

Machine Learning · Statistics 2025-07-30 Urban Eriksson

We study the relationship between the entropy of intermediate representations and a model's robustness to distributional shift. We train models consisting of two feed-forward networks end-to-end separated by a discrete $n$-bit channel on an…

Machine Learning · Computer Science 2023-05-23 Nandi Schoots , Dylan Cope

The existing upper and lower bounds between entropy and error are mostly derived through an inequality means without linking to joint distributions. In fact, from either theoretical or application viewpoint, there exists a need to achieve a…

Information Theory · Computer Science 2013-03-06 Bao-Gang Hu , Hong-Jie Xing

We construct an explicit distribution $\mathbf{D}$ over $\{0,1\}^N$ that exhibits an essentially optimal separation between adaptive and non-adaptive cell-probe sampling. The distribution can be sampled exactly when each output bit is…

Computational Complexity · Computer Science 2026-05-14 Farzan Byramji , Daniel M. Kane , Jackson Morris , Anthony Ostuni

A pair of probability distributions over $\{0,1\}^n$ is said to be $(k,\delta)$-wise indistinguishable if all of the size $k$ marginals are within statistical distance at most $\delta$. Previous works introduced this concept and study when…

Computational Complexity · Computer Science 2026-05-14 Christopher Williamson

In this paper we study the problem of computing max-entropy distributions over a discrete set of objects subject to observed marginals. Interest in such distributions arises due to their applicability in areas such as statistical physics,…

Data Structures and Algorithms · Computer Science 2013-05-02 Mohit Singh , Nisheeth K. Vishnoi

Universal hash functions map the output of a source to random strings over a finite alphabet, aiming to approximate the uniform distribution on the set of strings. A classic result on these functions, called the Leftover Hash Lemma, gives…

Information Theory · Computer Science 2026-01-05 Madhura Pathegama , Alexander Barg

This article presents an efficient algorithm to generate a discrete uniform distribution on a set of $p$ elements using a biased random source for $p$ prime. The algorithm generalizes Von Neumann's method and improves computational…

Probability · Mathematics 2023-01-18 Xiaoyu Lei