English
Related papers

Related papers: An Entropy Lower Bound for Non-Malleable Extractor…

200 papers

Kernel $k$-means clustering can correctly identify and extract a far more varied collection of cluster structures than the linear $k$-means clustering algorithm. However, kernel $k$-means clustering is computationally expensive when the…

Machine Learning · Computer Science 2019-02-12 Shusen Wang , Alex Gittens , Michael W. Mahoney

We study two weight inequalities in the recent innovative language of `entropy' due to Treil-Volberg. The inequalities are extended to $ L ^{p}$, for $ 1< p \neq 2 < \infty $, with new short proofs. A result proved is as follows. Let $…

Classical Analysis and ODEs · Mathematics 2016-06-02 Michael T. Lacey , Scott Spencer

Let X_1, ..., X_n be a sequence of n classical random variables and consider a sample of r positions selected at random. Then, except with (exponentially in r) small probability, the min-entropy of the sample is not smaller than, roughly, a…

Quantum Physics · Physics 2012-06-04 Robert Koenig , Renato Renner

Suppose that, for any (k \geq 1), (\epsilon > 0) and sufficiently large $\sigma$, we are given a black box that allows us to sample characters from a $k$th-order Markov source over the alphabet (\{0, ..., \sigma - 1\}). Even if we know the…

Information Theory · Computer Science 2009-12-31 Travis Gagie

Minimal codes are linear codes where all non-zero codewords are minimal, i.e., whose support is not properly contained in the support of another codeword. The minimum possible length of such a $k$-dimensional linear code over $\mathbb{F}_q$…

Combinatorics · Mathematics 2025-06-06 Vladimir Chubenko , Sascha Kurz

An $[[n,k,d]]$ quantum maximum-distance-separable code maps $k$ source qudits to $n$ coded qudits such that any $n-(d-1)$ coded qudits may recover all source qudits and $n = k + 2 (d-1)$. The entropy of the joint state of the reference…

Quantum Physics · Physics 2025-06-12 Hua Sun

Motivated from the fact that universal source coding on countably infinite alphabets is not feasible, this work introduces the notion of almost lossless source coding. Analog to the weak variable-length source coding problem studied by Han…

Information Theory · Computer Science 2021-11-30 Jorge F. Silva , Pablo Piantanida

This paper studies the minimum achievable source coding rate as a function of blocklength $n$ and probability $\epsilon$ that the distortion exceeds a given level $d$. Tight general achievability and converse bounds are derived that hold at…

Information Theory · Computer Science 2016-11-15 Victoria Kostina , Sergio Verdú

For $S\subseteq \mathbb{F}^n$, consider the linear space of restrictions of degree-$d$ polynomials to $S$. The Hilbert function of $S$, denoted $\mathrm{h}_S(d,\mathbb{F})$, is the dimension of this space. We obtain a tight lower bound on…

Computational Complexity · Computer Science 2024-05-17 Alexander Golovnev , Zeyu Guo , Pooya Hatami , Satyajeet Nagargoje , Chao Yan

It is well established that the notion of min-entropy fails to satisfy the \emph{chain rule} of the form $H(X,Y) = H(X|Y)+H(Y)$, known for Shannon Entropy. Such a property would help to analyze how min-entropy is split among smaller blocks.…

Information Theory · Computer Science 2017-03-01 Maciej Skorski

We consider a bound on the bias reduction of a random number generator by processing based on binary linear codes. We introduce a new bound on the total variation distance of the processed output based on the weight distribution of the code…

Information Theory · Computer Science 2014-05-13 Alessio Meneghetti , Massimiliano Sala , Alessandro Tomasi

A new framework is introduced for examining and evaluating the fundamental limits of lossless data compression, that emphasizes genuinely non-asymptotic results. The {\em sample complexity} of compressing a given source is defined as the…

Information Theory · Computer Science 2026-04-16 Terence Viaud , Ioannis Kontoyiannis

It is supposed that the exponential multiplier in the method of the non-equilibrium statistical operator (Zubarev`s approach) can be considered as a distribution density of the past lifetime of the system, and can be replaced by an…

Statistical Mechanics · Physics 2009-10-26 V. V. Ryazanov

An oblivious subspace embedding (OSE), characterized by parameters $m,n,d,\epsilon,\delta$, is a random matrix $\Pi\in \mathbb{R}^{m\times n}$ such that for any $d$-dimensional subspace $T\subseteq \mathbb{R}^n$, $\Pr_\Pi[\forall x\in T,…

Data Structures and Algorithms · Computer Science 2023-07-14 Yi Li , Mingmou Liu

A quasi-entropy is constructed for tensors averaged by a density function on $SO(3)$ using the log-determinant of a covariance matrix. It serves as a substitution of the entropy for tensors derived from a constrained minimization that…

Mathematical Physics · Physics 2022-11-09 Jie Xu

Given data drawn from an unknown distribution, $D$, to what extent is it possible to ``amplify'' this dataset and output an even larger set of samples that appear to have been drawn from $D$? We formalize this question as follows: an…

Machine Learning · Computer Science 2024-08-27 Brian Axelrod , Shivam Garg , Vatsal Sharan , Gregory Valiant

The remaining min-entropy of a secret generated by fuzzy extraction from a Physical Unclonable Function is typically estimated under the assumption of independent and identically distributed PUF responses, but this assumption does not hold…

Signal Processing · Electrical Eng. & Systems 2020-01-23 Florian Wilde , Christoph Frisch , Michael Pehl

In 2005 Bourgain gave the first explicit construction of a two-source extractor family with min-entropy rate less than $1/2$. His approach combined Fourier analysis with innovative but inefficient tools from arithmetic combinatorics and…

Combinatorics · Mathematics 2019-07-31 Mark Lewko

We extend the "method of multiplicities" to get the following results, of interest in combinatorics and randomness extraction. (A) We show that every Kakeya set (a set of points that contains a line in every direction) in $\F_q^n$ must be…

Combinatorics · Mathematics 2009-05-14 Zeev Dvir , Swastik Kopparty , Shubhangi Saraf , Madhu Sudan

Given $n$ elements, an integer $k$ and a parameter $\varepsilon$, we study to select an element with rank in $(k-n\varepsilon,k+n\varepsilon]$ using unreliable comparisons where the outcome of each comparison is incorrect independently with…

Data Structures and Algorithms · Computer Science 2022-05-04 Shengyu Huang , Chih-Hung Liu , Daniel Rutschman