English
Related papers

Related papers: Condensed Unpredictability

200 papers

We derive a lower bound on the smallest output entropy that can be achieved via vector quantization of a $d$-dimensional source with given expected $r$th-power distortion. Specialized to the one-dimensional case, and in the limit of…

Information Theory · Computer Science 2017-03-27 Tobias Koch , Gonzalo Vazquez-Vilar

The exponential growth of data transmission and processing speeds in modern digital infrastructure requires entropy sources capable of producing large volumes of true randomness for information security. Chaotic emissions from semiconductor…

Optics · Physics 2026-01-01 Chin-Hao Tseng , Atsushi Uchida , Sheng-Kwang Hwang

We show that unconverged stochastic gradient descent can be interpreted as a procedure that samples from a nonparametric variational approximate posterior distribution. This distribution is implicitly defined as the transformation of an…

Machine Learning · Statistics 2015-04-07 Dougal Maclaurin , David Duvenaud , Ryan P. Adams

The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible constrained to match empirical data, for instance, feature expectations. We seek to generalize…

Information Theory · Computer Science 2022-05-30 Kenneth Bogert

Large reasoning models have demonstrated remarkable performance on complex reasoning tasks, yet the excessive length of their chain-of-thought outputs remains a major practical bottleneck due to high computation cost and poor deployability.…

Computation and Language · Computer Science 2025-11-25 Hourun Zhu , Yang Gao , Wenlong Fei , Jiawei Li , Huashan Sun

Machine learning has had a major impact on data compression over the last decade and inspired many new, exciting theoretical and applied questions. This paper describes one such direction -- relative entropy coding -- which focuses on…

Information Theory · Computer Science 2026-02-10 Gergely Flamich , Deniz Gündüz

Herding is a deterministic algorithm used to generate data points that can be regarded as random samples satisfying input moment conditions. The algorithm is based on the complex behavior of a high-dimensional dynamical system and is…

Machine Learning · Statistics 2023-05-10 Hiroshi Yamashita , Hideyuki Suzuki , Kazuyuki Aihara

Here we deconstruct, and then in a reasoned way reconstruct, the concept of "entropy of a system," paying particular attention to where the randomness may be coming from. We start with the core concept of entropy as a COUNT associated with…

General Physics · Physics 2017-05-10 Tommaso Toffoli

We simply construct a quantum universal variable-length source code in which, independent of information source, both of the average error and the probability that the coding rate is greater than the entropy rate $H(rho_p)$, tend to 0. If…

Quantum Physics · Physics 2007-05-23 Masahito Hayashi , Keiji Matsumoto

We discuss further our proposed modification of the Susskind-Horowitz-Polchinski scenario in which black hole entropy goes over to string entropy as one scales the string length scale up and the string coupling constant down, keeping…

High Energy Physics - Theory · Physics 2012-09-25 Bernard S. Kay

We introduce the Clifford entropy, a measure of how close an arbitrary unitary is to a Clifford unitary, which generalizes the stabilizer entropy for states. We show that this quantity vanishes if and only if a unitary is Clifford, is…

Quantum Physics · Physics 2025-12-30 Gianluca Cuffaro , Matthew B. Weiss

In this paper, we propose a source coding scheme that represents data from unknown distributions through frequency and support information. Existing encoding schemes often compress data by sacrificing computational efficiency or by assuming…

Information Theory · Computer Science 2024-10-28 Leah Woldemariam , Hang Liu , Anna Scaglione

There are several inequalities in physics which limit how well we can process physical systems to achieve some intended goal, including the second law of thermodynamics, entropy bounds in quantum information theory, and the uncertainty…

Quantum Physics · Physics 2016-07-19 Francesco Buscemi , Siddhartha Das , Mark M. Wilde

Ultrafast physical random bit generation at hundreds of Gb/s rates, with verified randomness, is a crucial ingredient in secure communication and have recently emerged using optics based physical systems. Here we examine the inverse problem…

Signal Processing · Electrical Eng. & Systems 2019-11-05 Shira Sardi , Herut Uzan , Shiri Otmazgin , Yaara Aviad , Michael Rosenbluh , Ido Kanter

This paper addresses a fundamental problem in random variate generation: given access to a random source that emits a stream of independent fair bits, what is the most accurate and entropy-efficient algorithm for sampling from a discrete…

Data Structures and Algorithms · Computer Science 2020-03-10 Feras A. Saad , Cameron E. Freer , Martin C. Rinard , Vikash K. Mansinghka

Over the last few years, machine learning unlocked previously infeasible features for compression, such as providing guarantees for users' privacy or tailoring compression to specific data statistics (e.g., satellite images or audio…

Information Theory · Computer Science 2026-03-25 Gergely Flamich

Entropy rate of sequential data-streams naturally quantifies the complexity of the generative process. Thus entropy rate fluctuations could be used as a tool to recognize dynamical perturbations in signal sources, and could potentially be…

Information Theory · Computer Science 2014-03-24 Ishanu Chattopadhyay , Hod Lipson

This paper proposes a novel entropy encoding technique for lossless data compression. Representing a message string by its lexicographic index in the permutations of its symbols results in a compressed version matching Shannon entropy of…

Information Theory · Computer Science 2017-03-24 Abu Bakar Siddique

The generic crease set of an event horizon possesses anisotropic structure though most of black holes are dynamically stable. This fact suggests that a generic almost spherical black hole has a very crumpled crease set in a microscopic…

General Relativity and Quantum Cosmology · Physics 2009-11-07 Masaru Siino

We derive a new entropic quantum uncertainty relation involving min-entropy. The relation is tight and can be applied in various quantum-cryptographic settings. Protocols for quantum 1-out-of-2 Oblivious Transfer and quantum Bit Commitment…

Quantum Physics · Physics 2007-08-19 Ivan B. Damgaard , Serge Fehr , Renato Renner , Louis Salvail , Christian Schaffner