English
Related papers

Related papers: Non-random structures in universal compression and…

200 papers

There is a deep connection between permutations and trees. Certain sub-structures of permutations, called sub-permutations, bijectively map to sub-trees of binary increasing trees. This opens a powerful tool set to study enumerative and…

Combinatorics · Mathematics 2014-07-02 Filippo Disanto , Thomas Wiehe

We raise the question of approximating the compressibility of a string with respect to a fixed compression scheme, in sublinear time. We study this question in detail for two popular lossless compression schemes: run-length encoding (RLE)…

Data Structures and Algorithms · Computer Science 2007-06-11 Sofya Raskhodnikova , Dana Ron , Ronitt Rubinfeld , Adam Smith

We show that Kolmogorov complexity and such its estimators as universal codes (or data compression methods) can be applied for hypotheses testing in a framework of classical mathematical statistics. The methods for identity testing and…

Computational Complexity · Computer Science 2007-05-23 Boris Ryabko , Jaakko Astola , Alex Gammerman

Weak-scale supersymmetry is one of the most favoured theories beyond the Standard Model of particle physics that elegantly solves various theoretical and observational problems in both particle physics and cosmology. In this thesis, I…

Cosmology and Nongalactic Astrophysics · Physics 2011-11-04 Yashar Akrami

In this paper we try to model certain features of human language complexity by means of advanced concepts borrowed from statistical mechanics. We use a time series approach, the diffusion entropy method (DE), to compute the complexity of an…

Statistical Mechanics · Physics 2009-09-03 Paolo Allegrini , Paolo Grigolini , Luigi Palatella

The class of complex random vectors whose covariance matrix is linearly parameterized by a basis of Hermitian Toeplitz (HT) matrices is considered, and the maximum compression ratios that preserve all second-order information are derived…

Statistics Theory · Mathematics 2016-11-15 Daniel Romero , Roberto Lopez-Valcarce , Geert Leus

We propose a new method for the calculation of the statistical properties, as e.g. the entropy, of unknown generators of symbolic sequences. The probability distribution $p(k)$ of the elements $k$ of a population can be approximated by the…

chao-dyn · Physics 2009-10-28 Thorsten Pöschel , Werner Ebeling , Helge Rosé

Motivated by the recent proof of the Stanley-Wilf conjecture, we study the asymptotic behavior of the number of permutations avoiding a generalized pattern. Generalized patterns allow the requirement that some pairs of letters must be…

Combinatorics · Mathematics 2007-05-23 Sergi Elizalde

Previously referred to as `miraculous' in the scientific literature because of its powerful properties and its wide application as optimal solution to the problem of induction/inference, (approximations to) Algorithmic Probability (AP) and…

Information Theory · Computer Science 2018-04-16 Hector Zenil , Liliana Badillo , Santiago Hernández-Orozco , Francisco Hernández-Quiroz

We consider the problem of estimating the division rate of a size-structured population in a nonparametric setting. The size of the system evolves according to a transport-fragmentation equation: each individual grows with a given transport…

Statistics Theory · Mathematics 2013-01-21 Marie Doumic Jauffret , Marc Hoffmann , Patricia Reynaud-Bouret , Vincent Rivoirard

In this work we analyze statistical properties of 91 relatively small texts in 7 different languages (Spanish, English, French, German, Turkish, Russian, Icelandic) as well as texts with randomly inserted spaces. Despite the size (around…

Physics and Society · Physics 2020-07-15 Diego Espitia , Hernán Larralde

The Great Filter interpretation of Fermi's great silence asserts that $Npq$ is not a very large number, where $N$ is the number of potentially life-supporting planets in the observable universe, $p$ is the probability that a randomly chosen…

Popular Physics · Physics 2015-11-19 Vilhelm Verendel , Olle Häggström

We show that external randomization may enforce the convergence of test statistics to their limiting distributions in particular cases. This results in a sharper inference. Our approach is based on a central limit theorem for weighted sums.…

Statistics Theory · Mathematics 2022-11-17 Nikita Puchkin , Vladimir Ulyanov

Slepian-Wolf theorem is a well-known framework that targets almost lossless compression of (two) data streams with symbol-by-symbol correlation between the outputs of (two) distributed sources. However, this paper considers a different…

Information Theory · Computer Science 2012-06-20 Ahmad Beirami , Faramarz Fekri

Random Number Generators play a critical role in a number of important applications. In practice, statistical testing is employed to gather evidence that a generator indeed produces numbers that appear to be random. In this paper, we…

Computational Complexity · Computer Science 2010-03-25 Weiling Chang , Binxing Fang , Xiaochun Yun , Shupeng Wang , Xiangzhan Yu

The field of compressed sensing has shown that a sparse but otherwise arbitrary vector can be recovered exactly from a small number of randomly constructed linear projections (or samples). The question addressed in this paper is whether an…

Information Theory · Computer Science 2010-01-26 Galen Reeves , Michael Gastpar

We analyze the effect of lossy compression in the processing of sensor signals that must be used to detect anomalous events in the system under observation. The intuitive relationship between the quality loss at higher compression and the…

Information Theory · Computer Science 2024-10-28 Alex Marchioni , Andriy Enttsel , Mauro Mangia , Riccardo Rovatti , Gianluca Setti

We model certain features of human language complexity by means of advanced concepts borrowed from statistical mechanics. Using a time series approach, the diffusion entropy method (DE), we compute the complexity of an Italian corpus of…

Statistical Mechanics · Physics 2016-11-23 Paolo Allegrini , Paolo Grigolini , Luigi Palatella

The Coding Theorem of L.A. Levin connects unconditional prefix Kolmogorov complexity with the discrete universal distribution. There are conditional versions referred to in several publications but as yet there exist no written proofs in…

Information Theory · Computer Science 2013-01-23 Paul M. B. Vitanyi

Semi-supervised learning is a powerful technique for leveraging unlabeled data to improve machine learning models, but it can be affected by the presence of ``informative'' labels, which occur when some classes are more likely to be labeled…

Machine Learning · Statistics 2023-02-16 Aude Sportisse , Hugo Schmutz , Olivier Humbert , Charles Bouveyron , Pierre-Alexandre Mattei