Related papers: Dynamic entropies, long-range correlations, and fl…
We present the first large-scale, cross-domain evaluation of document chunking strategies for dense retrieval, addressing a critical but underexplored aspect of retrieval-augmented systems. In our study, 36 segmentation methods spanning…
We use statistical estimates of the entropy rate of spike train data in order to make inferences about the underlying structure of the spike train itself. We first examine a number of different parametric and nonparametric estimators (some…
The problem of differentiating the informational content of coding (exons) and non-coding (introns) regions of a DNA sequence is one of the central problems of genomics. The introns are estimated to be nearly 95% of the DNA and since they…
The frequency with which the letters of the English alphabet appear in writings has been applied to the field of cryptography, the development of keyboard mechanics, and the study of linguistics. We expanded on the statistical analysis of…
The correlation part of the pair density is separated into two components, one of them being predominant at short electronic ranges and the other at long ranges. The analysis of the intracular part of these components permits to classify…
The complexity of quantum many-body systems is manifested in the vast diversity of their correlations, making it challenging to distinguish the generic from the atypical features. This can be addressed by analyzing correlations through…
The task of finding a criterion allowing to distinguish a text from an arbitrary set of words is rather relevant in itself, for instance, in the aspect of development of means for internet-content indexing or separating signals and noise in…
We propose a new thermodynamic, relativistic relationship between information and entropy, which is closely analogous to the classic Maxwell electro-magnetic equations. Determination of whether information resides in points of…
Experimental data are presented on particle correlations and fluctuations in various high-energy multiparticle collisions, with special emphasis on evidence for scaling-law evolution in small phase-space domains. The notions of…
Detecting changes in high-dimensional vectors presents significant challenges, especially when the post-change distribution is unknown and time-varying. This paper introduces a novel robust algorithm for correlation change detection in…
In one dimension very general results from conformal field theory and exact calculations for certain quantum spin systems have established universal scaling properties of the entanglement entropy between two parts of a critical system.…
We report direct observation of the development of long-range spatial intensity correlations and the growth of intensity fluctuations inside the random media. We fabricated quasi-two-dimensional disordered photonic structures and probed the…
Information flow analysis is a powerful technique for reasoning about the sensitive information exposed by a program during its execution. While past work has proposed information theoretic metrics (e.g., Shannon entropy, min-entropy,…
In this paper we analyse the fractal structure of long human-language records by mapping large samples of texts onto time series. The particular mapping set up in this work is inspired on linguistic basis in the sense that is retains {\em…
The availability of large datasets requires an improved view on statistical laws in complex systems, such as Zipf's law of word frequencies, the Gutenberg-Richter law of earthquake magnitudes, or scale-free degree distribution in networks.…
This paper considers three kinds of length sequences of the complete genome. Detrended fluctuation analysis, spectral analysis, and the mean distance spanned within time $L$ are used to discuss the correlation property of these sequences.…
The rise of repetitive datasets has lately generated a lot of interest in compressed self-indexes based on dictionary compression, a rich and heterogeneous family that exploits text repetitions in different ways. For each such compression…
In this paper, we review the literature on statistical long-range correlation in DNA sequences. We examine the current evidence for these correlations, and conclude that a mixture of many length scales (including some relatively long ones)…
New measurements of short-range and long-range two-particle correlations, azimuthal anisotropy, and event-by-event fluctuations from the STAR experiment for sqrt{s_{NN}}= 130 and 200 GeV Au+Au collisions are summarized. Striking evidence is…
A class of nucleosome remodeling motors translocate nucleosomes, to which they are attached, toward the middle of DNA chain in the presence of ATP during in vitro experiments. Such a biological activity is likely based on a physical…