English
Related papers

Related papers: R\'enyi entropy and pattern matching for run-lengt…

200 papers

We investigate the longest common substring problem for encoded sequences and its asymptotic behaviour. The main result is a strong law of large numbers for a re-scaled version of this quantity, which presents an explicit relation with the…

Probability · Mathematics 2019-12-12 Adriana Coutinho , Rodrigo Lambert , Jérôme Rousseau

In this paper, we study the behaviour of the longest common substring for random subshifts of finite type (for dynamicists) or of the longest common substring for random sequences in random environments (for probabilists). We prove that,…

Dynamical Systems · Mathematics 2020-11-24 Jerome Rousseau

Maximal repetition of a string is the maximal length of a repeated substring. This paper investigates maximal repetition of strings drawn from stochastic processes. Strengthening previous results, two new bounds for the almost sure growth…

Information Theory · Computer Science 2020-03-11 Łukasz Dębowski

R\'enyi entropy is an important measure in the context of information theory as a generalization of Shannon entropy. This information measure was often used for uncertainty quantification of dynamical behaviour of stochastic processes. In…

Statistics Theory · Mathematics 2025-10-28 Salah H. Abid , Uday J. Quaez , Javier E. Contreras-Reyescor

In this paper, we discuss the possibility of unexplored behaviours for the entanglement entropy in extended quantum systems. Namely, we study the R\'enyi entanglement entropy for the ground state of long-range Kitaev chains with slow…

Statistical Mechanics · Physics 2019-11-27 Filiberto Ares , José G. Esteve , Fernando Falceto , Zoltán Zimborás

We study the Von Neumann and R\'enyi entanglement entropy of long-range harmonic oscillators (LRHO) by both theoretical and numerical means. We show that the entanglement entropy in massless harmonic oscillators increases logarithmically…

Statistical Mechanics · Physics 2013-01-21 M. Ghasemi Nezhadhaghighi , M. A. Rajabpour

We study systematically resource measures of coherence and entanglement based on R\'enyi relative entropies, which include the logarithmic robustness of coherence, geometric coherence, and conventional relative entropy of coherence together…

Quantum Physics · Physics 2017-11-29 Huangjun Zhu , Masahito Hayashi , Lin Chen

Entanglement R\'enyi-$\alpha$ entropy is an entanglement measure. It generalizes the entanglement of formation, and they coincide when $\alpha$ tends to 1. We derive analytical lower and upper bounds for the entanglement R\'enyi-$\alpha$…

Quantum Physics · Physics 2017-03-07 Wei Song , Lin Chen , Zhuo-Liang Cao

Shannon entropy is the shortest average codeword length a lossless compressor can achieve by encoding i.i.d. symbols. However, there are cases in which the objective is to minimize the \textit{exponential} average codeword length, i.e. when…

Information Theory · Computer Science 2024-06-10 Andrea Somazzi , Paolo Ferragina , Diego Garlaschelli

Via dependence with complete connections we investigate the $\psi$-mixing coefficients of the sequence $(a_n)_{n \in \mathbb{N}}$ of incomplete quotients and also of the doubly infinite sequence $(\overline{a}_l)_{l \in \mathbb{Z}}$ of…

Number Theory · Mathematics 2023-09-25 Gabriela Ileana Sebe , Dan Lascu

In this work, we study the real-time evolution of pseudo-(R\'enyi) entropy, a generalization of entanglement entropy, in two-dimensional conformal field theories (CFTs). We focus on states obtained by acting primary operators located at…

High Energy Physics - Theory · Physics 2022-09-28 Wu-zhong Guo , Song He , Yu-Xuan Zhang

Entropies must correspond to mean values for them to be measurable. The Shannon entropy corresponds to the weighted arithmetic mean, whereas the Renyi entropy corresponds to the exponential mean. These means refer to code lengths, which are…

Statistical Mechanics · Physics 2011-10-25 B. H. Lavenda

Based on the problem of quantum data compression in a lossless way, we present here an operational interpretation for the family of quantum R\'enyi entropies. In order to do this, we appeal to a very general quantum encoding scheme that…

Quantum Physics · Physics 2017-10-05 G. Bellomo , G. M. Bosyk , F. Holik , S. Zozor

Let $(X, Y) = (X_n, Y_n)_{n \geq 1}$ be the output process generated by a hidden chain $Z = (Z_n)_{n \geq 1}$, where $Z$ is a finite state, aperiodic, time homogeneous, and irreducible Markov chain. Let $LC_n$ be the length of the longest…

Probability · Mathematics 2019-04-08 Christian Houdré , George Kerchev

We propose and experimentally measure an entropy that quantifies the volume of correlations among qubits. The experiment is carried out on a nearly isolated quantum system composed of a central spin coupled and initially uncorrelated with…

Quantum Physics · Physics 2021-08-25 Mohamad Niknam , Lea F. Santos , David G. Cory

R\'enyi entropy of order \alpha is a general measure of entropy. In this paper we derive estimations for the R\'enyi entropy of the mixture of sources in terms of the entropy of the single sources. These relations allow to compute the…

Information Theory · Computer Science 2012-04-13 Marek Śmieja , Jacek Tabor

Subword tokenization is a key part of many NLP pipelines. However, little is known about why some tokenizer and hyperparameter combinations lead to better downstream model performance than others. We propose that good tokenizers lead to…

Computation and Language · Computer Science 2023-06-30 Vilém Zouhar , Clara Meister , Juan Luis Gastaldi , Li Du , Mrinmaya Sachan , Ryan Cotterell

We consider the two-dimensional (2d) Ising model on a infinitely long cylinder and study the probabilities $p_i$ to observe a given spin configuration $i$ along a circular section of the cylinder. These probabilities also occur as…

Strongly Correlated Electrons · Physics 2010-11-02 Jean-Marie Stéphan , Grégoire Misguich , Vincent Pasquier

The goal of this paper is to develop an estimate for the entropy of random long-range correlated symbolic sequences with elements belonging to a finite alphabet. As a plausible model, we use the high-order additive stationary ergodic Markov…

Information Theory · Computer Science 2014-12-12 S. S. Melnik , O. V. Usatenko

R\'enyi entropies are conceptually valuable and experimentally relevant generalisations of the celebrated von Neumann entanglement entropy. After a quantum quench in a clean quantum many-body system they generically display a universal…

Statistical Mechanics · Physics 2022-08-04 Bruno Bertini , Katja Klobas , Vincenzo Alba , Gianluca Lagnese , Pasquale Calabrese
‹ Prev 1 2 3 10 Next ›