English
Related papers

Related papers: Entropic nonextensivity as a measure of time serie…

200 papers

A time series is uniquely represented by its geometric shape, which also carries information. A time series can be modelled as the trajectory of a particle moving in a force field with one degree of freedom. The force acting on the particle…

Information Theory · Computer Science 2018-10-16 Kaushik Majumdar , Srinath Jayachandran

We consider the number of Bowen sets which are necessary to cover a large measure subset of the phase space. This introduce some complexity indicator characterizing different kind of (weakly) chaotic dynamics. Since in many systems its…

Dynamical Systems · Mathematics 2015-06-26 S. Galatolo

Irreversibility is commonly quantified by entropy production. An external observer can estimate it through measuring an observable that is antisymmetric under time-reversal like a current. We introduce a general framework that, inter alia,…

Statistical Mechanics · Physics 2023-07-05 Jann van der Meer , Julius Degünther , Udo Seifert

In this paper we introduce a nonextensive quantum information theoretic measure which may be defined between any arbitrary number of density matrices, and we analyze its fundamental properties in the spectral graph-theoretic framework.…

Information Theory · Computer Science 2015-04-15 A. Ben Hamza

In the last three decades, several measures of complexity have been proposed. Up to this point, most of such measures have only been developed for finite spaces. In these scenarios the baseline distribution is uniform. This makes sense…

Information Theory · Computer Science 2021-11-15 Daniel Andrés Díaz-Pachón , Robert J. Marks

We demonstrate and discuss the process of gaining information and show an example in which some specific way of gaining information about an object results in the Tsallis form of entropy rather than in the Shannon one.

Statistical Mechanics · Physics 2009-11-13 Grzegorz Wilk , Zbigniew Wlodarczyk

We investigate the concept of entropy in probabilistic theories more general than quantum mechanics, with particular reference to the notion of information causality recently proposed by Pawlowski et. al. (arXiv:0905.2992). We consider two…

A recently introduced model of coupled non linear oscillators in a ring is revisited in terms of its information processing capabilities. The use of Lempel-Ziv based entropic measures allows to study thoroughly the complex patterns…

Chaotic Dynamics · Physics 2018-03-20 E. Estevez-Rams , D. Estevez-Moya , B. Aragon Fernandez

Algorithmic entropy and Shannon entropy are two conceptually different information measures, as the former is based on size of programs and the later in probability distributions. However, it is known that, for any recursive probability…

Information Theory · Computer Science 2010-06-03 Andreia Teixeira , Andre Souto , Armando Matos , Luis Antunes

Two general upper bounds on the topological entropy of nonlinear time-varying systems are established: one using the matrix measure of the system Jacobian, the other using the largest real part of the eigenvalues of the Jacobian matrix with…

Optimization and Control · Mathematics 2025-09-18 Guosong Yang , Daniel Liberzon

We propose a formal expansion of the transfer entropy to put in evidence irreducible sets of variables which provide information for the future state of each assigned target. Multiplets characterized by a large contribution to the expansion…

Quantitative Methods · Quantitative Biology 2015-06-04 S. Stramaglia , Guo-Rong Wu , M. Pellicoro , D. Marinazzo

We define predictive states and predictive complexity for quantum systems composed of distinct subsystems. This complexity is a generalization of entanglement entropy. It is inspired by the statistical or forecasting complexity of…

Quantum Physics · Physics 2024-10-22 Curtis T. Asplund , Elisa Panciu

In this work, conditional entropy is used to quantify the information loss induced by passing a continuous random variable through a memoryless nonlinear input-output system. We derive an expression for the information loss depending on the…

Information Theory · Computer Science 2012-02-03 Bernhard C. Geiger , Christian Feldbauer , Gernot Kubin

More and more works deal with statistical systems far from equilibrium, dominated by unidirectional stochastic processes augmented by rare resets. We analyze the construction of the entropic distance measure appropriate for such dynamics.…

Statistical Mechanics · Physics 2017-11-08 Tamás S. Biró , András Telcs , Zoltán Néda

The necessary information for specifying a complex system may not be completely accessible to us, i.e., to mathematical treatments. This is not to be confounded with the incompleteness of our knowledge about whatever systems or nature,…

Statistical Mechanics · Physics 2007-05-23 Qiuping A. Wang

Probability theory is fundamental for modeling uncertainty, with traditional probabilities being real and non-negative. Complex probability extends this concept by allowing complex-valued probabilities, opening new avenues for analysis in…

Information Theory · Computer Science 2025-03-07 Chan Li , Hejun Xu , Zhu Cao

Information plays an important role in our understanding of the physical world. We hence propose an entropic measure of information for any physical theory that admits systems, states and measurements. In the quantum and classical world,…

Quantum Physics · Physics 2010-05-04 Anthony J. Short , Stephanie Wehner

Like natural complex systems such as the Earth's climate or a living cell, semiconductor lithography systems are characterized by nonlinear dynamics across more than a dozen orders of magnitude in space and time. Thousands of sensors…

Information Theory · Computer Science 2021-04-07 Errol Zalmijn , Tom Heskes , Tom Claassen

We propose a measure of learning efficiency for non-finite state spaces. We characterize the complexity of a learning problem by the metric entropy of its state space. We then describe how learning efficiency is determined by this measure…

Theoretical Economics · Economics 2024-08-28 Martin W Cripps

The formalism of statistical mechanics can be generalized by starting from more general measures of information than the Shannon entropy and maximizing those subject to suitable constraints. We discuss some of the most important examples of…

Statistical Mechanics · Physics 2015-05-13 Christian Beck