English
Related papers

Related papers: Random dynamical systems, entropies and informatio…

200 papers

Complexity is an important metric for appropriate characterization of different classes of irregular signals, observed in the laboratory or in nature. The literature is already rich in the description of such measures using a variety of…

Parameter identification problems are formulated in a probabilistic language, where the randomness reflects the uncertainty about the knowledge of the true values. This setting allows conceptually easily to incorporate new information, e.g.…

Numerical Analysis · Computer Science 2013-03-19 Bojana V. Rosić , Anna Kučerová , Jan Sýkora , Oliver Pajonk , Alexander Litvinenko , Hermann G. Matthies

We introduce an approach which allows detecting causal relationships between variables for which the time evolution is available. Causality is assessed by a variational scheme based on the Information Imbalance of distance ranks, a…

Methodology · Statistics 2024-05-07 Vittorio Del Tatto , Gianfranco Fortunato , Domenica Bueti , Alessandro Laio

We extend previously proposed measures of complexity, emergence, and self-organization to continuous distributions using differential entropy. This allows us to calculate the complexity of phenomena for which distributions are known. We…

Adaptation and Self-Organizing Systems · Physics 2016-04-01 Guillermo Santamaría-Bonfil , Nelson Fernández , Carlos Gershenson

Many complex systems exhibit extreme events far more often than expected for a normal distribution. This work examines how self-similar bursts of activity across several orders of magnitude can emerge from first principles in systems that…

Physics and Society · Physics 2015-11-13 Felix Patzelt

A central problem in uncertainty quantification is how to characterize the impact that our incomplete knowledge about models has on the predictions we make from them. This question naturally lends itself to a probabilistic formulation, by…

Statistical Mechanics · Physics 2018-09-03 Giovanni Dematteis , Tobias Grafke , Eric Vanden-Eijnden

Predictive inference requires balancing statistical accuracy against informational complexity, yet the choice of complexity measure is usually imposed rather than derived. We treat econometric objects as predictive rules, mappings from…

Statistics Theory · Mathematics 2026-02-16 Nicholas G. Polson , Daniel Zantedeschi

Information theory on a time-discrete setting in the framework of time series analysis is generalized to the time-continuous case. Considerations of the Roessler and Lorenz dynamics as well as the Ornstein-Uhlenbeck process yield for…

Chaotic Dynamics · Physics 2008-06-04 Detlef Holstein

Organisms and algorithms learn probability distributions from previous observations, either over evolutionary time or on the fly. In the absence of regularities, estimating the underlying distribution from data would require observing each…

Statistical Mechanics · Physics 2024-12-10 William Bialek , Stephanie E. Palmer , David J. Schwab

Randomness in scientific estimation is generally assumed to arise from unmeasured or uncontrolled factors. However, when combining subjective probability estimates, heterogeneity stemming from people's cognitive or information diversity is…

Methodology · Statistics 2015-09-14 Ville A. Satopää , Robin Pemantle , Lyle H. Ungar

Catastrophic regime shifts in complex natural systems may be averted through advanced detection. Recent work has provided a proof-of-principle that many systems approaching a catastrophic transition may be identified through the lens of…

Other Quantitative Biology · Quantitative Biology 2012-04-30 Carl Boettiger , Alan Hastings

In this paper we present a discussion of the basic aspects of the well-known problem of prediction and inference in physics, with specific attention to the role of models, the use of data and the application of recent developments in…

General Physics · Physics 2024-10-07 Luca Gammaitoni , Angelo Vulpiani

Reliable estimation of predictive uncertainty is crucial for machine learning applications, particularly in high-stakes scenarios where hedging against risks is essential. Despite its significance, there is no universal agreement on how to…

Machine Learning · Computer Science 2025-06-17 Kajetan Schweighofer , Lukas Aichberger , Mykyta Ielanskyi , Sepp Hochreiter

Mathematical models of real life phenomena are highly nonlinear involving multiple parameters and often exhibiting complex dynamics. Experimental data sets are typically small and noisy, rendering estimation of parameters from such data…

Chaotic Dynamics · Physics 2017-05-11 Abhirup Ghosh , Samit Bhattacharyya , Somdatta Sinha , Amit Apte

Despite broad interest in self-organizing systems, there are few quantitative, experimentally-applicable criteria for self-organization. The existing criteria all give counter-intuitive results for important cases. In this Letter, we…

Adaptation and Self-Organizing Systems · Physics 2011-11-10 Cosma Rohilla Shalizi , Kristina Lisa Shalizi , Robert Haslinger

In experiments, the dynamical behavior of systems is reflected in time series. Due to the finiteness of the observational data set it is not possible to reconstruct the invariant measure up to arbitrary fine resolution and arbitrary high…

Chaotic Dynamics · Physics 2009-10-31 M. Cencini , M. Falcioni , H. Kantz , E. Olbrich , A. Vulpiani

Using mathematical models to assist in the interpretation of experiments is becoming increasingly important in research across applied mathematics, and in particular in biology and ecology. In this context, accurate parameter estimation is…

Statistics Theory · Mathematics 2025-04-29 Jie Qi , Ruth E. Baker

Nonlinear dynamical systems are ubiquitous in nature and they are hard to forecast. Not only they may be sensitive to small perturbations in their initial conditions, but they are often composed of processes acting at multiple scales.…

Chaotic Dynamics · Physics 2025-10-06 Chenyu Dong , Davide Faranda , Adriano Gualandi , Valerio Lucarini , Gianmarco Mengaldo

We consider the number of Bowen sets which are necessary to cover a large measure subset of the phase space. This introduce some complexity indicator characterizing different kind of (weakly) chaotic dynamics. Since in many systems its…

Dynamical Systems · Mathematics 2015-06-26 S. Galatolo

A noncontextual system of random variables may become contextual if one adds to it a set of new variables, even if each of them is obtained by the same context-wise function of the old variables. This fact follows from the definition of…

Quantum Physics · Physics 2022-12-22 Ehtibar N. Dzhafarov , Janne V. Kujala