English
Related papers

Related papers: Consistent Entropy Estimation for Stationary Time …

200 papers

The approximation of integral functionals with respect to a stationary Markov process by a Riemann-sum estimator is studied. Stationarity and the functional calculus of the infinitesimal generator of the process are used to get a better…

Probability · Mathematics 2016-10-18 Randolf Altmeyer , Jakub Chorowski

We establish asymptotic properties of $M$-estimators, defined in terms of a contrast function and observations from a continuous-time locally stationary process. Using the stationary approximation of the sequence, $\theta$-weak dependence,…

Statistics Theory · Mathematics 2021-05-11 Bennet Ströh

Motivated by global warming issues, we consider a time se- ries that consists of a nondecreasing trend observed with station- ary fluctuations, nonparametric estimation of the trend under monotonicity assumption is considered. The rescaled…

Statistics Theory · Mathematics 2008-12-18 Ou Zhao , Michael Woodroofe

Consider the density dependent (i.e. Nemytskii-type) SDEs on $\mathbb R^d$, where the drift $b_t(x,\rho(x),\rho)$ is locally integrable in $(t,x)\in [0,\infty)\times \mathbb R^d$ and may be singular in the distribution density function…

Probability · Mathematics 2026-05-11 Feng-Yu Wang , Qiumiao Wen , Fen-Fen Yang

We study optimal transport for stationary stochastic processes taking values in finite spaces. In order to reflect the stationarity of the underlying processes, we restrict attention to stationary couplings, also known as joinings. The…

Statistics Theory · Mathematics 2021-12-13 Kevin O'Connor , Kevin McGoff , Andrew B Nobel

We develop entropy and variance results for the product of independent identically distributed random variables on Lie groups. Our results apply to the study of stationary measures in various contexts.

Probability · Mathematics 2026-02-03 Samuel Kittle , Constantin Kogler

For deterministic continuous time nonlinear control systems, epsilon-practical stabilization entropy and practical stabilization entropy are introduced. Here the rate of attraction is specified by a KL-function. Upper and lower bounds for…

Optimization and Control · Mathematics 2022-12-13 Fritz Colonius , Boumediene Hamzi

We study the probability of a real-valued stationary process to be positive on a large interval $[0,N]$. We show that if in some neighborhood of the origin the spectral measure of the process has density which is bounded away from zero and…

Probability · Mathematics 2016-08-10 Naomi D. Feldheim , Ohad N. Feldheim

Time lags are ubiquitous in biophysiological processes and more generally in real-world complex networks. It has been recently proposed to use information-theoretic tools such as transfer entropy to detect and estimate a possible delay in…

Statistical Mechanics · Physics 2018-10-03 M. L. Rosinberg , G. Tarjus , T. Munakata

The problem of Shannon entropy estimation in countable infinite alphabets is addressed from the study and use of convergence results of the entropy functional, which is known to be discontinuous with respect to the total variation distance…

Information Theory · Computer Science 2018-04-03 Jorge F. Silva

We propose a new sensitivity analysis methodology for complex stochastic dynamics based on the Relative Entropy Rate. The method becomes computationally feasible at the stationary regime of the process and involves the calculation of…

Mathematical Physics · Physics 2013-04-16 Yannis Pantazis , Markos A. Katsoulakis

We present an algorithm for the problem of linear distributed estimation of a parameter in a network where a set of agents are successively taking measurements. The approach considers a roaming token in a network that carries the estimate,…

Systems and Control · Computer Science 2018-07-05 Lucas Balthazar , João Xavier , Bruno Sinopoli

This paper addresses the problem of measuring complexity from embedded attractors as a way to characterize changes in the dynamical behaviour of different types of systems by observing their outputs. With the aim of measuring the stability…

Information Theory · Computer Science 2023-07-19 Julián D. Arias-Londoño , Juan I. Godino-Llorente

Based on Jaynes' maximum entropy principle, exponential random graphs provide a family of principled models that allow the prediction of network properties as constrained by empirical data (observables). However, their use is often hindered…

Statistical Mechanics · Physics 2020-12-03 Szabolcs Horvát , Éva Czabarka , Zoltán Toroczkai

Here, we propose a new tool to estimate the complexity of a time series: the entropy of difference (ED). The method is based solely on the sign of the difference between neighboring values in a time series. This makes it possible to…

Data Analysis, Statistics and Probability · Physics 2014-11-05 Pasquale Nardone

An efficient approach to the calculation of the $\epsilon$-entropy is proposed. The method is based on the idea of looking at the information content of a string of data, by analyzing the signal only at the instants when the fluctuations…

chao-dyn · Physics 2009-10-31 M. Abel , L. Biferale , M. Cencini , M. Falcioni , D. Vergni , A. Vulpiani

In this thesis, we provide an initial investigation into bounds for topological entropy of switched linear systems. Entropy measures, roughly, the information needed to describe the behavior of a system with finite precision on finite time…

Optimization and Control · Mathematics 2016-10-14 James Schmidt

We conclude a sequence of work by giving near-optimal sketching and streaming algorithms for estimating Shannon entropy in the most general streaming model, with arbitrary insertions and deletions. This improves on prior results that obtain…

Data Structures and Algorithms · Computer Science 2008-12-18 Nicholas J. A. Harvey , Jelani Nelson , Krzysztof Onak

For a closed-loop control system with a digital channel between the sensor and the controller, the notion of invariance entropy quantifies the smallest average rate of information transmission above which a given compact subset of the state…

Systems and Control · Electrical Eng. & Systems 2020-04-13 Mahendra Singh Tomar , Christoph Kawan , Pushpak Jagtap , Majid Zamani

Living systems operate far from thermal equilibrium by converting the chemical potential of ATP into mechanical work to achieve growth, replication or locomotion. Given time series observations of intra-, inter- or multicellular processes,…

Biological Physics · Physics 2021-11-03 Dominic J. Skinner , Jörn Dunkel