English
Related papers

Related papers: NPD Entropy: A Non-Parametric Differential Entropy…

200 papers

Shannon's entropy is one of the building blocks of information theory and an essential aspect of Machine Learning methods (e.g., Random Forests). Yet, it is only finitely defined for distributions with fast decaying tails on a countable…

Statistics Theory · Mathematics 2022-05-25 Jialin Zhang , Jingyi Shi

We consider the problem of estimating parameter sensitivity for Markovian models of reaction networks. Sensitivity values measure the responsiveness of an output to the model parameters. They help in analyzing the network, understanding its…

Probability · Mathematics 2014-04-18 Ankit Gupta , Mustafa Khammash

Shannon entropy is not the only entropy that is relevant to machine-learning datasets, nor possibly even the most important one. Traditional entropies such as Shannon entropy capture information represented by elements' frequencies but not…

Information Theory · Computer Science 2026-04-01 Phuc Nguyen , Josiah Couch , Rahul Bansal , Alexandra Morgan , Chris Tam , Miao Li , Rima Arnaout , Ramy Arnaout

This paper presents the first systematic study of evaluating Deep Neural Networks (DNNs) designed to forecast the evolution of stochastic complex systems. We show that traditional evaluation methods like threshold-based classification…

Machine Learning · Computer Science 2025-01-28 Harshit Kumar , Beomseok Kang , Biswadeep Chakraborty , Saibal Mukhopadhyay

The telegraph process $\{X(t), t>0\}$, is supposed to be observed at $n+1$ equidistant time points $t_i=i\Delta_n,i=0,1,..., n$. The unknown value of $\lambda$, the underlying rate of the Poisson process, is a parameter to be estimated. The…

Probability · Mathematics 2007-06-13 stefano m. iacus , nakahiro yoshida

Estimating the dissipation, or the entropy production rate (EPR), can provide insights into the underlying mechanisms of nonequilibrium driven processes. Experimentally, however, only partial information can be accessed, and the ability to…

Statistical Mechanics · Physics 2022-12-29 Uri Kapustin , Aishani Ghosal , Gili Bisker

Dynamical systems can be analyzed via their Frobenius-Perron transfer operator and its estimation from data is an active field of research. Recently entropic transfer operators have been introduced to estimate the operator of deterministic…

Dynamical Systems · Mathematics 2026-01-26 Hancheng Bi , Clément Sarrazin , Bernhard Schmitzer , Thilo D. Stier

Stochastic processes under resetting at random times have attracted a lot of attention in recent years and served as illustrations of nontrivial and interesting static and dynamic features of stochastic dynamics. In this paper, we aim to…

Statistical Mechanics · Physics 2025-06-18 Yating Wang , Hanshuang Chen

A method of estimating the joint probability mass function of a pair of discrete random variables is described. This estimator is used to construct the conditional Shannon-R\'eyni-Tsallis entropies estimates. From there almost sure rates of…

Statistics Theory · Mathematics 2020-02-18 Ba Amadou Diadie , Lo Gane Samb

Analytic continuation of numerical data obtained in imaginary time or frequency has become an essential part of many branches of quantum computational physics. It is, however, an ill-conditioned procedure and thus a hard numerical problem.…

Strongly Correlated Electrons · Physics 2016-08-18 Dominic Bergeron , A. -M. S. Tremblay

Estimating entropy production from real observation data can be difficult due to finite resolution in both space and time and finite measurement statistics. We characterize the statistical error introduced by finite sample size and compare…

Statistical Mechanics · Physics 2025-04-09 Jonas H. Fritz , Benjamin Ertel , Udo Seifert

It is well known that to estimate the Shannon entropy for symbolic sequences accurately requires a large number of samples. When some aspects of the data are known it is plausible to attempt to use this to more efficiently compute entropy.…

Data Analysis, Statistics and Probability · Physics 2018-05-18 Andrew D. Back , Daniel Angus , Janet Wiles

Measuring entropy production of a system directly from the experimental data is highly desirable since it gives a quantifiable measure of the time-irreversibility for non-equilibrium systems and can be used as a cost function to optimize…

Statistical Mechanics · Physics 2024-07-16 Prashant Singh , Karel Proesmans

We analyze the stochastic thermodynamics of systems with continuous space of states. The evolution equation, the rate of entropy production, and other results are obtained by a continuous time limit of a discrete time formulation. We point…

Statistical Mechanics · Physics 2020-08-27 Mário J. de Oliveira

We study the estimation of the invariant density of additive fractional stochastic differential equations with Hurst parameter $H \in (0,1)$. We first focus on continuous observations and develop a kernel-based estimator achieving faster…

Statistics Theory · Mathematics 2025-12-23 Chiara Amorino , Eulalia Nualart , Fabien Panloup , Julian Sieber

Long memory or long range dependency is an important phenomenon that may arise in the analysis of time series or spatial data. Most of the definitions of long memory of a stationary process $X=\{X_1, X_2,\cdots,\}$ are based on the…

Probability · Mathematics 2016-04-20 Yiming Ding , Xuyan Xiang

This paper is a survey of recent contributions on estimation in stochastic differential equations with mixed-effects. These models involve N stochastic differential equations with common drift and diffusion functions but random parameters…

Statistics Theory · Mathematics 2020-09-17 Maud Delattre

Neural networks have dramatically increased our capacity to learn from large, high-dimensional datasets across innumerable disciplines. However, their decisions are not easily interpretable, their computational costs are high, and building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mackenzie J. Meni , Ryan T. White , Michael Mayo , Kevin Pilkiewicz

Nonparametric density estimation is an unsupervised learning problem. In this work we propose a two-step procedure that casts the density estimation problem in the first step into a supervised regression problem. The advantage is that we…

Statistics Theory · Mathematics 2024-06-04 Thijs Bos , Johannes Schmidt-Hieber

Given a sample from a discretely observed multidimensional compound Poisson process, we study the problem of nonparametric estimation of its jump size density $r_0$ and intensity $\lambda_0$. We take a nonparametric Bayesian approach to the…

Statistics Theory · Mathematics 2015-06-08 Shota Gugushvili , Frank van der Meulen , Peter Spreij