中文
相关论文

相关论文: Renyi information for ergodic diffusion processes

200 篇论文

We consider triangular arrays of Markov chains that converge weakly to a diffusion process. Edgeworth type expansions of third order for transition densities are proved. This is done for time horizons that converge to 0. For this purpose we…

概率论 · 数学 2007-06-13 Valentin Konakov , Enno Mammen

Consider the density dependent (i.e. Nemytskii-type) SDEs on $\mathbb R^d$, where the drift $b_t(x,\rho(x),\rho)$ is locally integrable in $(t,x)\in [0,\infty)\times \mathbb R^d$ and may be singular in the distribution density function…

概率论 · 数学 2026-05-11 Feng-Yu Wang , Qiumiao Wen , Fen-Fen Yang

Starting from the geometrical interpretation of the R\'enyi entropy, we introduce further extensive generalizations and study their properties. In particular, we found the probability distribution function obtained by the MaxEnt principle…

统计力学 · 物理学 2015-06-17 Giorgio Sonnino , György Steinbrecher

In this article, we discuss the problem of establishing relations between information measures assessed for network structures. Two types of entropy based measures namely, the Shannon entropy and its generalization, the R\'{e}nyi entropy…

信息论 · 计算机科学 2013-01-24 Lavanya Sivakumar , Matthias Dehmer

We consider an isomorphism invariant for measure-preserving systems - types of generalized entropy convergence rates. We show the connections of this invariant with the types of Shannon entropy convergence rates. In the case when they…

动力系统 · 数学 2013-09-25 Fryderyk Falniowski

In this study an attempt has been made to propose a way to develop new distribution. For this purpose, we need only idea about distribution function. Some important statistical properties of the new distribution like moments, cumulants,…

统计方法学 · 统计学 2024-08-30 Brijesh P. Singh , Utpal Dhar Das

Transfer Entropy and Directed Information are information-theoretic measures of the directional dependency between stochastic processes. Following the definitions of Schreiber and Massey in discrete time, we define and evaluate these…

概率论 · 数学 2016-04-08 Nigel J. Newton

Entropies must correspond to mean values for them to be measurable. The Shannon entropy corresponds to the weighted arithmetic mean, whereas the Renyi entropy corresponds to the exponential mean. These means refer to code lengths, which are…

统计力学 · 物理学 2011-10-25 B. H. Lavenda

We research adaptive maximum likelihood-type estimation for an ergodic diffusion process where the observation is contaminated by noise. This methodology leads to the asymptotic independence of the estimators for the variance of observation…

统计理论 · 数学 2018-05-30 Shogo H. Nakakita , Masayuki Uchida

R\'enyi entropy is a one-parameter generalization of Shannon entropy, which has been used in various fields of physics. Despite its wide applicability, the physical interpretations of the R\'enyi entropy are not widely known. In this paper,…

统计力学 · 物理学 2024-08-29 Misaki Ozawa , Nina Javerzat

We consider stationary ergodic processes indexed by $\mathbb Z$ or $\mathbb Z^n$ whose finite dimensional marginals have laws which are absolutely continuous with respect to Lebesgue measure. We define an entropy theory for these continuous…

动力系统 · 数学 2007-05-23 D. Hamdan , W. Parry , J. -P. Thouvenot

This paper provides tight bounds on the R\'enyi entropy of a function of a discrete random variable with a finite number of possible values, where the considered function is not one-to-one. To that end, a tight lower bound on the R\'enyi…

信息论 · 计算机科学 2018-12-11 Igal Sason

In this paper, we examine the Renyi entropy rate of stationary ergodic processes. For a special class of stationary ergodic processes, we prove that the Renyi entropy rate always exists and can be polynomially approximated by its defining…

信息论 · 计算机科学 2022-07-18 Chengyu Wu , Yonglong Li , Li Xu , Guangyue Han

Gamma distributions, which contain the exponential as a special case, have a distinguished place in the representation of near-Poisson randomness for statistical processes; typically, they represent distributions of spacings between events…

数学物理 · 物理学 2009-05-22 C. T. J. Dodson

Shannon entropy was defined for probability distributions and then its using was expanded to measure the uncertainty of knowledge for systems with complete information. In this article, it is proposed to extend the using of Shannon entropy…

信息论 · 计算机科学 2017-09-15 Vasile Patrascu

This study explores a Gaussian quasi-likelihood approach for estimating parameters of diffusion processes with Markovian regime switching. Assuming the ergodicity under high-frequency sampling, we will show the asymptotic normality of the…

统计理论 · 数学 2025-05-19 Yuzhong Cheng , Hiroki Masuda

Popularized by their strong image generation performance, diffusion and related methods for generative modeling have found widespread success in visual media applications. In particular, diffusion methods have enabled new approaches to data…

图像与视频处理 · 电气工程与系统科学 2026-01-28 Yibo Yang , Stephan Mandt

In this paper, we introduce a new class of processes which are diffusions with jumps driven by a multivariate nonlinear Hawkes process. Our goal is to study their long-time behavior. In the case of exponential memory kernels for the…

概率论 · 数学 2020-01-09 Charlotte Dion , Sarah Lemler , Eva Löcherbach

We consider an infinite dimensional diffusion on $T^{\mathbb Z^d}$, where $T$ is the circle, defined by an infinitesimal generator of the form $L=\sum_{i\in\mathbb Z^d}\left(\frac{a_i(\eta)}{2}\partial^2_i +b_i(\eta)\partial_i\right)$, with…

概率论 · 数学 2016-08-08 Alejandro F. Ramirez

A deep analysis of the Lyapunov exponents, for stationary sequence of matrices going back to Furstenberg, for more general linear cocycles by Ledrappier and generalized to the context of non-linear cocycles by Avila and Viana, gives an…

动力系统 · 数学 2017-05-16 Ali Tahzibi , Jiagang Yang