English
Related papers

Related papers: The strong data processing inequality under the he…

200 papers

In this paper we study the large deviations of time averaged mean square displacement (TAMSD) for Gaussian processes. The theory of large deviations is related to the exponential decay of probabilities of large fluctuations in random…

Probability · Mathematics 2018-11-29 J. Gajda , A. Wylomanska , H. Kantz , A. V. Chechkin , G. Sikora

Heterogeneous diffusion with spatially changing diffusion coefficient arises in many experimental systems like protein dynamics in the cell cytoplasm, mobility of cajal bodies and confined hard-sphere fluids. Here, we showcase a simple…

Statistical Mechanics · Physics 2022-02-14 Prashant Singh

The distinguishability quantified by information measures after being processed by a private mechanism has been a useful tool in studying various statistical and operational tasks while ensuring privacy. To this end, standard…

Information Theory · Computer Science 2026-01-26 Theshani Nuradha , Ian George , Christoph Hirche

We derive concentration inequalities for the supremum norm of the difference between a kernel density estimator (KDE) and its point-wise expectation that hold uniformly over the selection of the bandwidth and under weaker conditions on the…

Statistics Theory · Mathematics 2020-01-01 Jisu Kim , Jaehyeok Shin , Alessandro Rinaldo , Larry Wasserman

We consider a system of $d$ non-linear stochastic heat equations in spatial dimension $k \geq 1$, whose solution is an $\R^d$-valued random field $u= \{u(t\,,x),\, (t,x) \in \R_+ \times \R^k\}$. The $d$-dimensional driving noise is white in…

Probability · Mathematics 2012-07-02 Robert C. Dalang , Davar Khoshnevisan , Eulalia Nualart

We study the quasilinear evolution of the one-point probability density functions (PDFs) of the smoothed density and velocity fields in a cosmological gravitating system beginning with Gaussian initial fluctuations. Our analytic results are…

Astrophysics · Physics 2009-10-22 Lev Kofman , Edmund Bertschinger , James M. Gelb , Adi Nusser , Avishai Dekel

We provide a Lyapunov convergence analysis for time-inhomogeneous variable coefficient stochastic differential equations (SDEs). Three typical examples include overdamped, irreversible drift, and underdamped Langevin dynamics. We first…

Probability · Mathematics 2024-02-05 Qi Feng , Xinzhe Zuo , Wuchen Li

Uncertain input of a mathematical model induces uncertainties in the output and probabilistic sensitivity analysis identifies the influential inputs to guide decision-making. Of practical concern is the probability that the output would, or…

Information Theory · Computer Science 2022-07-12 Jiannan Yang

Diffusion models, which convert noise into new data instances by learning to reverse a diffusion process, have become a cornerstone in contemporary generative modeling. In this work, we develop non-asymptotic convergence theory for a…

Machine Learning · Computer Science 2024-08-06 Gen Li , Yuting Wei , Yuejie Chi , Yuxin Chen

We prove that on compact Alexandrov spaces with curvature bounded below the gradient flow of the Dirichlet energy in the $L^2$-space produces the same evolution as the gradient flow of the relative entropy in the $L^2$-Wasserstein space.…

Differential Geometry · Mathematics 2013-02-11 Nicola Gigli , Kazumasa Kuwada , Shin-ichi Ohta

The estimation of information measures of continuous distributions based on samples is a fundamental problem in statistics and machine learning. In this paper, we analyze estimates of differential entropy in $K$-dimensional Euclidean space,…

Information Theory · Computer Science 2021-11-29 Georg Pichler , Pablo Piantanida , Günther Koliander

We show how some attractive information--theoretic properties of Gaussians pass over to more general families of stable densities. We define a new score function for symmetric stable laws, and use it to give a stable version of the heat…

Information Theory · Computer Science 2013-10-09 Oliver Johnson

The most effective differentially private machine learning algorithms in practice rely on an additional source of purportedly public data. This paradigm is most interesting when the two sources combine to be more than the sum of their…

Machine Learning · Computer Science 2025-07-25 Amrith Setlur , Pratiksha Thaker , Jonathan Ullman

We give a proof of Gaussian upper bound for the heat kernel coupled with the Ricci ow. Previous proofs by Lei Ni [5] use Harnack inequality and doubling volume property, also the recent proof by Zhang and Cao [6] uses Sobolev type…

Probability · Mathematics 2012-12-21 Koléhé Abdoulaye Coulibaly-Pasquier

In this paper, we develop a general methodology to prove weak uniqueness for stochastic differential equations with coefficients depending on some path-functionals of the process. As an extension of the technique developed by Bass \&…

Probability · Mathematics 2017-07-06 Noufel Frikha , Libo Li

Data-processing is a desired property of classical and quantum divergences and information measures. In information theory, the contraction coefficient measures how much the distinguishability of quantum states decreases when they are…

Quantum Physics · Physics 2025-12-19 Theshani Nuradha , Ian George , Christoph Hirche

Denoising diffusions sample from a probability distribution $\mu$ in $\mathbb{R}^d$ by constructing a stochastic process $({\hat{\boldsymbol x}}_t:t\ge 0)$ in $\mathbb{R}^d$ such that ${\hat{\boldsymbol x}}_0$ is easy to sample, but the…

Machine Learning · Statistics 2026-04-09 Andrea Montanari , Viet Vu

Heavy quark production provides a unique probe of the quark-gluon plasma transport properties in heavy ion collisions. Experimental observables like the nuclear modification factor $R_{\rm AA}$ and elliptic anisotropy $v_{2}$ of heavy…

High Energy Physics - Phenomenology · Physics 2020-07-28 Shuang Li , Jinfeng Liao

We consider a few cases of homogeneous and isotropic turbulence differing by the mechanisms of turbulence generation. The advective terms in the Navier-Stokes and Burgers equations are similar. It is proposed that the longitudinal structure…

chao-dyn · Physics 2009-10-30 Victor Yakhot

In this paper, we derive some upper and lower bounds and inequalities for the total variation distance (TVD) and the Kullback-Leibler divergence (KLD), also known as the relative entropy, between two probability measures $\mu$ and $\nu$…

Probability · Mathematics 2025-01-07 Ievlev Pavel , Timofei Shashkov