相关论文: Convexity of mutual information along the Ornstein…
We study the convexity of mutual information along the evolution of the heat equation. We prove that if the initial distribution is log-concave, then mutual information is always a convex function of time. We also prove that if the initial…
We study the convexity of mutual information as a function of time along the Fokker-Planck flow. The results are generalizations of that along heat flow and Ornstein-Ulenbeck flow, which were established by A. Wibisono and V. Jog. We prove…
In this paper we study some convergence results concerning the one-dimensional distribution of a time-changed fractional Ornstein-Uhlenbeck process. In particular, we establish that, despite the time change, the process admits a Gaussian…
We derive explicit representations for the (Siegmund) dual and the inverse flow of generalized Ornstein-Uhlenbeck processes whenever these exist. It turns out that the dual and the process corresponding to the inverse stochastic flow are…
We investigate a convexity properties for normalized log moment generating function continuing a recent investigation of Chen of convex images of Gaussians. We show that any variable satisfying a ``Ehrhard-like'' property for its…
We consider the inverse problem of determining initial data in general Ornstein-Uhlenbeck equations on the Euclidean space from partial measurement localized on the so-called thick sets. Using the logarithmic convexity technique and recent…
We study large deviations for the time average of the Ornstein-Uhlenbeck process raised to an arbitrary power. We prove that beyond a critical value, large deviations are subexponential in time, with a non-convex rate function whose main…
We establish several convexity properties for the entropy and Fisher information of mixtures of centered Gaussian distributions. First, we prove that if $X_1, X_2$ are independent scalar Gaussian mixtures, then the entropy of $\sqrt{t}X_1 +…
The Ornstein-Uhlenbeck process of diffusion in the harmonic potential is re-examined in the context of the first-passage time problem. We investigate this problem to the extent that it has not yet been fully resolved and demonstrate exact…
We consider a family of one-dimensional diffusions, in dynamical Wiener mediums, which are random perturbations of the Ornstein-Uhlenbeck diffusion process. We prove quenched and annealed convergences in distribution and under weighted…
We derive a general upper bound to mutual information in terms of the Fisher information. The bound may be further used to derive a lower bound for the Bayesian quadratic cost. These two provide alternatives to other inequalities in the…
We show via counterexamples that relative entropy between the solution of a Markovian master equation and the steady state is not a convex function of time. We thus let down a curtain on a possible formulation of a principle of…
Because of the kinematic reversibility of the Stokes equation, fluid mixing at the microscale requires an interplay between advection and diffusion. Here we introduce mutual information between particle positions before and after mixing as…
We prove an extended convexity for quantum Fisher information of a mixed state with a given convex decomposition. This convexity introduces a bound which has two parts: i. classical part associated to the Fisher information of the…
We consider the processing of statistical samples $X\sim P_\theta$ by a channel $p(y|x)$, and characterize how the statistical information from the samples for estimating the parameter $\theta\in\mathbb{R}^d$ can scale with the mutual…
In this paper, we investigate the log-concavity of the kernel for the parabolic Ornstein-Uhlenbeck operator in a bounded, convex domain. Consequently, we get the preservation of the log-concavity of the initial datum by the related flow. As…
Let $S$ and $\tilde S$ be two independent and identically distributed random variables, which we interpret as the signal, and let $P_1$ and $P_2$ be two communication channels. We can choose between two measurement scenarios: either we…
The mutual information of two random variables i and j with joint probabilities t_ij is commonly used in learning Bayesian nets as well as in many other fields. The chances t_ij are usually estimated by the empirical sampling frequency…
While the quantum mutual information is a fundamental measure of quantum information, it is only defined for spacelike-separated quantum systems. Such a limitation is not present in the theory of classical information, where the mutual…
We study the mixing time guarantee for sampling in relative Fisher information via the Proximal Sampler algorithm, which is an approximate proximal discretization of the Langevin dynamics. We show that when the target probability…