English
Related papers

Related papers: Fisher-Rao Gradient Flow: Geodesic Convexity and F…

200 papers

Many machine learning problems can be seen as approximating a \textit{target} distribution using a \textit{particle} distribution by minimizing their statistical discrepancy. Wasserstein Gradient Flow can move particles along a path that…

Machine Learning · Statistics 2024-06-07 Song Liu , Jiahao Yu , Jack Simons , Mingxuan Yi , Mark Beaumont

We prove the convergence of a Wasserstein gradient flow of a free energy in inhomogeneous media. Both the energy and media can depend on the spatial variable in a fast oscillatory manner. In particular, we show that the gradient-flow…

Analysis of PDEs · Mathematics 2025-08-19 Yuan Gao , Nung Kwan Yip

Using a dynamical density functional theory we analyze the density profile of a colloidal liquid near a wall under shear flow. Due to the symmetries of the system considered, the naive application of dynamical density functional theory does…

Soft Condensed Matter · Physics 2015-05-20 J. M. Brader , M. Krüger

We present two stochastic descent algorithms that apply to unconstrained optimization and are particularly efficient when the objective function is slow to evaluate and gradients are not easily obtained, as in some PDE-constrained…

Optimization and Control · Mathematics 2019-04-30 David Kozak , Stephen Becker , Alireza Doostan , Luis Tenorio

The Fisher-Snedecor $\mathcal{F}$ distribution has been recently proposed as a more accurate and mathematically tractable composite fading model than traditional established models in some practical cases. In this paper, we firstly derive…

Information Theory · Computer Science 2019-11-27 Hongyang Du , Jiayi Zhang , Kostas P. Peppas , Hui Zhao , Bo Ai , Xiaodan Zhang

One of the most popular approaches for solving total variation-regularized optimization problems in the space of measures are Particle Gradient Flows (PGFs). These restrict the problem to linear combinations of Dirac deltas and then perform…

Optimization and Control · Mathematics 2026-03-31 Christian Amend , Marcello Carioni , Konstantinos Zemas

Score-based Generative Models (SGMs) approximate a data distribution by perturbing it with Gaussian noise and subsequently denoising it via a learned reverse diffusion process. These models excel at modeling complex data distributions and…

Machine Learning · Computer Science 2025-09-23 Stefano Bruno , Sotirios Sabanis

Estimating density ratios between pairs of intractable data distributions is a core problem in probabilistic modeling, enabling principled comparisons of sample likelihoods under different data-generating processes across conditions and…

Machine Learning · Computer Science 2026-03-02 Egor Antipov , Alessandro Palma , Lorenzo Consoli , Stephan Günnemann , Andrea Dittadi , Fabian J. Theis

We study by means of an Eulerian-Lagrangian model the statistical properties of velocity and acceleration of a neutrally-buoyant finite-sized particle in a turbulent flow statistically homogeneous and isotropic. The particle equation of…

A new inequality between some functional of probability distribution functions is given. The inequality is based on strict convexity of a function used in functional definition. Equality sign in the inequality gives a characteristic…

Probability · Mathematics 2018-05-18 Lev B. Klebanov , Irina V. Volchenkova

The Fisher-Rao distance between two probability distributions of a statistical model is defined as the Riemannian geodesic distance induced by the Fisher information metric. In order to calculate the Fisher-Rao distance in closed-form, we…

Information Theory · Computer Science 2025-01-08 Frank Nielsen

This is a continuation of our previous work 0712.4092. It is well known that various isoperimetric inequalities imply their functional ``counterparts'', but in general this is not an equivalence. We show that under certain convexity…

Functional Analysis · Mathematics 2014-02-26 Emanuel Milman

A nonlinear parabolic equation of sixth order is analyzed. The equation arises as a reduction of a model from quantum statistical mechanics, and also as the gradient flow of a second-order information functional with respect to the…

Analysis of PDEs · Mathematics 2021-08-25 Daniel Matthes , Eva-Maria Rott

As an example of the nonlinear Fokker-Planck equation, the mean field Langevin dynamics recently attracts attention due to its connection to (noisy) gradient descent on infinitely wide neural networks in the mean field regime, and hence the…

Machine Learning · Statistics 2022-02-28 Atsushi Nitanda , Denny Wu , Taiji Suzuki

Learning conditional densities and identifying factors that influence the entire distribution are vital tasks in data-driven applications. Conventional approaches work mostly with summary statistics, and are hence inadequate for a…

Methodology · Statistics 2022-09-13 Chengliang Tang , Nathan Lenssen , Ying Wei , Tian Zheng

This paper investigates the gradient flow structure, well-posedness, and asymptotic behavior of the Fokker-Planck equation defined on locally uniformly finite graphs, which is highly non-trivial compared with the finite case. We first…

Probability · Mathematics 2025-11-13 Cong Wang

Hydrodynamics describes the evolution of macroscopic states in non--equilibrium thermodynamics. Following Onsager reciprocal relations, one can formulate a large class of hydrodynamic equations as gradient flows of free energies. In recent…

Mathematical Physics · Physics 2026-03-03 Wuchen Li

In optimization, the natural gradient method is well-known for likelihood maximization. The method uses the Kullback-Leibler divergence, corresponding infinitesimally to the Fisher-Rao metric, which is pulled back to the parameter space of…

Machine Learning · Statistics 2019-02-26 Anton Mallasto , Tom Dela Haije , Aasa Feragen

In proper, geodesic Gromov hyperbolic spaces, we investigate discrete-time gradient flows via the proximal point algorithm for unbounded Lipschitz convex functions. Assuming that the target convex function has negative asymptotic slope…

Optimization and Control · Mathematics 2025-10-24 Shin-ichi Ohta

We present a new time-dependent Density Functional approach to study the relaxational dynamics of an assembly of interacting particles subject to thermal noise. Starting from the Langevin stochastic equations of motion for the velocities of…

Statistical Mechanics · Physics 2016-08-31 Umberto Marini Bettolo Marconi , Pedro Tarazona
‹ Prev 1 4 5 6 7 8 10 Next ›