English
Related papers

Related papers: Information Newton's flow: second-order optimizati…

200 papers

We present a simple approach to study the one-dimensional pressureless Euler system via adhesion dynamics in the Wasserstein space of probability measures with finite quadratic moments. Starting from a discrete system of a finite number of…

Analysis of PDEs · Mathematics 2014-09-16 Luca Natile , Giuseppe Savaré

Maximization of the path information entropy is a clear prescription for constructing models in non-equilibrium statistical mechanics. Here it is shown that, following this prescription under the assumption of arbitrary instantaneous…

Data Analysis, Statistics and Probability · Physics 2016-08-01 Sergio Davis , Diego González

We consider a class of time-homogeneous diffusion processes on $\mathbb{R}^{n}$ with common invariant measure but varying volatility matrices. In Euclidean space, we show via stochastic control of the diffusion coefficient that the…

Probability · Mathematics 2023-10-31 Bertram Tschiderer

The population dynamics of molecules, cells, and organisms are governed by a number of unknown forces. In the last decade, population dynamics have predominantly been modeled with Wasserstein gradient flows. However, since gradient flows…

Machine Learning · Computer Science 2026-05-19 Vincent Guan , Lazar Atanackovic , Kirill Neklyudov

We consider discrete porous medium equations of the form \partial_t \rho_t = \Delta \phi(\rho_t), where \Delta is the generator of a reversible continuous time Markov chain on a finite set X, and \phi is an increasing function. We show that…

Functional Analysis · Mathematics 2012-12-06 Matthias Erbar , Jan Maas

Scientific data, from cellular snapshots in biology to celestial distributions in cosmology, often consists of static patterns from underlying dynamical systems. These snapshots, while lacking temporal ordering, implicitly encode the…

Machine Learning · Computer Science 2025-09-23 Yanbo Zhang , Michael Levin

Stein's method has been widely used for probability approximations. However, in the multi-dimensional setting, most of the results are for multivariate normal approximation or for test functions with bounded second- or higher-order…

Probability · Mathematics 2018-08-16 Xiao Fang , Qi-Man Shao , Lihu Xu

We discuss averaged turbulence modeling of multi-scales of length for an incompressible Newtonian fluid, with the help of the maximum information principle. We suppose that there exists a function basis to decompose the turbulent…

Fluid Dynamics · Physics 2010-09-10 L. Tao , M. Ramakrishna

We revisit the variational characterization of conservative diffusion as entropic gradient flow and provide for it a probabilistic interpretation based on stochastic calculus. It was shown by Jordan, Kinderlehrer, and Otto that, for…

Probability · Mathematics 2020-08-24 Ioannis Karatzas , Walter Schachermayer , Bertram Tschiderer

We present a short overview on the strongest variational formulation for gradient flows of geodesically $\lambda$-convex functionals in metric spaces, with applications to diffusion equations in Wasserstein spaces of probability measures.…

Classical Analysis and ODEs · Mathematics 2010-09-21 Sara Daneri , Giuseppe Savaré

We study the Wasserstein gradient flow of semi-discrete energies in the space of probability measures, that is functionals depending on two measures-one being an absolutely continuous density and the other an atomic measure. These energies…

Analysis of PDEs · Mathematics 2026-03-05 Joao Miguel Machado

Minimizing loss functions is central to machine-learning training. Although first-order methods dominate practical applications, higher-order techniques such as Newton's method can deliver greater accuracy and faster convergence, yet are…

Machine Learning · Computer Science 2025-11-25 Giuseppe Carrino , Elena Loli Piccolomini , Elisa Riccietti , Theo Mary

Wasserstein gradient flows are continuous time dynamics that define curves of steepest descent to minimize an objective function over the space of probability measures (i.e., the Wasserstein space). This objective is typically a divergence…

Optimization and Control · Mathematics 2021-02-23 Adil Salim , Anna Korba , Giulia Luise

In this paper, we formulate the Load Flow (LF) problem in radial electricity distribution networks as an unconstrained Riemannian optimization problem, consisting of two manifolds, and we consider alternative retractions and initialization…

Optimization and Control · Mathematics 2020-04-09 M. Heidarifar , P. Andrianesis , M. C. Caramanis

Several deterministic and stochastic multi-variable global optimization algorithms (Conjugate Gradient, Nelder-Mead, Quasi-Newton, and Global) are investigated in conjunction with energy minimization principle to resolve the pressure and…

Fluid Dynamics · Physics 2015-09-08 Taha Sochi

This work considers the problem of sampling from a probability distribution known up to a normalization constant while satisfying a set of statistical constraints specified by the expected values of general nonlinear functions. This problem…

Machine Learning · Statistics 2025-01-08 Luiz F. O. Chamon , Mohammad Reza Karimi , Anna Korba

This monograph develops a comprehensive statistical learning framework that is robust to (distributional) perturbations in the data using Distributionally Robust Optimization (DRO) under the Wasserstein metric. Beginning with fundamental…

Machine Learning · Statistics 2021-08-23 Ruidi Chen , Ioannis Ch. Paschalidis

In this study, we use Rational-Quadratic Neural Spline Flows, a sophisticated parametrization of Normalizing Flows, for inferring posterior probability distributions in scenarios where direct evaluation of the likelihood is challenging at…

Data Analysis, Statistics and Probability · Physics 2024-01-26 Mathias El Baz , Federico Sánchez

This work concerns linearization methods for efficiently solving the Richards` equation,a degenerate elliptic-parabolic equation which models flow in saturated/unsaturated porous media.The discretization of Richards` equation is based on…

Numerical Analysis · Mathematics 2017-06-01 Florian List , Florin Adrian Radu

Variational inference (VI) can be cast as an optimization problem in which the variational parameters are tuned to closely align a variational distribution with the true posterior. The optimization task can be approached through vanilla…

Machine Learning · Computer Science 2025-04-24 Dai Hai Nguyen , Tetsuya Sakurai , Hiroshi Mamitsuka