English
Related papers

Related papers: A Variational Formulation of the BDF2 Method for M…

200 papers

In this paper, we study higher-order-accurate-in-time minimizing movements schemes for Wasserstein gradient flows. We introduce a novel accelerated second-order scheme, leveraging the differential structure of the Wasserstein space in both…

Analysis of PDEs · Mathematics 2025-12-23 Raymond Chu , Matt Jacobs

We prove the convergence of a particle method for the approximation of diffusive gradient flows in one dimension. This method relies on the discretisation of the energy via non-overlapping balls centred at the particles and preserves the…

Analysis of PDEs · Mathematics 2017-06-09 J. A. Carrillo , F. S. Patacchini , P. Sternberg , G. Wolansky

Variational inference, such as the mean-field (MF) approximation, requires certain conjugacy structures for efficient computation. These can impose unnecessary restrictions on the viable prior distribution family and further constraints on…

Statistics Theory · Mathematics 2023-09-11 Rentian Yao , Yun Yang

Sampling a probability distribution with an unknown normalization constant is a fundamental problem in computational science and engineering. This task may be cast as an optimization problem over all probability measures, and an initial…

Machine Learning · Statistics 2024-09-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

A fully coupled system of two second-order parabolic degenerate equations arising as a thin film approximation to the Muskat problem is interpreted as a gradient flow for the 2-Wasserstein distance in the space of probability measures with…

Analysis of PDEs · Mathematics 2013-08-29 Philippe Laurencot , Bogdan-Vasile Matioc

Gradient descent-ascent (GDA) flows play a central role in finding saddle points of bivariate functionals, with applications in optimization, game theory, and robust control. While they are well-understood in Hilbert and Banach spaces via…

Functional Analysis · Mathematics 2025-06-26 Noboru Isobe , Sho Shimoyama

We construct and analyze a projection-free linearly implicit method for the approximation of flows of harmonic maps into spheres. The proposed method is unconditionally energy stable and, under a sharp discrete regularity condition,…

Numerical Analysis · Mathematics 2026-02-16 Georgios Akrivis , Sören Bartels , Michele Ruggeri , Jilu Wang

An adaptive BDF2 implicit time-stepping method is analyzed for the phase field crystal model. The suggested method is proved to preserve a modified energy dissipation law at the discrete levels if the time-step ratios…

Numerical Analysis · Mathematics 2020-12-22 Hong-lin Liao , Bingquan Ji , Luming Zhang

We propose a family of optimization methods that achieve linear convergence using first-order gradient information and constant step sizes on a class of convex functions much larger than the smooth and strongly convex ones. This larger…

Optimization and Control · Mathematics 2018-09-14 Chris J. Maddison , Daniel Paulin , Yee Whye Teh , Brendan O'Donoghue , Arnaud Doucet

We propose a discrete functional analysis result suitable for proving compactness in the framework of fully discrete approximations of strongly degenerate parabolic problems. It is based on the original exploitation of a result related to…

Numerical Analysis · Mathematics 2015-04-16 Boris Andreianov , Clément Cancès , Ayman Moussa

We develop in this paper a new regularized flow dynamic approach to construct efficient numerical schemes for Wasserstein gradient flows in Lagrangian coordinates. Instead of approximating the Wasserstein distance which needs to solve…

Numerical Analysis · Mathematics 2024-06-24 Qing Cheng , Qianqian Liu , Wenbin Chen , Jie Shen

We propose a variational finite volume scheme to approximate the solutions to Wasserstein gradient flows. The time discretization is based on an implicit linearization of the Wasserstein distance expressed thanks to Benamou-Brenier formula,…

Numerical Analysis · Mathematics 2019-07-22 Clément Cancès , Thomas O. Gallouët , Gabriele Todeschi

Accelerated gradient descent iterations are widely used in optimization. It is known that, in the continuous-time limit, these iterations converge to a second-order differential equation which we refer to as the accelerated gradient flow.…

Optimization and Control · Mathematics 2020-06-16 Mohammad Farazmand

This paper contains two contributions in the study of optimal transport on metric graphs. Firstly, we prove a Benamou-Brenier formula for the Wasserstein distance, which establishes the equivalence of static and dynamical optimal transport.…

Analysis of PDEs · Mathematics 2022-05-02 Matthias Erbar , Dominik Forkert , Jan Maas , Delio Mugnolo

In this paper, we present a novel second-order generalised rotational discrete gradient scheme for numerically approximating the orthonormal frame gradient flow of biaxial nematic liquid crystals. This scheme relies on reformulating the…

Numerical Analysis · Mathematics 2023-10-17 Hanbin Wang , Jie Xu , Zhiguo Yang

We study the numerical behaviour of a particle method for gradient flows involving linear and nonlinear diffusion. This method relies on the discretisation of the energy via non-overlapping balls centred at the particles. The resulting…

Analysis of PDEs · Mathematics 2016-12-07 J. A. Carrillo , Y. Huang , F. S. Patacchini , G. Wolansky

We present a novel approximate inference method for diffusion processes, based on the Wasserstein gradient flow formulation of the diffusion. In this formulation, the time-dependent density of the diffusion is derived as the limit of…

Machine Learning · Statistics 2018-06-13 Charlie Frogner , Tomaso Poggio

We study a second order BDF (Backward Differentiation Formula) scheme for the numerical approximation of parabolic HJB (Hamilton-Jacobi-Bellman) equations. The scheme under consideration is implicit, non-monotone, and second order accurate…

Numerical Analysis · Mathematics 2018-02-21 Olivier Bokanowski , Athena Picarelli , Christoph Reisinger

We propose a novel, highly efficient, mean-reverting-SAV-BDF2-based, long-time unconditionally stable numerical scheme for a class of finite-dimensional nonlinear models important in geophysical fluid dynamics. The scheme is highly…

Numerical Analysis · Mathematics 2025-04-15 Jack Coleman , Daozhi Han , Xiaoming Wang

In this paper, we study a novel second-order energy stable Backward Differentiation Formula (BDF) finite difference scheme for the epitaxial thin film equation with slope selection (SS). One major challenge for the higher oder in time…

Numerical Analysis · Mathematics 2017-06-29 Wenqiang Feng , Cheng Wang , Steven M. Wise , Zhengru Zhang