English
Related papers

Related papers: A Variational Formulation of the BDF2 Method for M…

200 papers

In this work, we investigate the two-step backward differentiation formula (BDF2) with nonuniform grids for the Allen-Cahn equation. We show that the nonuniform BDF2 scheme is energy stable under the time-step ratio restriction…

Numerical Analysis · Mathematics 2022-01-05 Hong-lin Liao , Tao Tang , Tao Zhou

Gradient flow in the 2-Wasserstein space is widely used to optimize functionals over probability distributions and is typically implemented using an interacting particle system with $n$ particles. Analyzing these algorithms requires showing…

Machine Learning · Computer Science 2026-03-27 Chandan Tankala , Dheeraj M. Nagaraj , Anant Raj

In this paper we propose optimisation methods for variational regularisation problems based on discretising the inverse scale space flow with discrete gradient methods. Inverse scale space flow generalises gradient flows by incorporating a…

Optimization and Control · Mathematics 2020-02-11 Martin Benning , Erlend S. Riis , Carola-Bibiane Schönlieb

The theory of Wasserstein gradient flows in the space of probability measures has made an enormous progress over the last twenty years. It constitutes a unified and powerful framework in the study of dissipative partial differential…

Analysis of PDEs · Mathematics 2022-01-17 Daniel Adams , Manh Hong Duong , Goncalo dos Reis

Variational inference is a technique that approximates a target distribution by optimizing within the parameter space of variational families. On the other hand, Wasserstein gradient flows describe optimization within the space of…

Machine Learning · Statistics 2023-11-01 Mingxuan Yi , Song Liu

Optimization techniques are at the core of many scientific and engineering disciplines. The steepest descent methods play a foundational role in this area. In this paper we studied a generalized steepest descent method on Riemannian…

Optimization and Control · Mathematics 2025-02-28 Rashid A. , Amal A Samad

We present a manifestly covariant formulation of the gradient descent method, ensuring consistency across arbitrary coordinate systems and general curved trainable spaces. The optimization dynamics is defined using a covariant force vector…

Machine Learning · Computer Science 2025-04-15 Dmitry Guskov , Vitaly Vanchurin

We propose a novel second-order ODE as the continuous-time limit of a Riemannian accelerated gradient-based method on a manifold with curvature bounded from below. This ODE can be seen as a generalization of the ODE derived for Euclidean…

Optimization and Control · Mathematics 2020-03-10 Foivos Alimisis , Antonio Orvieto , Gary Bécigneul , Aurelien Lucchi

In this paper, we discuss the problem of minimizing the sum of two convex functions: a smooth function plus a non-smooth function. Further, the smooth part can be expressed by the average of a large number of smooth component functions, and…

Machine Learning · Computer Science 2016-11-17 Luo Luo , Zihao Chen , Zhihua Zhang , Wu-Jun Li

A variational time discretization of anisotropic Willmore flow combined with a spatial discretization via piecewise affine finite elements is presented. Here, both the energy and the metric underlying the gradient flow are anisotropic,…

Numerical Analysis · Mathematics 2015-03-25 Ricardo Perl , Paola Pozzi , Martin Rumpf

We demonstrate spontaneous bidirectional motion of droplets on liquid infused surfaces in the presence of a topographical gradient, in which the droplets can move either toward the denser or the sparser solid fraction area. Our analytical…

Wasserstein gradient flow (WGF) is a common method to perform optimization over the space of probability measures. While WGF is guaranteed to converge to a first-order stationary point, for nonconvex functionals the converged solution does…

Optimization and Control · Mathematics 2025-09-23 Naoya Yamamoto , Juno Kim , Taiji Suzuki

This paper is concerned with a rigorous convergence analysis of a fully discrete Lagrangian scheme for the Hele-Shaw flow, which is the fourth order thin-film equation with linear mobility in one space dimension. The discretization is based…

Numerical Analysis · Mathematics 2015-09-07 Horst Osberger , Daniel Matthes

We present a method to efficiently compute Wasserstein gradient flows. Our approach is based on a generalization of the back-and-forth method (BFM) introduced by Jacobs and L\'eger to solve optimal transport problems. We evolve the gradient…

Numerical Analysis · Mathematics 2020-11-17 Matt Jacobs , Wonjun Lee , Flavien Léger

Motivated by the computation of the non-parametric maximum likelihood estimator (NPMLE) and the Bayesian posterior in statistics, this paper explores the problem of convex optimization over the space of all probability distributions. We…

Statistics Theory · Mathematics 2023-11-03 Rentian Yao , Linjun Huang , Yun Yang

We are interested in existence of gradient flows for shape functionals especially for first Laplacian eigenvalues. We introduce different techniques to prove existence and use different formulations for gradient flows. We apply a…

Spectral Theory · Mathematics 2020-03-04 Yannick Holle

We derive a variational model to fit a composite B\'ezier curve to a set of data points on a Riemannian manifold. The resulting curve is obtained in such a way that its mean squared acceleration is minimal in addition to remaining close the…

Numerical Analysis · Mathematics 2018-12-10 Ronny Bergmann , Pierre-Yves Gousenbourger

Despite the widespread use of gradient-based algorithms for optimizing high-dimensional non-convex functions, understanding their ability of finding good minima instead of being trapped in spurious ones remains to a large extent an open…

We reveal a precise mathematical framework about a new family of generative models which we call Gradient Flow Drifting. With this framework, we prove an equivalence between the recently proposed Drifting Model and the Wasserstein gradient…

Machine Learning · Computer Science 2026-03-12 Jiarui Cao , Zixuan Wei , Yuxin Liu

Finite difference method and finite element method are popular methods for solving groundwater flow equations. This paper presents a new method that uses gradually varied functions to solve such equation. In this paper, we have established…

Numerical Analysis · Mathematics 2012-10-17 Li Chen , Xun-Hong Chen