English
Related papers

Related papers: Gradient Flows and Nonlinear Power Methods for the…

200 papers

This paper addresses the gradient flow -- the continuous-time representation of the gradient method -- with the smooth approximation of a non-differentiable objective function and presents convergence analysis framework. Similar to the…

Optimization and Control · Mathematics 2023-12-08 Mitsuru Toyoda , Akatsuki Nishioka , Mirai Tanaka

We propose a quasi-Grassmannian gradient flow model for eigenvalue problems of linear operators, aiming to efficiently address many eigenpairs. Our model inherently ensures asymptotic orthogonality: without the need for initial…

Numerical Analysis · Mathematics 2025-06-27 Shengyue Wang , Aihui Zhou

Sampling a probability distribution with an unknown normalization constant is a fundamental problem in computational science and engineering. This task may be cast as an optimization problem over all probability measures, and an initial…

Machine Learning · Statistics 2024-09-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

In this work, we show that a family of non-linear mean-field equations on discrete spaces can be viewed as a gradient flow of a natural free energy functional with respect to a certain metric structure we make explicit. We also prove that…

Probability · Mathematics 2016-10-26 Matthias Erbar , Max Fathi , Vaios Laschos , André Schlichting

Numerical solution of Euler-Euler model using different in-house, open source and commercial software can generate significantly different results, even when the governing equations and the initial and boundary conditions are exactly same.…

Fluid Dynamics · Physics 2024-06-03 Yige Liu , Mingming He , Jianhua Chen , Wen Li , Bidan Zhao , Ji Xu , Junwu Wang

We investigate a family of approximate multi-step proximal point methods, accelerated by implicit linear discretizations of gradient flow. The resulting methods are multi-step proximal point methods, with similar computational cost in each…

Optimization and Control · Mathematics 2023-10-23 Yushen Huang , Yifan Sun

The main contribution of this paper is the formulation of a diffuse approximation method(DAM), for two-dimensional channel flows. The proposed method is based on the vorticity-streamfunction formulation. The DAM which estimates derivates of…

Computational Physics · Physics 2018-11-19 Christian Prax , Hamou Sadat

We study the numerical behaviour of a particle method for gradient flows involving linear and nonlinear diffusion. This method relies on the discretisation of the energy via non-overlapping balls centred at the particles. The resulting…

Analysis of PDEs · Mathematics 2016-12-07 J. A. Carrillo , Y. Huang , F. S. Patacchini , G. Wolansky

Sampling a target probability distribution with an unknown normalization constant is a fundamental challenge in computational science and engineering. Recent work shows that algorithms derived by considering gradient flows in the space of…

Machine Learning · Statistics 2024-03-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M Stuart

The initial-value problem for the perturbed gradient flow \[ B(t,u(t)) \in \partial\Psi_{u(t)}(u'(t))+\partial \mathcal E_t(u(t)) \text{ for a.a. } t\in (0,T),\qquad u(0)=u_0 \] with a perturbation $B$ in a Banach space $V$ is investigated,…

Mathematical Physics · Physics 2018-01-17 Aras Bacho , Etienne Emmrich , Alexander Mielke

We present a novel approximate inference method for diffusion processes, based on the Wasserstein gradient flow formulation of the diffusion. In this formulation, the time-dependent density of the diffusion is derived as the limit of…

Machine Learning · Statistics 2018-06-13 Charlie Frogner , Tomaso Poggio

Recently, minimax optimization received renewed focus due to modern applications in machine learning, robust optimization, and reinforcement learning. The scale of these applications naturally leads to the use of first-order methods.…

Optimization and Control · Mathematics 2023-03-07 Saeed Hajizadeh , Haihao Lu , Benjamin Grimmer

The article deals with gradient-like iterative methods for solving nonlinear operator equations on Hilbert and Banach spaces. The authors formulate a general principle of studying such methods. This principle allows to formulate simple…

Functional Analysis · Mathematics 2008-09-09 O. N. Evkhuta , P. P. Zabreiko

This paper introduces a novel steepest descent flow in Banach spaces. This extends previous works on generalized gradient descent, notably the work of Charpiat et al., to the setting of Finsler metrics. Such a generalized gradient allows…

Numerical Analysis · Mathematics 2015-12-08 Guillaume Charpiat , Giacomo Nardi , Gabriel Peyré , François-Xavier Vialard

A recurring obstacle in the study of Wasserstein gradient flow is the lack of convexity of the square Wasserstein metric. In this paper, we develop a class of transport metrics that have better convexity properties and use these metrics to…

Analysis of PDEs · Mathematics 2014-06-06 Katy Craig

Proximal methods are known to identify the underlying substructure of nonsmooth optimization problems. Even more, in many interesting situations, the output of a proximity operator comes with its structure at no additional cost, and…

Optimization and Control · Mathematics 2023-02-10 Gilles Bareilles , Franck Iutzeler , Jérôme Malick

In this study, we investigate the performance of two novel first-order optimization algorithms, namely the rescaled-gradient flow (RGF) and the signed-gradient flow (SGF). These algorithms are derived from the forward Euler discretization…

Machine Learning · Computer Science 2025-03-19 Siqi Zhang , Mouhacine Benosman , Orlando Romero

We establish long-time existence of Banach gradient flows for generalised integral Menger curvatures and tangent-point energies, and for O'Hara's self-repulsive potentials $E^{\alpha,p}$. In order to do so, we employ the theory of curves of…

Classical Analysis and ODEs · Mathematics 2023-04-25 Hannes Matt , Daniel Steenebrügge , Heiko von der Mosel

This paper presents a rigorous convergence analysis of the $L^{p+1}$-normalized gradient flow with asymptotic Lagrange multiplier (GFALM) method for computing the action ground state of the nonlinear Schr\"odinger equation in the focusing…

Numerical Analysis · Mathematics 2026-02-25 Wei Liu , Tingfeng Wang , Xiaofei Zhao

We study the particle method to approximate the gradient flow on the $L^p$-Wasserstein space. This method relies on the discretization of the energy introduced by [3] via nonoverlapping balls centered at the particles and preserves the…

Numerical Analysis · Mathematics 2025-01-08 Rong Lei