English
Related papers

Related papers: Tikhonov-regularised projected gradient flow for e…

200 papers

We prove non-asymptotic error bounds for particle gradient descent (PGD, Kuntz et al., 2023), a recently introduced algorithm for maximum likelihood estimation of large latent variable models obtained by discretizing a gradient flow of the…

Machine Learning · Computer Science 2025-07-17 Rocco Caprio , Juan Kuntz , Samuel Power , Adam M. Johansen

This paper is devoted to the investigation of gradient flows in asymmetric metric spaces (for example, irreversible Finsler manifolds and Minkowski normed spaces) by means of discrete approximation. We study basic properties of curves and…

Differential Geometry · Mathematics 2023-07-21 Shin-ichi Ohta , Wei Zhao

Motivated by a constrained minimization problem, it is studied the gradient flows with respect to Hessian Riemannian metrics induced by convex functions of Legendre type. The first result characterizes Hessian Riemannian structures on…

Optimization and Control · Mathematics 2018-11-27 Felipe Alvarez , Jérôme Bolte , Olivier Brahic

Entropic regularization provides a simple way to approximate linear programs whose constraints split into two or more tractable blocks. The resulting objectives are amenable to cyclic Kullback-Leibler (KL) Bregman projections, with…

Optimization and Control · Mathematics 2026-05-11 Gabriel Peyré

We consider a continuous curve of linear elliptic formally self-adjoint differential operators of first order with smooth coefficients over a compact Riemannian manifold with boundary together with a continuous curve of global elliptic…

Differential Geometry · Mathematics 2014-06-04 Bernhelm Booss-Bavnbek , Chaofeng Zhu

We study Dirichlet boundary control of Stokes flows in 2D polygonal domains. We consider cost functionals with two different boundary control regularization terms: the $L^2$ norm and an energy space seminorm. We prove well-posedness and…

Optimization and Control · Mathematics 2020-11-18 W. Gong , M. Mateos , J. Singler , Y. Zhang

We explicitly construct parameter transformations between gradient flows in metric spaces, called curves of maximal slope, having different exponents when the associated function satisfies a suitable convexity condition. These…

Analysis of PDEs · Mathematics 2024-04-04 Sho Shimoyama

This paper studies the numerical approximation of the ground state of the Gross-Pitaevskii (GP) eigenvalue problem with a fully discretized Sobolev gradient flow induced by the $H^1$ norm. For the spatial discretization, we consider the…

Numerical Analysis · Mathematics 2024-09-04 Ziang Chen , Jianfeng Lu , Yulong Lu , Xiangxiong Zhang

In a Hilbert space setting $\mathcal H$, we study the convergence properties as $t \to + \infty$ of the trajectories of the second-order differential equation \begin{equation*} \mbox{(AVD)}_{\alpha, \epsilon} \quad \quad \ddot{x}(t) +…

Optimization and Control · Mathematics 2016-02-08 Hedy Attouch , Zaki Chbani

We formulate gradient flow dynamics generated by two natural actions of the quantum metric for an isolated set of Bloch bands. Specializing to two spatial dimensions, we derive Bogomolny-type lower bounds that relate these actions to the…

Mesoscale and Nanoscale Physics · Physics 2026-01-06 T. Fukui

In this work, we study shape optimization problems in the Stokes flows. By phase-field approaches, the resulted total objective function consists of the dissipation energy of the fluids and the Ginzburg--Landau energy functional as a…

Numerical Analysis · Mathematics 2022-07-13 Futuan Li , Jiang Yang

We study the implicit regularization imposed by gradient descent for learning multi-layer homogeneous functions including feed-forward fully connected and convolutional deep neural networks with linear, ReLU or Leaky ReLU activation. We…

Machine Learning · Computer Science 2018-11-01 Simon S. Du , Wei Hu , Jason D. Lee

A new algorithm for smooth constrained optimization is proposed that never computes the value of the problem's objective function and that handles both equality and inequality constraints. The algorithm uses an adaptive switching strategy…

Optimization and Control · Mathematics 2026-02-13 S. Bellavia , S. Gratton , B. Morini , Ph. L. Toint

In this article we derive Talagrand's $T_2$ inequality on the path space w.r.t. the maximum norm for various stochastic processes, including solutions of one-dimensional stochastic differential equations with measurable drifts, backward…

Probability · Mathematics 2020-08-12 Daniel Bartl , Ludovic Tangpi

We study the global convergence of a Fisher-Rao policy gradient flow for infinite-horizon entropy-regularised Markov decision processes with Polish state and action space. The flow is a continuous-time analogue of a policy mirror descent…

Optimization and Control · Mathematics 2025-06-09 Bekzhan Kerimkulov , James-Michael Leahy , David Siska , Lukasz Szpruch , Yufei Zhang

We establish a theoretical link between the recently proposed "drifting" generative dynamics and gradient flows induced by the Sinkhorn divergence. In a particle discretization, the drift field admits a cross-minus-self decomposition: an…

Machine Learning · Computer Science 2026-03-30 Ping He , Om Khangaonkar , Hamed Pirsiavash , Yikun Bai , Soheil Kolouri

In this work, we establish a frequency-domain framework for analyzing gradient-based algorithms in linear minimax optimization problems; specifically, our approach is based on the Z-transform, a powerful tool applied in Control Theory and…

Optimization and Control · Mathematics 2020-10-08 Ioannis Anagnostides , Paolo Penna

In this paper, optimal control problems governed by diffusion equations with Dirichlet and Neumann boundary conditions are investigated in the framework of the gradient discretisation method. Gradient schemes are defined for the optimality…

Numerical Analysis · Mathematics 2018-10-09 Jerome Droniou , Neela Nataraj , Devika Shylaja

In this paper, we introduce, in a Hilbert space setting, a second order dynamical system with asymptotically vanishing damping and vanishing Tikhonov regularization that approaches a multiobjective optimization problem with convex and…

Optimization and Control · Mathematics 2025-06-30 Radu Ioan Bot , Konstantin Sonntag

We present a rigorous analysis of the transient evolution of nearly circular bilayer interfaces evolving under the thin interface limit, $\varepsilon\ll1$, of the mass preserving $L^2$-gradient flow of the strong scaling of the…

Analysis of PDEs · Mathematics 2020-09-04 Yuan Chen , Keith Promislow