English
Related papers

Related papers: Inexact JKO and proximal-gradient algorithms in th…

200 papers

This paper studies iterative schemes for measure transfer and approximation problems, which are defined through a slicing-and-matching procedure. Similar to the sliced Wasserstein distance, these schemes benefit from the availability of…

Numerical Analysis · Mathematics 2026-03-17 Shiying Li , Caroline Moosmueller , Yongzhe Wang

The adaptive cubic regularization algorithm employing the inexact gradient and Hessian is proposed on general Riemannian manifolds, together with the iteration complexity to get an approximate second-order optimality under certain…

Optimization and Control · Mathematics 2024-05-07 Z. Y. Li , X. M. Wang

We show that the continuous-time gradient descent in Rn can be viewed as an optimal controlled evolution for a suitable action functional; a similar result holds for stochastic gradient descent. We then provide an analogous characterization…

Optimization and Control · Mathematics 2025-11-03 Yongxin Chen , Tryphon Georgiou , Michele Pavon

We provide a comprehensive study of the convergence of the forward-backward algorithm under suitable geometric conditions, such as conditioning or {\L}ojasiewicz properties. These geometrical notions are usually local by nature, and may…

Optimization and Control · Mathematics 2023-12-25 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

We study a class of optimization problems in the Wasserstein space (the space of probability measures) where the objective function is nonconvex along generalized geodesics. Specifically, the objective exhibits some difference-of-convex…

Optimization and Control · Mathematics 2025-01-08 Hoang Phuc Hau Luu , Hanlin Yu , Bernardo Williams , Petrus Mikkola , Marcelo Hartmann , Kai Puolamäki , Arto Klami

We consider the distributionally robust optimization (DRO) model of principal component analysis (PCA) to account for uncertainty in the underlying probability distribution. The resulting formulation leads to a nonsmooth constrained min-max…

Optimization and Control · Mathematics 2025-07-14 Lei Wang , Xin Liu , Xiaojun Chen

We consider the problem of minimizing a convex objective which is the sum of a smooth part, with Lipschitz continuous gradient, and a nonsmooth part. Inspired by various applications, we focus on the case when the nonsmooth part is a…

Optimization and Control · Mathematics 2013-08-28 Ting Kei Pong

We propose a stochastic first-order trust-region method with inexact function and gradient evaluations for solving finite-sum minimization problems. Using a suitable reformulation of the given problem, our method combines the inexact…

Optimization and Control · Mathematics 2022-10-25 Stefania Bellavia , Natasa Krejic , Benedetta Morini , Simone Rebegoldi

We prove the first convergence guarantees for a subgradient method minimizing a generic Lipschitz function over generic Lipschitz inequality constraints. No smoothness or convexity (or weak convexity) assumptions are made. Instead, we…

Optimization and Control · Mathematics 2024-08-16 Benjamin Grimmer , Zhichao Jia

We consider a class of time-fractional porous medium equations with nonlocal pressure. We show the existence of their weak solutions by proposing a JKO scheme for modified Wasserstein distance and a square fractional Sobolev norm. Moreover,…

Analysis of PDEs · Mathematics 2024-09-16 Nhan-Phu Chung , Thanh-Son Trinh

We propose a mathematically principled PDE gradient flow framework for distributionally robust optimization (DRO). Exploiting the recent advances in the intersection of Markov Chain Monte Carlo sampling and gradient flow theory, we show…

Optimization and Control · Mathematics 2026-05-27 Zusen Xu , Jia-Jie Zhu

We develop a gradient-like algorithm to minimize a sum of peer objective functions based on coordination through a peer interconnection network. The coordination admits two stages: the first is to constitute a gradient, possibly with…

Optimization and Control · Mathematics 2023-07-19 Sandushan Ranaweera , Chathuranga Weeraddana , Prathapasinghe Dharmawansa , Carlo Fischione

We investigate asymptotic convergence in the~$\Delta x \!\rightarrow\! 0$ limit as a tool for determining whether numerical computations involving shocks are accurate. We use one-dimensional operator-split finite-difference schemes for…

Astrophysics · Physics 2009-09-25 Paul A. Kimoto , David F. Chernoff

Solving Fredholm equations of the first kind is crucial in many areas of the applied sciences. In this work we adopt a probabilistic and variational point of view by considering a minimization problem in the space of probability measures…

Optimization and Control · Mathematics 2024-05-17 Francesca R. Crucinio , Valentin De Bortoli , Arnaud Doucet , Adam M. Johansen

We propose a gradient-based Jacobi algorithm for a class of maximization problems on the unitary group, with a focus on approximate diagonalization of complex matrices and tensors by unitary transformations. We provide weak convergence…

Optimization and Control · Mathematics 2020-07-13 Konstantin Usevich , Jianze Li , Pierre Comon

We incorporate inertial terms in the hybrid proximal-extragradient algorithm and investigate the convergence properties of the resulting iterative scheme designed for finding the zeros of a maximally monotone operator in real Hilbert…

Functional Analysis · Mathematics 2014-07-02 Radu Ioan Bot , Ernö Robert Csetnek

We address the optimization problem of simultaneously minimizing multiple objective functionals over a family of probability distributions. This type of Multi-Objective Distributional Optimization commonly arises in machine learning and…

Machine Learning · Computer Science 2025-05-27 Dai Hai Nguyen , Hiroshi Mamitsuka , Atsuyoshi Nakamura

We consider the classical gradient descent algorithm with constant stepsizes, where some error is introduced in the computation of each gradient. More specifically, we assume some relative bound on the inexactness, in the sense that the…

Optimization and Control · Mathematics 2025-09-12 Pierre Vernimmen , François Glineur

On the flat torus in any dimension we prove existence of a solution to the TV Wasserstein gradient flow equation, only assuming that the initial density $\rho_0$ is bounded from below and above by strictly positive constants. This solution…

Analysis of PDEs · Mathematics 2026-02-02 Kexin Lin , Filippo Santambrogio

This paper studies minimax optimization problems defined over infinite-dimensional function classes of overparameterized two-layer neural networks. In particular, we consider the minimax optimization problem stemming from estimating linear…

Machine Learning · Computer Science 2024-10-25 Yuchen Zhu , Yufeng Zhang , Zhaoran Wang , Zhuoran Yang , Xiaohong Chen
‹ Prev 1 8 9 10 Next ›