English
Related papers

Related papers: Guaranteeing Higher Order Convergence Rates for Ac…

200 papers

Flow matching has emerged as a powerful framework for generative modeling, offering computational advantages over diffusion models by leveraging deterministic Ordinary Differential Equations (ODEs) instead of stochastic dynamics. While…

Machine Learning · Computer Science 2025-03-13 Chengyue Gong , Xiaoyu Li , Yingyu Liang , Jiangxuan Long , Zhenmei Shi , Zhao Song , Yu Tian

In this paper, we propose a first second-order scheme based on arbitrary non-Euclidean norms, incorporated by Bregman distances. They are introduced directly in the Newton iterate with regularization parameter proportional to the square…

Optimization and Control · Mathematics 2021-12-07 Nikita Doikov , Yurii Nesterov

We provide faster algorithms for approximately solving $\ell_{\infty}$ regression, a fundamental problem prevalent in both combinatorial and continuous optimization. In particular, we provide accelerated coordinate descent methods capable…

Data Structures and Algorithms · Computer Science 2020-04-03 Aaron Sidford , Kevin Tian

Minimizing functionals in the space of probability distributions can be done with Wasserstein gradient flows. To solve them numerically, a possible approach is to rely on the Jordan-Kinderlehrer-Otto (JKO) scheme which is analogous to the…

Machine Learning · Computer Science 2022-11-16 Clément Bonet , Nicolas Courty , François Septier , Lucas Drumetz

Wasserstein gradient flows of maximum mean discrepancy (MMD) functionals with non-smooth Riesz kernels show a rich structure as singular measures can become absolutely continuous ones and conversely. In this paper we contribute to the…

Machine Learning · Computer Science 2024-03-22 Fabian Altekrüger , Johannes Hertrich , Gabriele Steidl

This paper introduces a novel second-order splitting scheme for charged-particle dynamics in strong magnetic fields characterized by the maximal ordering. The proposed scheme is explicit and symmetric, which respectively ensure the…

Numerical Analysis · Mathematics 2026-04-14 Mengting Hu , Jiyong Li , Bin Wang

We develop two novel couplings between general pure-jump L\'evy processes in $\R^d$ and apply them to obtain upper bounds on the rate of convergence in an appropriate Wasserstein distance on the path space for a wide class of L\'evy…

Probability · Mathematics 2025-06-19 Jorge González Cázares , David Kramer-Bang , Aleksandar Mijatović

This paper studies the convergence properties of the inexact Jordan-Kinderlehrer-Otto (JKO) scheme and proximal-gradient algorithm in the context of Wasserstein spaces. The JKO scheme, a widely-used method for approximating solutions to…

Optimization and Control · Mathematics 2025-06-19 Simone Di Marino , Emanuele Naldi , Silvia Villa

We study differentiable strongly quasiconvex functions for providing new properties for algorithmic and monotonicity purposes. Furthemore, we provide insights into the decreasing behaviour of strongly quasiconvex functions, applying this…

Optimization and Control · Mathematics 2024-10-07 Felipe Lara , Raúl T. Marcavillaca , Phan T. Vuong

We describe the first gradient methods on Riemannian manifolds to achieve accelerated rates in the non-convex case. Under Lipschitz assumptions on the Riemannian gradient and Hessian of the cost function, these methods find approximate…

Optimization and Control · Mathematics 2021-11-29 Christopher Criscitiello , Nicolas Boumal

This paper provides results on Wasserstein gradient flows between measures on the real line. Utilizing the isometric embedding of the Wasserstein space $\mathcal P_2(\mathbb R)$ into the Hilbert space $L_2((0,1))$, Wasserstein gradient…

Optimization and Control · Mathematics 2024-08-13 Johannes Hertrich , Robert Beinert , Manuel Gräf , Gabriele Steidl

Applications of optimal transport have recently gained remarkable attention thanks to the computational advantages of entropic regularization. However, in most situations the Sinkhorn approximation of the Wasserstein distance is replaced by…

Machine Learning · Statistics 2019-06-04 Giulia Luise , Alessandro Rudi , Massimiliano Pontil , Carlo Ciliberto

We present a new pathwise approximation scheme for stochastic differential equations driven by multidimensional Brownian motion which does not require the simulation of L\'{e}vy area and has a Wasserstein convergence rate better than the…

Probability · Mathematics 2015-07-02 Guy Flint , Terry Lyons

We present a consistent high-order staggered Lagrangian hydrodynamics framework designed to reconcile an underlying disparity in existing curvilinear formulations: the mismatch between quadrature-based "strong" mass conservation and the…

Numerical Analysis · Mathematics 2026-04-01 Zhiyuan Sun , Jun Liu , Pei Wang

Numerous infinite dimensional dynamical systems arising in different fields have been shown to exhibit a gradient flow structure in the Wasserstein space. We construct Two Point Flux Approximation Finite Volume schemes discretizing such…

Numerical Analysis · Mathematics 2020-06-29 Andrea Natale , Gabriele Todeschi

New implicit and implicit-explicit time-stepping methods for the wave equation in second-order form are described with application to two and three-dimensional problems discretized on overset grids. The implicit schemes are single step,…

Numerical Analysis · Mathematics 2024-04-24 Allison M. Carson , Jeffrey W. Banks , William D. Henshaw , Donald W. Schwendeman

We present a method to efficiently compute Wasserstein gradient flows. Our approach is based on a generalization of the back-and-forth method (BFM) introduced by Jacobs and L\'eger to solve optimal transport problems. We evolve the gradient…

Numerical Analysis · Mathematics 2020-11-17 Matt Jacobs , Wonjun Lee , Flavien Léger

This work introduces a new higher-order super-compact (HOSC) implicit finite difference scheme for analyzing three-dimensional (3D) natural convection and entropy generation in non-Newtonian fluids. The proposed scheme achieves fourth-order…

Fluid Dynamics · Physics 2024-11-12 Ashwani Punia , Rajendra K. Ray

Optimization over the space of probability measures endowed with the Wasserstein-2 geometry is central to modern machine learning and mean-field modeling. However, traditional methods relying on full Wasserstein gradients often suffer from…

Machine Learning · Statistics 2026-04-03 Yewei Xu , Qin Li

We develop multi-step gradient methods for network-constrained optimization of strongly convex functions with Lipschitz-continuous gradients. Given the topology of the underlying network and bounds on the Hessian of the objective function,…

Optimization and Control · Mathematics 2015-06-12 Euhanna Ghadimi , Iman Shames , Mikael Johansson