中文
相关论文

相关论文: Hessian-guided Perturbed Wasserstein Gradient Flow…

200 篇论文

Nonsmooth nonconvex optimization problems broadly emerge in machine learning and business decision making, whereas two core challenges impede the development of efficient solution methods with finite-time convergence guarantee: the lack of…

最优化与控制 · 数学 2022-10-18 Tianyi Lin , Zeyu Zheng , Michael I. Jordan

Sliced Wasserstein (SW) distances offer an efficient method for comparing high-dimensional probability measures by projecting them onto multiple 1-dimensional probability distributions. However, identifying informative slicing directions…

机器学习 · 计算机科学 2025-06-04 Navid NaderiAlizadeh , Darian Salehi , Xinran Liu , Soheil Kolouri

The sliced-Wasserstein flow is an evolution equation where a probability density evolves in time, advected by a velocity field computed as the average among directions in the unit sphere of the optimal transport displacements from its 1D…

最优化与控制 · 数学 2024-05-13 Giacomo Cozzi , Filippo Santambogio

A recurring obstacle in the study of Wasserstein gradient flow is the lack of convexity of the square Wasserstein metric. In this paper, we develop a class of transport metrics that have better convexity properties and use these metrics to…

偏微分方程分析 · 数学 2014-06-06 Katy Craig

Over the past fifteen years, the theory of Wasserstein gradient flows of convex (or, more generally, semiconvex) energies has led to advances in several areas of partial differential equations and analysis. In this work, we extend the…

偏微分方程分析 · 数学 2017-05-04 Katy Craig

Applications of optimal transport have recently gained remarkable attention thanks to the computational advantages of entropic regularization. However, in most situations the Sinkhorn approximation of the Wasserstein distance is replaced by…

机器学习 · 统计学 2019-06-04 Giulia Luise , Alessandro Rudi , Massimiliano Pontil , Carlo Ciliberto

Nesterov's accelerated gradient descent (AGD), an instance of the general family of "momentum methods", provably achieves faster convergence rate than gradient descent (GD) in the convex setting. However, whether these methods are superior…

机器学习 · 计算机科学 2017-11-29 Chi Jin , Praneeth Netrapalli , Michael I. Jordan

Accelerating the convergence of second-order optimization, particularly Newton-type methods, remains a pivotal challenge in algorithmic research. In this paper, we extend previous work on the \textbf{Quadratic Gradient (QG)} and rigorously…

最优化与控制 · 数学 2026-04-01 John Chiang

This paper presents a novel Wasserstein distributionally robust control and state estimation algorithm for partially observable linear stochastic systems, where the probability distributions of disturbances and measurement noises are…

系统与控制 · 电气工程与系统科学 2024-06-05 Minhyuk Jang , Astghik Hakobyan , Insoon Yang

We propose a new algorithm that uses an auxiliary neural network to express the potential of the optimal transport map between two data distributions. In the sequel, we use the aforementioned map to train generative networks. Unlike WGANs,…

机器学习 · 计算机科学 2020-04-21 Vaios Laschos , Jan Tinapp , Klaus Obermayer

Wasserstein distributionally robust optimization (WDRO) strengthens statistical learning under model uncertainty by minimizing the local worst-case risk within a prescribed ambiguity set. Although WDRO has been extensively studied in…

机器学习 · 统计学 2025-11-12 Changyu Liu , Yuling Jiao , Junhui Wang , Jian Huang

Gromov--Wasserstein (GW) distances compare graphs, shapes, and point clouds through internal distances, without requiring a common coordinate system. This invariance is powerful, but discrete GW is a nonconvex quadratic optimal transport…

机器学习 · 计算机科学 2026-05-15 Ao Xu , Tieru Wu

We study the performance of stochastic first-order methods for finding saddle points of convex-concave functions. A notorious challenge faced by such methods is that the gradients can grow arbitrarily large during optimization, which may…

机器学习 · 计算机科学 2024-06-10 Gergely Neu , Nneka Okolo

Stochastic gradient descent (SGD) with stochastic momentum is popular in nonconvex stochastic optimization and particularly for the training of deep neural networks. In standard SGD, parameters are updated by improving along the path of the…

机器学习 · 计算机科学 2021-06-08 Jun-Kun Wang , Chi-Heng Lin , Jacob Abernethy

Wasserstein distributionally robust optimization (WDRO) optimizes against worst-case distributional shifts within a specified uncertainty set, leading to enhanced generalization on unseen adversarial examples, compared to standard…

机器学习 · 计算机科学 2025-03-07 Shuang Liu , Yihan Wang , Yifan Zhu , Yibo Miao , Xiao-Shan Gao

Multi-objective optimization (MOO) aims to optimize multiple, possibly conflicting objectives with widespread applications. We introduce a novel interacting particle method for MOO inspired by molecular dynamics simulations. Our approach…

机器学习 · 计算机科学 2024-11-22 Yinuo Ren , Tesi Xiao , Tanmay Gangwani , Anshuka Rangi , Holakou Rahmanian , Lexing Ying , Subhajit Sanyal

We develop a new algorithm for non-convex stochastic optimization that finds an $\epsilon$-critical point in the optimal $O(\epsilon^{-3})$ stochastic gradient and Hessian-vector product computations. Our algorithm uses Hessian-vector…

机器学习 · 计算机科学 2021-07-13 Hoang Tran , Ashok Cutkosky

We study the behavior of the Wasserstein-$2$ distance between discrete measures $\mu$ and $\nu$ in $\mathbb{R}^d$ when both measures are smoothed by small amounts of Gaussian noise. This procedure, known as Gaussian-smoothed optimal…

统计理论 · 数学 2022-06-15 Yunzi Ding , Jonathan Niles-Weed

In this paper, we deal with a class of time-homogeneous continuous-time Markov processes with transition probabilities bearing a nonparametric uncertainty. The uncertainty is modeled by considering perturbations of the transition…

概率论 · 数学 2022-04-11 Sven Fuhrmann , Michael Kupper , Max Nendel

We provide upper bounds of the expected Wasserstein distance between a probability measure and its empirical version, generalizing recent results for finite dimensional Euclidean spaces and bounded functional spaces. Such a generalization…

统计理论 · 数学 2020-01-29 Jing Lei
‹ 上一页 1 8 9 10 下一页 ›