中文
相关论文

相关论文: Tikhonov Regularization is Optimal Transport Robus…

200 篇论文

Design of reliable systems must guarantee stability against input perturbations. In machine learning, such guarantee entails preventing overfitting and ensuring robustness of models against corruption of input data. In order to maximize…

机器学习 · 统计学 2019-08-08 Judy Hoffman , Daniel A. Roberts , Sho Yaida

To mitigate the limitation that the classical reinforcement learning (RL) framework heavily relies on identical training and test environments, Distributionally Robust RL (DRRL) has been proposed to enhance performance across a range of…

机器学习 · 统计学 2024-09-24 Zhipeng Liang , Xiaoteng Ma , Jose Blanchet , Jiheng Zhang , Zhengyuan Zhou

We consider robust variants of the standard optimal transport, named robust optimal transport, where marginal constraints are relaxed via Kullback-Leibler divergence. We show that Sinkhorn-based algorithms can approximate the optimal cost…

机器学习 · 计算机科学 2021-10-29 Khang Le , Huy Nguyen , Quang Nguyen , Tung Pham , Hung Bui , Nhat Ho

Distributionally robust optimization (DRO) studies decision problems under uncertainty where the probability distribution governing the uncertain problem parameters is itself uncertain. A key component of any DRO model is its ambiguity set,…

最优化与控制 · 数学 2025-05-28 Daniel Kuhn , Soroosh Shafiee , Wolfram Wiesemann

In this paper, for a convex-concave bilinear saddle point problem, we propose a Tikhonov regularized second-order primal-dual dynamical system with slow damping, extrapolation and general time scaling parameters. Depending on the vanishing…

最优化与控制 · 数学 2024-09-10 Xiangkai Sun , Liang He , Xian-Jun Long

In this paper, we are motivated by two important applications: entropy-regularized optimal transport problem and road or IP traffic demand matrix estimation by entropy model. Both of them include solving a special type of optimization…

最优化与控制 · 数学 2017-09-27 Pavel Dvurechensky , Alexander Gasnikov , Sergey Omelchenko , Alexander Tiurin

We introduce a new class of optimal-transport-regularized divergences, $D^c$, constructed via an infimal convolution between an information divergence, $D$, and an optimal-transport (OT) cost, $C$, and study their use in distributionally…

机器学习 · 计算机科学 2025-07-25 Jeremiah Birrell , Reza Ebrahimi

This paper proposes novel primal-dual dynamical systems for solving linear equality constrained convex optimization. First, we introduce a primal-dual dynamical system with implicit Hessian damping, which can neutralize the transversal…

最优化与控制 · 数学 2025-08-26 Hong-lu Li , Xin He , Yi-bin Xiao

In this paper we propose and study a novel optimal transport based regularization of linear dynamic inverse problems. The considered inverse problems aim at recovering a measure valued curve and are dynamic in the sense that (i) the…

泛函分析 · 数学 2023-04-26 Kristian Bredies , Silvio Fanzon

Despite the growing prevalence of artificial neural networks in real-world applications, their vulnerability to adversarial attacks remains a significant concern, which motivates us to investigate the robustness of machine learning models.…

机器学习 · 计算机科学 2024-08-23 Jie Wang , Rui Gao , Yao Xie

In this work, we present an algorithmically tractable safe approximation of distributionally robust optimization (DRO) problems that contain univariate indicator functions. The latter appear in different applications, but render the model…

最优化与控制 · 数学 2026-01-22 Jana Dienstbier , Frauke Liers , Florian Rösel , Jan Rolfes

We introduce a novel kind of robustness in linear programming. A solution x* is called robust optimal if for all realizations of objective functions coefficients and constraint matrix entries from given interval domains there are…

最优化与控制 · 数学 2019-05-27 Milan Hladík

Optimal Transport is a foundational mathematical theory that connects optimization, partial differential equations, and probability. It offers a powerful framework for comparing probability distributions and has recently become an important…

机器学习 · 统计学 2025-05-13 Gabriel Peyré

Communication efficiency and robustness are two major issues in modern distributed learning framework. This is due to the practical situations where some computing nodes may have limited communication power or may behave adversarial…

机器学习 · 统计学 2021-03-02 Xingcai Zhou , Le Chang , Pengfei Xu , Shaogao Lv

Regularization techniques are necessary to compute meaningful solutions to discrete ill-posed inverse problems. The well-known 2-norm Tikhonov regularization method equipped with a discretization of the gradient operator as regularization…

数值分析 · 数学 2024-06-05 Silvia Gazzola , Ali Gholami

The classical problem of optimal transportation can be formulated as a linear optimization problem on a convex domain: among all joint measures with fixed marginals find the optimal one, where optimality is measured against a cost function.…

最优化与控制 · 数学 2012-11-29 Jonathan Korman , Robert J. McCann

We study a variant of the martingale optimal transport problem in a multi-period setting to derive robust price bounds of a financial derivative. On top of marginal and martingale constraints, we introduce a time-homogeneity assumption,…

数理金融 · 定量金融 2021-05-07 Stephan Eckstein , Michael Kupper

Regularized optimal transport (OT) is now increasingly used as a loss or as a matching layer in neural networks. Entropy-regularized OT can be computed using the Sinkhorn algorithm but it leads to fully-dense transportation plans, meaning…

机器学习 · 统计学 2023-04-17 Tianlin Liu , Joan Puigcerver , Mathieu Blondel

We investigate the asymptotic properties of the trajectories generated by a second-order dynamical system with Hessian driven damping and a Tikhonov regularization term in connection with the minimization of a smooth convex function in…

最优化与控制 · 数学 2020-08-03 Radu Ioan Bot , Ernö Robert Csetnek , Szilárd Csaba László

Square-root (loss) regularized models have recently become popular in linear regression due to their nice statistical properties. Moreover, some of these models can be interpreted as the distributionally robust optimization counterparts of…

最优化与控制 · 数学 2023-10-06 Hong T. M. Chu , Kim-Chuan Toh , Yangjing Zhang