中文
相关论文

相关论文: A First-Order Algorithmic Framework for Wasserstei…

200 篇论文

Reinforcement learning algorithms, though successful, tend to over-fit to training environments hampering their application to the real-world. This paper proposes $\text{W}\text{R}^{2}\text{L}$ -- a robust reinforcement learning algorithm…

We study finite-sample statistical performance guarantees for distributionally robust optimization (DRO) with optimal transport (OT) and OT-regularized divergence model neighborhoods. Specifically, we derive concentration inequalities for…

机器学习 · 统计学 2026-03-31 Jeremiah Birrell , Xiaoxi Shen

We study a single-server appointment scheduling problem with a fixed sequence of appointments, for which we must determine the arrival time for each appointment. We specifically examine two stochastic models. In the first model, we assume…

最优化与控制 · 数学 2019-07-09 Ruiwei Jiang , Minseok Ryu , Guanglin Xu

Distributionally Robust Optimization (DRO), which aims to find an optimal decision that minimizes the worst case cost over the ambiguity set of probability distribution, has been widely applied in diverse applications, e.g., network…

机器学习 · 计算机科学 2022-12-20 Yang Jiao , Kai Yang , Dongjin Song

Recent progress in Large Language Model (LLM) reasoning is increasingly driven by the refinement of post-training loss functions and alignment strategies. However, standard Reinforcement Learning (RL) paradigms like Group Relative Policy…

机器学习 · 计算机科学 2026-01-28 Kishan Panaganti , Zhenwen Liang , Wenhao Yu , Haitao Mi , Dong Yu

Learning under a Wasserstein loss, a.k.a. Wasserstein loss minimization (WLM), is an emerging research topic for gaining insights from a large set of structured objects. Despite being conceptually simple, WLM problems are computationally…

统计计算 · 统计学 2017-06-07 Jianbo Ye , James Z. Wang , Jia Li

In data-driven optimization, sample average approximation (SAA) is known to suffer from the so-called optimizer's curse that causes an over-optimistic evaluation of the solution performance. We argue that a special type of distributionallly…

最优化与控制 · 数学 2023-10-13 Zhenyuan Liu , Bart P. G. Van Parys , Henry Lam

We propose an adjusted Wasserstein distributionally robust estimator -- based on a nonlinear transformation of the Wasserstein distributionally robust (WDRO) estimator in statistical learning. The classic WDRO estimator is asymptotically…

机器学习 · 统计学 2024-05-13 Yiling Xie , Xiaoming Huo

Distributionally-robust optimization is often studied for a fixed set of distributions rather than time-varying distributions that can drift significantly over time (which is, for instance, the case in finance and sociology due to…

最优化与控制 · 数学 2020-10-01 Iman Shames , Farhad Farokhi

Distributionally robust optimization (DRO) provides a framework for training machine learning models that are able to perform well on a collection of related data distributions (the "uncertainty set"). This is done by solving a min-max…

机器学习 · 计算机科学 2021-04-01 Paul Michel , Tatsunori Hashimoto , Graham Neubig

This paper studies Distributionally Robust Optimization (DRO), a fundamental framework for enhancing the robustness and generalization of statistical learning and optimization. An effective ambiguity set for DRO must involve distributions…

机器学习 · 计算机科学 2025-10-28 Jiaqi Wen , Jianyi Yang

We study distributionally robust optimization with Sinkhorn distance -- a variant of Wasserstein distance based on entropic regularization. We derive a convex programming dual reformulation for general nominal distributions, transport…

最优化与控制 · 数学 2025-03-27 Jie Wang , Rui Gao , Yao Xie

Generative Adversarial Networks (GANs) are one of the most practical methods for learning data distributions. A popular GAN formulation is based on the use of Wasserstein distance as a metric between probability distributions.…

机器学习 · 计算机科学 2018-05-23 Maziar Sanjabi , Jimmy Ba , Meisam Razaviyayn , Jason D. Lee

Optimal transport is a foundational problem in optimization, that allows to compare probability distributions while taking into account geometric aspects. Its optimal objective value, the Wasserstein distance, provides an important loss…

机器学习 · 计算机科学 2020-02-21 Marin Ballu , Quentin Berthet , Francis Bach

The study of robustness has received much attention due to its inevitability in data-driven settings where many systems face uncertainty. One such example of concern is Bayesian Optimization (BO), where uncertainty is multi-faceted, yet…

机器学习 · 计算机科学 2023-10-31 Hisham Husain , Vu Nguyen , Anton van den Hengel

A major challenge in aligning large language models (LLMs) with human preferences is the issue of distribution shift. LLM alignment algorithms rely on static preference datasets, assuming that they accurately represent real-world user…

机器学习 · 计算机科学 2026-01-16 Zaiyan Xu , Sushil Vemuri , Kishan Panaganti , Dileep Kalathil , Rahul Jain , Deepak Ramachandran

Recent deep models for solving routing problems always assume a single distribution of nodes for training, which severely impairs their cross-distribution generalization ability. In this paper, we exploit group distributionally robust…

机器学习 · 计算机科学 2022-02-16 Yuan Jiang , Yaoxin Wu , Zhiguang Cao , Jie Zhang

This paper investigates group distributionally robust optimization (GDRO) with the goal of learning a model that performs well over $m$ different distributions. First, we formulate GDRO as a stochastic convex-concave saddle-point problem,…

机器学习 · 计算机科学 2024-11-21 Lijun Zhang , Haomin Bai , Peng Zhao , Tianbao Yang , Zhi-Hua Zhou

Our goal is to train control policies that generalize well to unseen environments. Inspired by the Distributionally Robust Optimization (DRO) framework, we propose DRAGEN - Distributionally Robust policy learning via Adversarial Generation…

机器人学 · 计算机科学 2022-07-08 Allen Z. Ren , Anirudha Majumdar

We consider the problem of learning a control policy that is robust against the parameter mismatches between the training environment and testing environment. We formulate this as a distributionally robust reinforcement learning (DR-RL)…

机器学习 · 计算机科学 2023-05-23 Zaiyan Xu , Kishan Panaganti , Dileep Kalathil