中文
相关论文

相关论文: Drago: Primal-Dual Coupled Variance Reduction for …

200 篇论文

Limiting failures of machine learning systems is of paramount importance for safety-critical applications. In order to improve the robustness of machine learning systems, Distributionally Robust Optimization (DRO) has been proposed as a…

This paper studies distributionally robust optimization (DRO) with polynomial robust constraints. We give a Moment-SOS relaxation approach to solve the DRO. This reduces to solving linear conic optimization with semidefinite constraints.…

最优化与控制 · 数学 2025-05-13 Jiawang Nie , Suhan Zhong

Primal-dual methods in online optimization give several of the state-of-the art results in both of the most common models: adversarial and stochastic/random order. Here we try to provide a more unified analysis of primal-dual algorithms to…

数据结构与算法 · 计算机科学 2020-11-04 Marco Molinaro

We investigate a stochastic program with expected value constraints, addressing the problem in a general context through Distributionally Robust Optimization (DRO) approach using Wasserstein distances, where the ambiguity set depends on the…

最优化与控制 · 数学 2023-04-18 Diego Fonseca , Mauricio Junca

We investigate model risk and distributionally robust optimization (DRO) under marginal and martingale constraints. Building on our previous work, we address the previously open case of static hedging with second-period maturity vanilla…

概率论 · 数学 2026-01-29 Nathan Sauldubois

We consider a generic empirical composition optimization problem, where there are empirical averages present both outside and inside nonlinear loss functions. Such a problem is of interest in various machine learning applications, and…

最优化与控制 · 数学 2019-11-04 Adithya M. Devraj , Jianshu Chen

Wasserstein distributionally robust optimization (DRO) has recently achieved empirical success for various applications in operations research and machine learning, owing partly to its regularization effect. Although connection between…

机器学习 · 计算机科学 2020-11-02 Rui Gao , Xi Chen , Anton J. Kleywegt

In this paper we develop a Stochastic Gradient Langevin Dynamics (SGLD) algorithm tailored for solving a certain class of non-convex distributionally robust optimisation (DRO) problems. By deriving non-asymptotic convergence bounds, we…

最优化与控制 · 数学 2026-05-08 Ariel Neufeld , Matthew Ng Cheng En , Ying Zhang

Mean-variance optimization (MVO) is known to be sensitive to estimation error in its inputs. Norm penalization of MVO programs is a regularization technique that can mitigate the adverse effects of estimation error. We augment the standard…

最优化与控制 · 数学 2022-11-30 Andrew Butler , Roy H. Kwon

This paper studies distributionally robust optimization (DRO) when the ambiguity set is given by moments for the distributions. The objective and constraints are given by polynomials in decision variables. We reformulate the DRO with…

最优化与控制 · 数学 2022-12-02 Jiawang Nie , Liu Yang , Suhan Zhong , Guangming Zhou

Many machine learning algorithms minimize a regularized risk, and stochastic optimization is widely used for this task. When working with massive data, it is desirable to perform stochastic optimization in parallel. Unfortunately, many…

机器学习 · 统计学 2023-11-27 Shin Matsushima , Hyokun Yun , Xinhua Zhang , S. V. N. Vishwanathan

Distributionally robust stochastic optimization (DRSO) is an approach to optimization under uncertainty in which, instead of assuming that there is a known true underlying probability distribution, one hedges against a chosen set of…

最优化与控制 · 数学 2022-05-03 Rui Gao , Anton J. Kleywegt

There is a recent interest on first-order methods for linear programming (LP). In this paper,we propose a stochastic algorithm using variance reduction and restarts for solving sharp primal-dual problems such as LP. We show that the…

最优化与控制 · 数学 2024-01-02 Haihao Lu , Jinwen Yang

In this paper, we propose two novel non-stationary first-order primal-dual algorithms to solve nonsmooth composite convex optimization problems. Unlike existing primal-dual schemes where the parameters are often fixed, our methods use…

最优化与控制 · 数学 2020-07-13 Quoc Tran-Dinh , Yuzixuan Zhu

By exploiting double-penalty terms for the primal subproblem, we develop a novel relaxed augmented Lagrangian method for solving a family of convex optimization problems subject to equality or inequality constraints. The method is then…

数值分析 · 数学 2025-06-16 Jianchao Bai , Linyuan Jia , Zheng Peng

We develop a Distributionally Robust Optimization (DRO) formulation for Multiclass Logistic Regression (MLR), which could tolerate data contaminated by outliers. The DRO framework uses a probabilistic ambiguity set defined as a ball of…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Ruidi Chen , Boran Hao , Ioannis Ch. Paschalidis

We develop a Distributionally Robust Optimization (DRO) formulation for Multiclass Logistic Regression (MLR), which could tolerate data contaminated by outliers. The DRO framework uses a probabilistic ambiguity set defined as a ball of…

机器学习 · 统计学 2023-03-28 Ruidi Chen , Boran Hao , Ioannis Paschalidis

In this paper, we consider a network capacity expansion problem in the context of telecommunication networks, where there is uncertainty associated with the expected traffic demand. We employ a distributionally robust stochastic…

最优化与控制 · 数学 2020-04-10 Trivikram Dokka , Francis Garuba , Marc Goerigk , Peter Jacko

Reinforcement learning (RL) policies often fail under dynamics that differ from training, a gap not fully addressed by domain randomization or existing adversarial RL methods. Distributionally robust RL provides a formal remedy but still…

机器学习 · 计算机科学 2026-04-16 Mintae Kim , Koushil Sreenath

The primal-dual distributed optimization methods have broad large-scale machine learning applications. Previous primal-dual distributed methods are not applicable when the dual formulation is not available, e.g. the sum-of-non-convex…

机器学习 · 计算机科学 2017-10-30 Zhouyuan Huo , Heng Huang