中文
相关论文

相关论文: ALSO-X#: Better Convex Approximations for Distribu…

200 篇论文

Safe reinforcement learning (RL) aims to learn policies that satisfy certain constraints before deploying them to safety-critical applications. Previous primal-dual style approaches suffer from instability issues and lack optimality…

机器学习 · 计算机科学 2022-06-20 Zuxin Liu , Zhepeng Cen , Vladislav Isenbaev , Wei Liu , Zhiwei Steven Wu , Bo Li , Ding Zhao

While traditional Deep Learning (DL) optimization methods treat all training samples equally, Distributionally Robust Optimization (DRO) adaptively assigns importance weights to different samples. However, a significant gap exists between…

Chance-constrained problems involve stochastic components in the constraints which can be violated with a small probability. We investigate the impact of different types of chance constraints on the performance of iterative search…

神经与进化计算 · 计算机科学 2024-05-30 Saba Sadeghi Ahouei , Jacob de Nobel , Aneta Neumann , Thomas Bäck , Frank Neumann

We present CCO-VOXEL: the very first chance-constrained optimization (CCO) algorithm that can compute trajectory plans with probabilistic safety guarantees in real-time directly on the voxel-grid representation of the world. CCO-VOXEL maps…

机器人学 · 计算机科学 2022-04-06 Sudarshan S Harithas , Rishabh Dev Yadav , Deepak Singh , Arun Kumar Singh , K Madhava Krishna

We study distributed optimization algorithms for minimizing the average of convex functions. The applications include empirical risk minimization problems in statistical machine learning where the datasets are large and have to be stored on…

最优化与控制 · 数学 2016-01-07 Jason D. Lee , Qihang Lin , Tengyu Ma , Tianbao Yang

This paper addresses risk averse constrained optimization problems where the objective and constraint functions can only be computed by a blackbox subject to unknown uncertainties. To handle mixed aleatory/epistemic uncertainties, the…

最优化与控制 · 数学 2023-10-18 Charles Audet , Jean Bigeon , Romain Couderc , Michael Kokkolaras

Distributionally robust optimization (DRO) is a widely-used approach to learn models that are robust against distribution shift. Compared with the standard optimization setting, the objective function in DRO is more difficult to optimize,…

机器学习 · 计算机科学 2021-10-27 Jikai Jin , Bohang Zhang , Haiyang Wang , Liwei Wang

Distributionally Robust Optimization (DRO), as a popular method to train robust models against distribution shift between training and test sets, has received tremendous attention in recent years. In this paper, we propose and analyze…

机器学习 · 计算机科学 2023-08-17 Qi Qi , Jiameng Lyu , Kung sik Chan , Er Wei Bai , Tianbao Yang

A novel and fully distributed optimization method is proposed for the distributed robust convex program (DRCP) over a time-varying unbalanced directed network under the uniformly jointly strongly connected (UJSC) assumption. Firstly, an…

最优化与控制 · 数学 2025-10-29 Jun Fu , Xunhao Wu

This paper studies consensus-based decentralized stochastic optimization for minimizing possibly non-convex expected objectives with convex non-smooth regularizers and nonlinear functional inequality constraints. We reformulate the…

最优化与控制 · 数学 2026-01-29 Shivangi Dubey Sharma , Basil M. Idrees , Lavish Arora , Ketan Rajawat

We consider a minimax problem motivated by distributionally robust optimization (DRO) when the worst-case distribution is continuous, leading to significant computational challenges due to the infinite-dimensional nature of the optimization…

机器学习 · 统计学 2024-12-31 Linglingzhi Zhu , Yao Xie

In this paper we wish to tackle stochastic programs affected by ambiguity about the probability law that governs their uncertain parameters. Using optimal transport theory, we construct an ambiguity set that exploits the knowledge about the…

最优化与控制 · 数学 2021-06-15 Adrián Esteban-Pérez , Juan M. Morales

We propose a novel stochastic approximation algorithm, termed PMQSopt, for solving weakly convex stochastic optimization problems involving expectation-valued functions. The algorithm is constructed by integrating the proximal method of…

最优化与控制 · 数学 2026-05-06 Yule Zhang , Benqi Liu , Xiantao Xiao , Liwei Zhang

A method is developed to numerically solve chance constrained optimal control problems. The chance constraints are reformulated as nonlinear constraints that retain the probability properties of the original constraint. The reformulation…

最优化与控制 · 数学 2020-05-29 Rachel E. Keil , Alexander T. Miller , Mrinal Kumar , Anil V. Rao

We consider chance-constrained binary knapsack problems, where the weights of items are independent random variables with the means and standard deviations known. The chance constraint can be reformulated as a second-order cone constraint…

最优化与控制 · 数学 2021-05-26 Jaehyeon Ryu , Sungsoo Park

Inspired by recent advances in distributed algorithms for approximating Wasserstein barycenters, we propose a novel distributed algorithm for this problem. The main novelty is that we consider time-varying computational networks, which are…

最优化与控制 · 数学 2023-07-26 Olga Yufereva , Michael Persiianov , Pavel Dvurechensky , Alexander Gasnikov , Dmitry Kovalev

We study stochastic decentralized optimization for the problem of training machine learning models with large-scale distributed data. We extend the widely used EXTRA and DIGing methods with variance reduction (VR), and propose two methods:…

最优化与控制 · 数学 2022-08-30 Huan Li , Zhouchen Lin , Yongchun Fang

This paper considers a distributed convex optimization problem over a time-varying multi-agent network, where each agent has its own decision variables that should be set so as to minimize its individual objective subject to local…

最优化与控制 · 数学 2018-05-22 Chuanye Gu , Zhiyou Wu , Jueyou Li , Yaning Guo

Preference-based alignment methods (e.g., RLHF, DPO) typically optimize a single scalar objective, implicitly averaging over heterogeneous human preferences. In practice, systematic annotator and user-group disagreement makes mean-reward…

机器学习 · 计算机科学 2026-05-19 Mingxi Zou , Jiaxiang Chen , Junfan Li , Langzhang Liang , Qifan Wang , Xu Yinghui , Zenglin Xu

This paper proposes a robust approximation method for solving chance constrained optimization (CCO) of polynomials. Assume the CCO is defined with an individual chance constraint that is affine in the decision variables. We construct a…

最优化与控制 · 数学 2024-08-27 Bo Rao , Liu Yang , Suhan Zhong , Guangming Zhou