English
Related papers

Related papers: Differentially Private Non-convex Distributionally…

200 papers

In this paper, we investigate one of the most fundamental nonconvex learning problems, ReLU regression, in the Differential Privacy (DP) model. Previous studies on private ReLU regression heavily rely on stringent assumptions, such as…

Machine Learning · Computer Science 2025-06-11 Meng Ding , Mingxi Lei , Shaowei Wang , Tianhang Zheng , Di Wang , Jinhui Xu

In this paper, we investigate the empirical counterpart of Group Distributionally Robust Optimization (GDRO), which aims to minimize the maximal empirical risk across $m$ distinct groups. We formulate empirical GDRO as a…

Machine Learning · Computer Science 2024-09-23 Dingzhi Yu , Yunuo Cai , Wei Jiang , Lijun Zhang

Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO), as the widely employed policy based reinforcement learning (RL) methods, are prone to converge to a sub-optimal solution as they limit the policy representation…

Machine Learning · Computer Science 2020-06-16 Jun Song , Chaoyue Zhao

This paper investigates group distributionally robust optimization (GDRO) with the goal of learning a model that performs well over $m$ different distributions. First, we formulate GDRO as a stochastic convex-concave saddle-point problem,…

Machine Learning · Computer Science 2024-11-21 Lijun Zhang , Haomin Bai , Peng Zhao , Tianbao Yang , Zhi-Hua Zhou

We consider the problem of offline reinforcement learning with model-based control, whose goal is to learn a dynamics model from the experience replay and obtain a pessimism-oriented agent under the learned model. Current model-based…

Machine Learning · Computer Science 2021-09-16 Ruizhen Liu , Dazhi Zhong , Zhicong Chen

We propose a mathematically principled PDE gradient flow framework for distributionally robust optimization (DRO). Exploiting the recent advances in the intersection of Markov Chain Monte Carlo sampling and gradient flow theory, we show…

Optimization and Control · Mathematics 2026-05-27 Zusen Xu , Jia-Jie Zhu

It is common practice to use data containing personal information to build predictive models in the framework of empirical risk minimization (ERM). While these models can be highly accurate in prediction, sharing the results from these…

Machine Learning · Statistics 2024-09-30 Spencer Giddens , Yiwang Zhou , Kevin R. Krull , Tara M. Brinkman , Peter X. K. Song , Fang Liu

There are numerous industrial settings in which a decision maker must decide whether to enter into long-term contracts to guarantee price (and hence cash flow) stability or to participate in more volatile spot markets. In this paper, we…

Optimization and Control · Mathematics 2025-01-28 Dimitri J. Papageorgiou

While traditional distributionally robust optimization (DRO) aims to minimize the maximal risk over a set of distributions, Agarwal and Zhang (2022) recently proposed a variant that replaces risk with excess risk. Compared to DRO, the new…

Optimization and Control · Mathematics 2024-05-29 Lijun Zhang , Haomin Bai , Wei-Wei Tu , Ping Yang , Yao Hu

We propose kernel distributionally robust optimization (Kernel DRO) using insights from the robust optimization theory and functional analysis. Our method uses reproducing kernel Hilbert spaces (RKHS) to construct a wide range of convex…

Optimization and Control · Mathematics 2021-06-28 Jia-Jie Zhu , Wittawat Jitkrittum , Moritz Diehl , Bernhard Schölkopf

Off-policy evaluation and learning (OPE/L) use offline observational data to make better decisions, which is crucial in applications where online experimentation is limited. However, depending entirely on logged data, OPE/L is sensitive to…

Machine Learning · Computer Science 2022-07-19 Nathan Kallus , Xiaojie Mao , Kaiwen Wang , Zhengyuan Zhou

We investigate a stochastic program with expected value constraints, addressing the problem in a general context through Distributionally Robust Optimization (DRO) approach using Wasserstein distances, where the ambiguity set depends on the…

Optimization and Control · Mathematics 2023-04-18 Diego Fonseca , Mauricio Junca

Differential privacy (DP) techniques can be applied to the federated learning model to statistically guarantee data privacy against inference attacks to communication among the learning agents. While ensuring strong data privacy, however,…

Machine Learning · Computer Science 2022-02-22 Minseok Ryu , Kibaek Kim

The study of robustness has received much attention due to its inevitability in data-driven settings where many systems face uncertainty. One such example of concern is Bayesian Optimization (BO), where uncertainty is multi-faceted, yet…

Machine Learning · Computer Science 2023-10-31 Hisham Husain , Vu Nguyen , Anton van den Hengel

We present a computationally efficient framework, called $\texttt{FlowDRO}$, for solving flow-based distributionally robust optimization (DRO) problems with Wasserstein uncertainty sets while aiming to find continuous worst-case…

Machine Learning · Computer Science 2024-02-27 Chen Xu , Jonghyeok Lee , Xiuyuan Cheng , Yao Xie

Topology design is a critical task for the reliability, economic operation, and resilience of distribution systems. This paper proposes a distributionally robust optimization (DRO) model for designing the topology of a new distribution…

Optimization and Control · Mathematics 2018-08-29 Sadra Babaei , Ruiwei Jiang , Chaoyue Zhao

We study the distributionally robust optimization (DRO) in a dynamic context where the model uncertainty is captured by penalizing potential models in function of their adapted Wasserstein distance to a given reference model. We consider…

Probability · Mathematics 2025-09-30 Yifan Jiang

Deep learning using large models have achieved great success in a wide range of domains. However, training these models on billions of parameters is very challenging in terms of the training speed, memory cost, and communication efficiency,…

Machine Learning · Computer Science 2023-11-21 Zhiqi Bu , Justin Chiu , Ruixuan Liu , Sheng Zha , George Karypis

Training with differential privacy (DP) provides a guarantee to members in a dataset that they cannot be identified by users of the released model. However, those data providers, and, in general, the public, lack methods to efficiently…

Machine Learning · Computer Science 2025-12-04 Zoë Ruha Bell , Anvith Thudi , Olive Franzese-McLaughlin , Nicolas Papernot , Shafi Goldwasser

Distributionally robust optimization (DRO) is an effective approach for data-driven decision-making in the presence of uncertainty. Geometric uncertainty due to sampling or localized perturbations of data points is captured by Wasserstein…

Machine Learning · Statistics 2023-11-10 Sloan Nietert , Ziv Goldfeld , Soroosh Shafiee