中文
相关论文

相关论文: Distributionally Robust Groupwise Regularization E…

200 篇论文

We propose an approach for fitting linear regression models that splits the set of covariates into groups. The optimal split of the variables into groups and the regularized estimation of the regression coefficients are performed by…

统计方法学 · 统计学 2019-12-13 Anthony Christidis , Ruben Zamar , Laks V. S. Lakshmanan , Ezequiel Smucler

Model explainability is crucial for human users to be able to interpret how a proposed classifier assigns labels to data based on its feature values. We study generalized linear models constructed using sets of feature value rules, which…

机器学习 · 统计学 2023-11-06 Sanjeeb Dash , Soumyadip Ghosh , Joao Goncalves , Mark S. Squillante

We consider optimal decision-making problems in an uncertain environment. In particular, we consider the case in which the distribution of the input is unknown, yet there is abundant historical data drawn from the distribution. In this…

最优化与控制 · 数学 2014-10-03 Zizhuo Wang , Peter Glynn , Yinyu Ye

We show that several machine learning estimators, including square-root LASSO (Least Absolute Shrinkage and Selection) and regularized logistic regression can be represented as solutions to distributionally robust optimization (DRO)…

统计理论 · 数学 2020-10-22 Jose Blanchet , Yang Kang , Karthyek Murthy

Distributionally Robust Optimization (DRO) has been shown to provide a flexible framework for decision making under uncertainty and statistical estimation. For example, recent works in DRO have shown that popular statistical estimators can…

机器学习 · 统计学 2020-04-21 Jose Blanchet , Yang Kang , Fan Zhang , Zhangyi Hu

We consider the problem of distributionally robust multimodal machine learning. Existing approaches often rely on merging modalities on the feature level (early fusion) or heuristic uncertainty modeling, which downplays modality-aware…

机器学习 · 计算机科学 2025-11-11 Peilin Yang , Yu Ma

Distributionally robust optimization (DRO) is a widely-used approach to learn models that are robust against distribution shift. Compared with the standard optimization setting, the objective function in DRO is more difficult to optimize,…

机器学习 · 计算机科学 2021-10-27 Jikai Jin , Bohang Zhang , Haiyang Wang , Liwei Wang

Recently, there has been a growing interest in distributionally robust optimization (DRO) as a principled approach to data-driven decision making. In this paper, we consider a distributionally robust two-stage stochastic optimization…

最优化与控制 · 数学 2020-12-07 Zhe Zhang , Shabbir Ahmed , Guanghui Lan

Distributionally robust optimization (DRO) has shown lot of promise in providing robustness in learning as well as sample based optimization problems. We endeavor to provide DRO solutions for a class of sum of fractionals, non-convex…

机器学习 · 计算机科学 2022-06-01 Avinandan Bose , Arunesh Sinha , Tien Mai

Many machine learning tasks involve subpopulation shift where the testing data distribution is a subpopulation of the training distribution. For such settings, a line of recent work has proposed the use of a variant of empirical risk…

机器学习 · 计算机科学 2021-06-14 Runtian Zhai , Chen Dan , J. Zico Kolter , Pradeep Ravikumar

Reinforcement learning (RL) has proven remarkably effective at improving the accuracy of language models in verifiable and deterministic domains like mathematics. Here, we examine if current RL methods are also effective at optimizing…

机器学习 · 计算机科学 2025-08-19 Michael Bereket , Jure Leskovec

Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO), as the widely employed policy based reinforcement learning (RL) methods, are prone to converge to a sub-optimal solution as they limit the policy representation…

机器学习 · 计算机科学 2020-06-16 Jun Song , Chaoyue Zhao

High-dimensional predictive models, those with more measurements than observations, require regularization to be well defined, perform well empirically, and possess theoretical guarantees. The amount of regularization, often determined by…

统计方法学 · 统计学 2019-07-16 Darren Homrighausen , Daniel J. McDonald

We study a robust alternative to empirical risk minimization called distributionally robust learning (DRL), in which one learns to perform against an adversary who can choose the data distribution from a specified set of distributions. We…

机器学习 · 计算机科学 2019-12-19 Charlie Frogner , Sebastian Claici , Edward Chien , Justin Solomon

Robustness to adversarial attacks is an important concern due to the fragility of deep neural networks to small perturbations and has received an abundance of attention in recent years. Distributionally Robust Optimization (DRO), a…

机器学习 · 统计学 2020-06-09 Hisham Husain

Data-driven distributionally robust optimization is a recently emerging paradigm aimed at finding a solution that is driven by sample data but is protected against sampling errors. An increasingly popular approach, known as Wasserstein…

最优化与控制 · 数学 2022-07-20 Jonathan Yu-Meng Li , Tiantian Mao

Limiting failures of machine learning systems is of paramount importance for safety-critical applications. In order to improve the robustness of machine learning systems, Distributionally Robust Optimization (DRO) has been proposed as a…

Wasserstein distributionally robust optimization (DRO) has gained prominence in operations research and machine learning as a powerful method for achieving solutions with favorable out-of-sample performance. Two compelling explanations for…

机器学习 · 计算机科学 2024-12-23 Qinyu Wu , Jonathan Yu-Meng Li , Tiantian Mao

We consider stochastic programs conditional on some covariate information, where the only knowledge of the possible relationship between the uncertain parameters and the covariates is reduced to a finite data sample of their joint…

最优化与控制 · 数学 2021-11-23 Adrián Esteban-Pérez , Juan M. Morales

Statistical learning under distribution shift is challenging when neither prior knowledge nor fully accessible data from the target distribution is available. Distributionally robust learning (DRL) aims to control the worst-case statistical…

统计方法学 · 统计学 2024-12-19 Yu Gui , Rina Foygel Barber , Cong Ma