中文
相关论文

相关论文: Out-of-distribution Robust Optimization

200 篇论文

Most classification and segmentation datasets assume a closed-world scenario in which predictions are expressed as distribution over a predetermined set of visual classes. However, such assumption implies unavoidable and often unnoticeable…

计算机视觉与模式识别 · 计算机科学 2018-10-02 Petra Bevandić , Ivan Krešo , Marin Oršić , Siniša Šegvić

We present an approach that can be utilized in order to account for the covariate shift between two datasets of the same observable with different distributions. This helps improve the generalizability of a neural network model trained on…

天体物理仪器与方法 · 物理学 2025-02-12 Sambatra Andrianomena , Sultan Hassan

Stochastic and (distributionally) robust optimization problems often become computationally challenging as the number of scenarios or data points increases. Scenario reduction is therefore a key technique for improving tractability. We…

最优化与控制 · 数学 2026-03-10 Kevin-Martin Aigner , Sebastian Denzler , Frauke Liers , Sebastian Pokutta , Kartikey Sharma

It is essential for safety-critical applications of deep neural networks to determine when new inputs are significantly different from the training distribution. In this paper, we explore this out-of-distribution (OOD) detection problem for…

计算机视觉与模式识别 · 计算机科学 2022-03-17 Poulami Sinhamahapatra , Rajat Koner , Karsten Roscher , Stephan Günnemann

Distributionally robust optimization tackles out-of-sample issues like overfitting and distribution shifts by adopting an adversarial approach over a range of possible data distributions, known as the ambiguity set. To balance conservatism…

机器学习 · 计算机科学 2025-10-02 Ahmad-Reza Ehyaei , Golnoosh Farnadi , Samira Samadi

Specifying a proper input distribution is often a challenging task in simulation modeling. In practice, there may be multiple plausible distributions that can fit the input data reasonably well, especially when the data volume is not large.…

统计方法学 · 统计学 2019-03-15 Weiwei Fan , L. Jeff Hong , Xiaowei Zhang

This paper studies Distributionally Robust Optimization (DRO), a fundamental framework for enhancing the robustness and generalization of statistical learning and optimization. An effective ambiguity set for DRO must involve distributions…

机器学习 · 计算机科学 2025-10-28 Jiaqi Wen , Jianyi Yang

Statistical learning under distribution shift is challenging when neither prior knowledge nor fully accessible data from the target distribution is available. Distributionally robust learning (DRL) aims to control the worst-case statistical…

统计方法学 · 统计学 2024-12-19 Yu Gui , Rina Foygel Barber , Cong Ma

The goal of an offline reinforcement learning (RL) algorithm is to learn optimal polices using historical (offline) data, without access to the environment for online exploration. One of the main challenges in offline RL is the distribution…

机器学习 · 计算机科学 2023-10-31 Kishan Panaganti , Zaiyan Xu , Dileep Kalathil , Mohammad Ghavamzadeh

Out-of-distribution (OOD) generalization remains a fundamental challenge in real-world classification, where test distributions often differ substantially from training data. Most existing approaches pursue domain-invariant representations,…

机器学习 · 计算机科学 2026-01-30 Chen Cheng , Ang Li

We introduce a fine-grained framework for uncertainty quantification of predictive models under distributional shifts. This framework distinguishes the shift in covariate distributions from that in the conditional relationship between the…

统计方法学 · 统计学 2025-05-20 Jiahao Ai , Zhimei Ren

Due to the significant process variations, designers have to optimize the statistical performance distribution of nano-scale IC design in most cases. This problem has been investigated for decades under the formulation of stochastic…

计算工程、金融与科学 · 计算机科学 2023-08-17 Yifan Pan , Zichang He , Nanlin Guo , Zheng Zhang

Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample.…

机器学习 · 计算机科学 2021-06-16 Jaemoo Choi , Changyeon Yoon , Jeongwoo Bae , Myungjoo Kang

We consider stochastic programs conditional on some covariate information, where the only knowledge of the possible relationship between the uncertain parameters and the covariates is reduced to a finite data sample of their joint…

最优化与控制 · 数学 2021-11-23 Adrián Esteban-Pérez , Juan M. Morales

In recent years, there have been significant improvements in various forms of image outlier detection. However, outlier detection performance under adversarial settings lags far behind that in standard settings. This is due to the lack of…

Our goal is to build robust optimization problems for making decisions based on complex data from the past. In robust optimization (RO) generally, the goal is to create a policy for decision-making that is robust to our uncertainty about…

最优化与控制 · 数学 2014-07-07 Theja Tulabandhula , Cynthia Rudin

Out-of-distribution (OOD) data poses serious challenges in deployed machine learning models, so methods of predicting a model's performance on OOD data without labels are important for machine learning safety. While a number of methods have…

We consider a distributionally robust stochastic optimization problem and formulate it as a stochastic two-level composition optimization problem with the use of the mean--semideviation risk measure. In this setting, we consider a single…

最优化与控制 · 数学 2023-06-12 Landi Zhu , Mert Gürbüzbalaban , Andrzej Ruszczyński

Recent advances in neural information retrieval (IR) models have significantly enhanced their effectiveness over various IR tasks. The robustness of these models, essential for ensuring their reliability in practice, has also garnered…

信息检索 · 计算机科学 2024-08-19 Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Yixing Fan , Xueqi Cheng

Many existing approaches for estimating parameters in settings with distributional shifts operate under an invariance assumption. For example, under covariate shift, it is assumed that $p(y|x)$ remains invariant. We refer to such…

统计方法学 · 统计学 2025-02-07 Yujin Jeong , Dominik Rothenhäusler