中文
相关论文

相关论文: Out-of-distribution Robust Optimization

200 篇论文

We propose a regularisation strategy of classical machine learning algorithms rooted in causality that ensures robustness against distribution shifts. Building upon the anchor regression framework, we demonstrate how incorporating a…

机器学习 · 统计学 2025-03-12 Homer Durand , Gherardo Varando , Nathan Mankovich , Gustau Camps-Valls

We present a new loss function that addresses the out-of-distribution (OOD) calibration problem. While many objective functions have been proposed to effectively calibrate models in-distribution, our findings show that they do not always…

机器学习 · 计算机科学 2024-03-12 Dexter Neo , Stefan Winkler , Tsuhan Chen

The Invariant Risk Minimization (IRM) framework aims to learn invariant features from a set of environments for solving the out-of-distribution (OOD) generalization problem. The underlying assumption is that the causal components of the…

机器学习 · 计算机科学 2021-12-28 Moulik Choraria , Ibtihal Ferwana , Ankur Mani , Lav R. Varshney

Machine learning systems often experience a distribution shift between training and testing. In this paper, we introduce a simple variational objective whose optima are exactly the set of all representations on which risk minimizers are…

机器学习 · 计算机科学 2022-03-16 Yangjun Ruan , Yann Dubois , Chris J. Maddison

Distributionally robust optimization (DRO) studies decision problems under uncertainty where the probability distribution governing the uncertain problem parameters is itself uncertain. A key component of any DRO model is its ambiguity set,…

最优化与控制 · 数学 2025-05-28 Daniel Kuhn , Soroosh Shafiee , Wolfram Wiesemann

Offline Reinforcement Learning (RL) offers an attractive alternative to interactive data acquisition by leveraging pre-existing datasets. However, its effectiveness hinges on the quantity and quality of the data samples. This work explores…

机器学习 · 计算机科学 2024-10-17 Wen Zheng Terence Ng , Jianda Chen , Tianwei Zhang

The field of Contextual Optimization (CO) integrates machine learning and optimization to solve decision making problems under uncertainty. Recently, a risk sensitive variant of CO, known as Conditional Robust Optimization (CRO), combines…

机器学习 · 计算机科学 2024-03-08 Abhilash Chenreddy , Erick Delage

Distributionally robust optimization is used to tackle decision making problems under uncertainty where the distribution of the uncertain data is ambiguous. Many ambiguity sets have been proposed for continuous uncertainty that build on…

最优化与控制 · 数学 2025-05-28 Karthik Natarajan , Divya Padmanabhan , Arjun Ramachandra

Efficient resource allocation and scheduling algorithms are essential for various distributed applications, ranging from wireless networks and cloud computing platforms to autonomous multi-agent systems and swarm robotic networks. However,…

系统与控制 · 电气工程与系统科学 2023-12-01 Mohammadreza Doostmohammadian , Alireza Aghasi

The concepts of risk-aversion, chance-constrained optimization, and robust optimization have developed significantly over the last decade. Statistical learning community has also witnessed a rapid theoretical and applied growth by relying…

最优化与控制 · 数学 2022-10-25 Hamed Rahimian , Sanjay Mehrotra

In the current work we introduce a novel estimation of distribution algorithm to tackle a hard combinatorial optimization problem, namely the single-machine scheduling problem, with uncertain delivery times. The majority of the existing…

数据结构与算法 · 计算机科学 2013-12-05 Boris Mitavskiy , Jun He

Many real-world domains require safe decision making in uncertain environments. In this work, we introduce a deep reinforcement learning framework for approaching this important problem. We consider a distribution over transition models,…

机器学习 · 计算机科学 2023-10-27 James Queeney , Mouhacine Benosman

The primary goal of out-of-distribution (OOD) detection tasks is to identify inputs with semantic shifts, i.e., if samples from novel classes are absent in the in-distribution (ID) dataset used for training, we should reject these OOD…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Xingming Long , Jie Zhang , Shiguang Shan , Xilin Chen

Denoising diffusion models have emerged as the go-to generative framework for solving inverse problems in imaging. A critical concern regarding these models is their performance on out-of-distribution tasks, which remains an under-explored…

计算机视觉与模式识别 · 计算机科学 2025-01-29 Riccardo Barbano , Alexander Denker , Hyungjin Chung , Tae Hoon Roh , Simon Arridge , Peter Maass , Bangti Jin , Jong Chul Ye

Covariate-shift generalization, a typical case in out-of-distribution (OOD) generalization, requires a good performance on the unknown test distribution, which varies from the accessible training distribution in the form of covariate shift.…

机器学习 · 计算机科学 2023-10-18 Renzhe Xu , Xingxuan Zhang , Zheyan Shen , Tong Zhang , Peng Cui

Empirical risk minimization often performs poorly when the distribution of the target domain differs from those of source domains. To address such potential distribution shifts, we develop an unsupervised domain adaptation approach that…

机器学习 · 统计学 2025-03-25 Zhenyu Wang , Peter Bühlmann , Zijian Guo

Recently, we have witnessed generative retrieval increasingly gaining attention in the information retrieval (IR) field, which retrieves documents by directly generating their identifiers. So far, much effort has been devoted to developing…

信息检索 · 计算机科学 2023-06-23 Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Wei Chen , Xueqi Cheng

The paper algorithmizes the problem of regime change point identification for data measured in a system exhibiting impulsive behaviors. This is a fundamental challenge for annotation of measurement data relevant, e.g., for designing…

Reinforcement learning (RL) policies often fail under dynamics that differ from training, a gap not fully addressed by domain randomization or existing adversarial RL methods. Distributionally robust RL provides a formal remedy but still…

机器学习 · 计算机科学 2026-04-16 Mintae Kim , Koushil Sreenath

Cooperative geolocation has attracted significant research interests in recent years. A large number of localization algorithms rely on the availability of statistical knowledge of measurement errors, which is often difficult to obtain in…

应用统计 · 统计学 2017-01-05 Xiufang Shi , Guoqiang Mao , Brian. D. O. Anderson , Zaiyue Yang , Jiming Chen