中文
相关论文

相关论文: Risk Variance Penalization

200 篇论文

The recent achievements of Deep Learning rely on the test data being similar in distribution to the training data. In an ideal case, Deep Learning models would achieve Out-of-Distribution (OoD) Generalization, i.e. reliably make predictions…

图像与视频处理 · 电气工程与系统科学 2021-09-07 Antoine Sanner , Camila Gonzalez , Anirban Mukhopadhyay

The mismatch between training and target data is one major challenge for current machine learning systems. When training data is collected from multiple domains and the target domains include all training domains and other new domains, we…

机器学习 · 计算机科学 2021-01-22 Haotian Ye , Chuanlong Xie , Yue Liu , Zhenguo Li

A critical flaw of existing inverse reinforcement learning (IRL) methods is their inability to significantly outperform the demonstrator. This is because IRL typically seeks a reward function that makes the demonstrator appear near-optimal,…

机器学习 · 计算机科学 2019-07-10 Daniel S. Brown , Wonjoon Goo , Prabhat Nagarajan , Scott Niekum

It is crucial to detect when an instance lies downright too far from the training samples for the machine learning model to be trusted, a challenge known as out-of-distribution (OOD) detection. For neural networks, one approach to this task…

Prediction models often fail if train and test data do not stem from the same distribution. Out-of-distribution (OOD) generalization to unseen, perturbed test data is a desirable but difficult-to-achieve property for prediction models and…

统计方法学 · 统计学 2022-05-25 Lucas Kook , Beate Sick , Peter Bühlmann

Invariant Causal Prediction (Peters et al., 2016) is a technique for out-of-distribution generalization which assumes that some aspects of the data distribution vary across the training set but that the underlying causal mechanisms remain…

机器学习 · 计算机科学 2021-03-30 Elan Rosenfeld , Pradeep Ravikumar , Andrej Risteski

Robustness to out-of-distribution (OOD) data is an important goal in building reliable machine learning systems. Especially in autonomous systems, wrong predictions for OOD inputs can cause safety critical situations. As a first step…

机器学习 · 计算机科学 2020-04-17 Andreas Sedlmeier , Thomas Gabor , Thomy Phan , Lenz Belzner , Claudia Linnhoff-Popien

The performance of Offline reinforcement learning is significantly impacted by the issue of state distributional shift, and out-of-distribution (OOD) state correction is a popular approach to address this problem. In this paper, we propose…

机器学习 · 计算机科学 2025-07-09 Ke Jiang , Wen Jiang , Xiaoyang Tan

Out-of-distribution detection is one of the most critical issue in the deployment of machine learning. The data analyst must assure that data in operation should be compliant with the training phase as well as understand if the environment…

人工智能 · 计算机科学 2023-08-22 Giacomo De Bernardi , Sara Narteni , Enrico Cambiaso , Maurizio Mongelli

The class of Affine (Jump) Diffusion (AD) has, due to its closed form characteristic function (ChF), gained tremendous popularity among practitioners and researchers. However, there is clear evidence that a linearity constraint is…

计算金融 · 定量金融 2022-08-29 Lech A. Grzelak

Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the…

An issue concerning the use of deep reinforcement learning (RL) agents is whether they can be trusted to perform reliably when deployed, as training environments may not reflect real-life environments. Anticipating instances outside their…

机器学习 · 计算机科学 2025-03-10 Mohit Prashant , Arvind Easwaran , Suman Das , Michael Yuhas

Out-of-distribution (OoD) detection is a natural downstream task for deep generative models, due to their ability to learn the input probability distribution. There are mainly two classes of approaches for OoD detection using deep…

机器学习 · 计算机科学 2019-07-11 Yujia Huang , Sihui Dai , Tan Nguyen , Richard G. Baraniuk , Anima Anandkumar

Domain generalization aims to solve the challenge of Out-of-Distribution (OOD) generalization by leveraging common knowledge learned from multiple training domains to generalize to unseen test domains. To accurately evaluate the OOD…

机器学习 · 计算机科学 2024-03-26 Han Yu , Xingxuan Zhang , Renzhe Xu , Jiashuo Liu , Yue He , Peng Cui

Deep probabilistic generative models enable modeling the likelihoods of very high dimensional data. An important application of generative modeling should be the ability to detect out-of-distribution (OOD) samples by setting a threshold on…

机器学习 · 计算机科学 2020-10-13 Zhisheng Xiao , Qing Yan , Yali Amit

Traditional machine learning paradigms are based on the assumption that both training and test data follow the same statistical pattern, which is mathematically referred to as Independent and Identically Distributed ($i.i.d.$). However, in…

机器学习 · 计算机科学 2023-07-28 Jiashuo Liu , Zheyan Shen , Yue He , Xingxuan Zhang , Renzhe Xu , Han Yu , Peng Cui

Out-of-distribution (OOD) generalization is a challenging machine learning problem yet highly desirable in many high-stake applications. Existing methods suffer from overly pessimistic modeling with low generalization confidence. As…

机器学习 · 计算机科学 2024-06-10 Fengchun Qiao , Xi Peng

We propose a novel approach for domain generalisation (DG) leveraging risk distributions to characterise domains, thereby achieving domain invariance. In our findings, risk distributions effectively highlight differences between training…

机器学习 · 计算机科学 2023-10-31 Toan Nguyen , Kien Do , Bao Duong , Thin Nguyen

In this work, we study out-of-distribution (OOD) generalization in meta-reinforcement learning from an information-theoretic perspective. We begin by establishing OOD generalization bounds for meta-supervised learning under two distinct…

机器学习 · 计算机科学 2026-04-07 Xingtu Liu

Out-of-distribution (OOD) detection is important for deploying reliable machine learning models on real-world applications. Recent advances in outlier exposure have shown promising results on OOD detection via fine-tuning model with…

机器学习 · 计算机科学 2023-10-27 Jianing Zhu , Geng Yu , Jiangchao Yao , Tongliang Liu , Gang Niu , Masashi Sugiyama , Bo Han