中文
相关论文

相关论文: Towards out of distribution generalization for pro…

200 篇论文

Generalization to out-of-distribution (OOD) data is a capability natural to humans yet challenging for machines to reproduce. This is because most learning algorithms strongly rely on the i.i.d.~assumption on source/target data, which is…

机器学习 · 计算机科学 2022-08-15 Kaiyang Zhou , Ziwei Liu , Yu Qiao , Tao Xiang , Chen Change Loy

In the field of Machine Learning (ML) and data-driven applications, one of the significant challenge is the change in data distribution between the training and deployment stages, commonly known as distribution shift. This paper outlines…

机器学习 · 计算机科学 2025-07-30 Lakpa Tamang , Mohamed Reda Bouadjenek , Richard Dazeley , Sunil Aryal

In this work, we study out-of-distribution (OOD) generalization in meta-reinforcement learning from an information-theoretic perspective. We begin by establishing OOD generalization bounds for meta-supervised learning under two distinct…

机器学习 · 计算机科学 2026-04-07 Xingtu Liu

Data-driven machine learning (ML) is promoted as one potential technology to be used in next-generations wireless systems. This led to a large body of research work that applies ML techniques to solve problems in different layers of the…

机器学习 · 计算机科学 2023-03-15 Mohamed Akrout , Amal Feriani , Faouzi Bellili , Amine Mezghani , Ekram Hossain

Detecting out-of-distribution (OOD) data is a fundamental challenge in the deployment of machine learning models. From a security standpoint, this is particularly important because OOD test data can result in misleadingly confident yet…

机器学习 · 计算机科学 2025-02-25 Onat Gungor , Amanda Sofie Rios , Nilesh Ahuja , Tajana Rosing

With the goal of generalizing to out-of-distribution (OOD) data, recent domain generalization methods aim to learn "stable" feature representations whose effect on the output remains invariant across domains. Given the theoretical…

机器学习 · 计算机科学 2021-10-08 Divyat Mahajan , Shruti Tople , Amit Sharma

We study the Out-of-Distribution (OOD) generalization in machine learning and propose a general framework that establishes information-theoretic generalization bounds. Our framework interpolates freely between Integral Probability Metric…

信息论 · 计算机科学 2024-12-16 Wenliang Liu , Guanding Yu , Lele Wang , Renjie Liao

Out-of-distribution (OOD) detection is vital to safety-critical machine learning applications and has thus been extensively studied, with a plethora of methods developed in the literature. However, the field currently lacks a unified,…

Detecting and rejecting unknown out-of-distribution (OOD) samples is critical for deployed neural networks to void unreliable predictions. In real-world scenarios, however, the efficacy of existing OOD detection methods is often impeded by…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Kai Liu , Zhihang Fu , Sheng Jin , Chao Chen , Ze Chen , Rongxin Jiang , Fan Zhou , Yaowu Chen , Jieping Ye

In real-world applications, it is important and desirable to learn a model that performs well on out-of-distribution (OOD) data. Recently, causality has become a powerful tool to tackle the OOD generalization problem, with the idea resting…

机器学习 · 统计学 2022-03-25 Ruoyu Wang , Mingyang Yi , Zhitang Chen , Shengyu Zhu

Deep network models perform excellently on In-Distribution (ID) data, but can significantly fail on Out-Of-Distribution (OOD) data. While developing methods focus on improving OOD generalization, few attention has been paid to evaluating…

机器学习 · 计算机科学 2021-11-22 Rui Hu , Jitao Sang , Jinqiang Wang , Rui Hu , Chaoquan Jiang

Numerous machine learning (ML) models have been developed, including those for software engineering (SE) tasks, under the assumption that training and testing data come from the same distribution. However, training and testing distributions…

软件工程 · 计算机科学 2025-03-04 Yanfu Yan , Viet Duong , Huajie Shao , Denys Poshyvanyk

Test data is said to be out-of-distribution (OOD) when it unexpectedly differs from the training data, a common challenge in real-world use cases of machine learning. Although OOD generalisation has gained interest in recent years, few…

计算与语言 · 计算机科学 2024-09-30 Dejan Porjazovski , Anssi Moisio , Mikko Kurimo

To detect distribution shifts and improve model safety, many out-of-distribution (OOD) detection methods rely on the predictive uncertainty or features of supervised models trained on in-distribution data. In this paper, we critically…

We study the problem of Out-of-Distribution (OOD) detection, that is, detecting whether a learning algorithm's output can be trusted at inference time. While a number of tests for OOD detection have been proposed in prior work, a formal…

机器学习 · 统计学 2023-09-19 Akshayaa Magesh , Venugopal V. Veeravalli , Anirban Roy , Susmit Jha

Graph machine learning (GML) has been successfully applied across a wide range of tasks. Nonetheless, GML faces significant challenges in generalizing over out-of-distribution (OOD) data, which raises concerns about its wider applicability.…

机器学习 · 计算机科学 2024-10-17 Jing Ma

Recent years have witnessed significant progress in the development of machine learning models across a wide range of fields, fueled by increased computational resources, large-scale datasets, and the rise of deep learning architectures.…

Distribution shifts on graphs -- the discrepancies in data distribution between training and employing a graph machine learning model -- are ubiquitous and often unavoidable in real-world scenarios. These shifts may severely deteriorate…

机器学习 · 计算机科学 2025-03-31 Kexin Zhang , Shuhan Liu , Song Wang , Weili Shi , Chen Chen , Pan Li , Sheng Li , Jundong Li , Kaize Ding

Prediction models often fail if train and test data do not stem from the same distribution. Out-of-distribution (OOD) generalization to unseen, perturbed test data is a desirable but difficult-to-achieve property for prediction models and…

统计方法学 · 统计学 2022-05-25 Lucas Kook , Beate Sick , Peter Bühlmann

This paper addresses the challenge of out-of-distribution (OOD) generalization in graph machine learning, a field rapidly advancing yet grappling with the discrepancy between source and target data distributions. Traditional graph learning…

机器学习 · 计算机科学 2024-08-09 Xin Sun , Liang Wang , Qiang Liu , Shu Wu , Zilei Wang , Liang Wang