中文
相关论文

相关论文: Breaking Correlation Shift via Conditional Invaria…

200 篇论文

Out-of-distribution detection (OOD) is a pivotal task for real-world applications that trains models to identify samples that are distributionally different from the in-distribution (ID) data during testing. Recent advances in AI,…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Chaohua Li , Enhao Zhang , Chuanxing Geng , Songcan Chen

Through recognizing causal subgraphs, causal graph learning (CGL) has risen to be a promising approach for improving the generalizability of graph neural networks under out-of-distribution (OOD) scenarios. However, the empirical successes…

机器学习 · 计算机科学 2025-07-02 Yujia Yin , Tianyi Qu , Zihao Wang , Yifan Chen

While pretrained language models achieve excellent performance on natural language understanding benchmarks, they tend to rely on spurious correlations and generalize poorly to out-of-distribution (OOD) data. Recent work has explored using…

计算与语言 · 计算机科学 2022-03-17 Nitish Joshi , He He

Detecting Out-of-Distribution (OOD) sensory data and covariate distribution shift aims to identify new test examples with different high-level image statistics to the captured, normal and In-Distribution (ID) set. Existing OOD detection…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Christiaan Viviers , Amaan Valiuddin , Francisco Caetano , Lemar Abdi , Lena Filatova , Peter de With , Fons van der Sommen

Designing deep neural network classifiers that perform robustly on distributions differing from the available training data is an active area of machine learning research. However, out-of-distribution generalization for regression-the…

机器学习 · 计算机科学 2024-01-01 Benjamin Eyre , Elliot Creager , David Madras , Vardan Papyan , Richard Zemel

We establish a new model-agnostic optimization framework for out-of-distribution generalization via multicalibration, a criterion that ensures a predictor is calibrated across a family of overlapping groups. Multicalibration is shown to be…

机器学习 · 计算机科学 2024-06-04 Jiayun Wu , Jiashuo Liu , Peng Cui , Zhiwei Steven Wu

There has been a massive increase in research interest towards applying data driven methods to problems in mechanics. While traditional machine learning (ML) methods have enabled many breakthroughs, they rely on the assumption that the…

机器学习 · 统计学 2022-09-16 Lingxiao Yuan , Harold S. Park , Emma Lejeune

We study the Out-of-Distribution (OOD) generalization in machine learning and propose a general framework that establishes information-theoretic generalization bounds. Our framework interpolates freely between Integral Probability Metric…

信息论 · 计算机科学 2024-12-16 Wenliang Liu , Guanding Yu , Lele Wang , Renjie Liao

Explaining out-of-distribution generalization has been a central problem in epistemology since Goodman's "grue" puzzle in 1946. Today it's a central problem in machine learning, including AI alignment. Here we propose a principled account…

机器学习 · 计算机科学 2026-05-13 Scott Aaronson , Lin Lin Lee , Jiawei Li

Covariate shift, a widely used assumption in tackling {\it distributional shift} (when training and test distributions differ), focuses on scenarios where the distribution of the labels conditioned on the feature vector is the same, but the…

机器学习 · 计算机科学 2025-02-24 Deeksha Adil , Jarosław Błasiok

Out-of-distribution (OOD) generalization is an important issue for Graph Neural Networks (GNNs). Recent works employ different graph editions to generate augmented environments and learn an invariant GNN for generalization. However, the…

机器学习 · 计算机科学 2023-03-28 Junchi Yu , Jian Liang , Ran He

Causal influence measures for machine learnt classifiers shed light on the reasons behind classification, and aid in identifying influential input features and revealing their biases. However, such analyses involve evaluating the classifier…

机器学习 · 计算机科学 2018-04-10 Shayak Sen , Piotr Mardziel , Anupam Datta , Matthew Fredrikson

Most existing out-of-distribution (OOD) detection benchmarks classify samples with novel labels as the OOD data. However, some marginal OOD samples actually have close semantic contents to the in-distribution (ID) sample, which makes…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Xingming Long , Jie Zhang , Shiguang Shan , Xilin Chen

The challenge of Out-of-Distribution (OOD) generalization poses a foundational concern for the application of machine learning algorithms to risk-sensitive areas. Inspired by traditional importance weighting and propensity weighting…

机器学习 · 计算机科学 2025-02-12 Han Yu , Yue He , Renzhe Xu , Dongbai Li , Jiayin Zhang , Wenchao Zou , Peng Cui

Semi-supervised learning methods have shown promising results in solving many practical problems when only a few labels are available. The existing methods assume that the class distributions of labeled and unlabeled data are equal;…

机器学习 · 计算机科学 2024-08-06 Min Gu Kwak , Hyungu Kahng , Seoung Bum Kim

Enhancing the stability of machine learning algorithms under distributional shifts is at the heart of the Out-of-Distribution (OOD) Generalization problem. Derived from causal learning, recent works of invariant learning pursue strict…

机器学习 · 计算机科学 2024-02-15 Jiashuo Liu , Jiayun Wu , Jie Peng , Xiaoyu Wu , Yang Zheng , Bo Li , Peng Cui

Recommender systems use users' historical interactions to learn their preferences and deliver personalized recommendations from a vast array of candidate items. Current recommender systems primarily rely on the assumption that the training…

信息检索 · 计算机科学 2024-04-24 Zhuhang Li , Ning Yang

In the context of modern machine learning, models deployed in real-world scenarios often encounter diverse data shifts like covariate and semantic shifts, leading to challenges in both out-of-distribution (OOD) generalization and detection.…

机器学习 · 计算机科学 2024-09-30 Han Wang , Yixuan Li

Unsupervised out-of-distribution (OOD) Detection aims to separate the samples falling outside the distribution of training data without label information. Among numerous branches, contrastive learning has shown its excellent capability of…

计算机视觉与模式识别 · 计算机科学 2023-02-07 Menglong Chen , Xingtai Gui , Shicai Fan

Recent object detectors have achieved impressive accuracy in identifying objects seen during training. However, real-world deployment often introduces novel and unexpected objects, referred to as out-of-distribution (OOD) objects, posing…