中文
相关论文

相关论文: Principled Out-of-Distribution Generalization via …

200 篇论文

Out-of-Distribution (OoD) detection aims to justify whether a given sample is from the training distribution of the classifier-under-protection, i.e., In-Distribution (InD), or from OoD. Diffusion Models (DMs) are recently utilized in OoD…

计算机视觉与模式识别 · 计算机科学 2024-11-20 Kun Fang , Qinghua Tao , Zuopeng Yang , Xiaolin Huang , Jie Yang

Deep network models perform excellently on In-Distribution (ID) data, but can significantly fail on Out-Of-Distribution (OOD) data. While developing methods focus on improving OOD generalization, few attention has been paid to evaluating…

机器学习 · 计算机科学 2021-11-22 Rui Hu , Jitao Sang , Jinqiang Wang , Rui Hu , Chaoquan Jiang

Successful deep neural networks discover salient features of data. We show when and why they fail to learn out-of-distribution (OOD)-relevant representations from an in-distribution (ID) training window. This requires decoupling feature…

机器学习 · 计算机科学 2026-05-14 Leonel Aguilar , Jan Nagler , Christoph Hoelscher , Nino Antulov-Fantulin

Deep neural networks often face generalization problems to handle out-of-distribution (OOD) data, and there remains a notable theoretical gap between the contributing factors and their respective impacts. Literature evidence from…

机器学习 · 计算机科学 2024-04-24 Songming Zhang , Yuxiao Luo , Qizhou Wang , Haoang Chi , Xiaofeng Chen , Bo Han , Jinyan Li

With the goal of generalizing to out-of-distribution (OOD) data, recent domain generalization methods aim to learn "stable" feature representations whose effect on the output remains invariant across domains. Given the theoretical…

机器学习 · 计算机科学 2021-10-08 Divyat Mahajan , Shruti Tople , Amit Sharma

Out-of-distribution (OOD) generalisation is challenging because it involves not only learning from empirical data, but also deciding among various notions of generalisation, e.g., optimising the average-case risk, worst-case risk, or…

机器学习 · 计算机科学 2024-05-31 Anurag Singh , Siu Lun Chau , Shahine Bouabid , Krikamol Muandet

Machine learning-assisted retrosynthesis prediction models have been gaining widespread adoption, though their performances oftentimes degrade significantly when deployed in real-world applications embracing out-of-distribution (OOD)…

机器学习 · 计算机科学 2023-12-19 Yemin Yu , Luotian Yuan , Ying Wei , Hanyu Gao , Xinhai Ye , Zhihua Wang , Fei Wu

Out-of-distribution (OOD) generalization remains a central challenge in deploying deep learning models to real-world scenarios, particularly in domains such as biomedical images, where distribution shifts are both subtle and pervasive.…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Haoran Pei , Yuguang Yang , Kexin Liu , Baochang Zhang

Deep neural networks are increasingly used in a wide range of technologies and services, but remain highly susceptible to out-of-distribution (OOD) samples, that is, drawn from a different distribution than the original training set. A…

机器学习 · 计算机科学 2024-04-17 Pietro Recalcati , Fabio Garcea , Luca Piano , Fabrizio Lamberti , Lia Morra

Out-of-distribution (OOD) detection is a crucial part of deploying machine learning models safely. It has been extensively studied with a plethora of methods developed in the literature. This problem is tackled with an OOD score…

计算机视觉与模式识别 · 计算机科学 2024-01-19 Jingqiu Zhou , Aojun Zhou , Hongsheng Li

The diffusion probabilistic generative models are widely used to generate high-quality data. Though they can synthetic data that does not exist in the training set, the rationale behind such generalization is still unexplored. In this…

机器学习 · 计算机科学 2023-05-25 Mingyang Yi , Jiacheng Sun , Zhenguo Li

A key feature of out-of-distribution (OOD) detection is to exploit a trained neural network by extracting statistical patterns and relationships through the multi-layer classifier to detect shifts in the expected input data distribution.…

机器学习 · 计算机科学 2023-06-07 Eduardo Dadalto , Pierre Colombo , Guillaume Staerman , Nathan Noiry , Pablo Piantanida

Diffusion models generalize well in practice. However, an optimal diffusion model fully memorizes the training data and therefore fails to generalize, raising the question of what induces generalization in a real diffusion model. We show…

机器学习 · 计算机科学 2026-05-21 Tim Kaiser , Markus Kollmann

Out-of-Distribution (OOD) detection is critical for safe deployment; however, existing detectors often struggle to generalize across datasets of varying scales and model architectures, and some can incur high computational costs in…

机器学习 · 计算机科学 2025-04-04 Litian Liu , Yao Qin

Methods which utilize the outputs or feature representations of predictive models have emerged as promising approaches for out-of-distribution (OOD) detection of image inputs. However, these methods struggle to detect OOD inputs that share…

机器学习 · 计算机科学 2023-02-09 Lily H. Zhang , Rajesh Ranganath

Time series remains one of the most challenging modalities in machine learning research. The out-of-distribution (OOD) detection and generalization on time series tend to suffer due to its non-stationary property, i.e., the distribution…

机器学习 · 计算机科学 2023-08-07 Wang Lu , Jindong Wang , Xinwei Sun , Yiqiang Chen , Xiangyang Ji , Qiang Yang , Xing Xie

The ability to generalize out-of-domain (OOD) is an important goal for deep neural network development, and researchers have proposed many high-performing OOD generalization methods from various foundations. While many OOD algorithms…

机器学习 · 计算机科学 2022-08-29 Zining Zhu , Soroosh Shahtalebi , Frank Rudzicz

Diffusion probabilistic models have been successfully used to generate data from noise. However, most diffusion models are computationally expensive and difficult to interpret with a lack of theoretical justification. Random feature models…

机器学习 · 统计学 2025-08-11 Esha Saha , Giang Tran

Out-of-distribution (OOD) detection is crucial for deploying robust machine learning models, especially in areas where security is critical. However, traditional OOD detection methods often fail to capture complex data distributions from…

计算机视觉与模式识别 · 计算机科学 2024-08-22 Armando Zhu , Jiabei Liu , Keqin Li , Shuying Dai , Bo Hong , Peng Zhao , Changsong Wei

Can models with particular structure avoid being biased towards spurious correlation in out-of-distribution (OOD) generalization? Peters et al. (2016) provides a positive answer for linear cases. In this paper, we use a functional modular…

机器学习 · 计算机科学 2021-06-08 Dinghuai Zhang , Kartik Ahuja , Yilun Xu , Yisen Wang , Aaron Courville