中文
相关论文

相关论文: Intermediate Layer Classifiers for OOD generalizat…

200 篇论文

Detecting out-of-distribution (OOD) samples is essential for ensuring the reliability of deep neural networks (DNNs) in real-world scenarios. While previous research has predominantly investigated the disparity between in-distribution (ID)…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Yingwen Wu , Tao Li , Xinwen Cheng , Jie Yang , Xiaolin Huang

Out-of-distribution (OOD) detection lies at the heart of robust artificial intelligence (AI), aiming to identify samples from novel distributions beyond the training set. Recent approaches have exploited feature representations as…

机器学习 · 计算机科学 2025-08-06 Tarhib Al Azad , Faizul Rakib Sayem , Shahana Ibrahim

Improving out-of-distribution (OOD) generalization during in-distribution (ID) adaptation is a primary goal of robust fine-tuning of zero-shot models beyond naive fine-tuning. However, despite decent OOD generalization performance from…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Changdae Oh , Hyesu Lim , Mijoo Kim , Dongyoon Han , Sangdoo Yun , Jaegul Choo , Alexander Hauptmann , Zhi-Qi Cheng , Kyungwoo Song

Deep learning models often exhibit overconfidence in predicting out-of-distribution (OOD) data, underscoring the crucial role of OOD detection in ensuring reliability in predictions. Among various OOD detection approaches, post-hoc…

机器学习 · 计算机科学 2023-11-28 Naveen Karunanayake , Suranga Seneviratne , Sanjay Chawla

Graphs are a fundamental data structure for representing relational information in domains such as social networks, molecular systems, and knowledge graphs. However, graph learning models often suffer from limited generalization when…

机器学习 · 计算机科学 2026-01-30 Haoyang Li , Haibo Chen , Xin Wang , Wenwu Zhu

The inability of deep learning models to handle data drawn from unseen distributions has sparked much interest in unsupervised out-of-distribution (U-OOD) detection, as it is crucial for reliable deep learning models. Despite considerable…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Lars Doorenbos , Raphael Sznitman , Pablo Márquez-Neila

Continual learning (CL) is an important technique to allow artificial neural networks to work in open environments. CL enables a system to learn new tasks without severe interference to its performance on old tasks, i.e., overcome the…

机器学习 · 计算机科学 2024-07-08 Liangxuan Guo , Yang Chen , Shan Yu

In the open world, detecting out-of-distribution (OOD) data, whose labels are disjoint with those of in-distribution (ID) samples, is important for reliable deep neural networks (DNNs). To achieve better detection performance, one type of…

计算机视觉与模式识别 · 计算机科学 2025-02-28 Yingwen Wu , Ruiji Yu , Xinwen Cheng , Zhengbao He , Xiaolin Huang

Out-of-distribution (OOD) generalization is a critical ability for deep learning models in many real-world scenarios including healthcare and autonomous vehicles. Recently, different techniques have been proposed to improve OOD…

机器学习 · 计算机科学 2023-08-24 Sobhan Hemati , Guojun Zhang , Amir Estiri , Xi Chen

The capability of reliably detecting out-of-distribution samples is one of the key factors in deploying a good classifier, as the test distribution always does not match with the training distribution in most real-world applications. In…

机器学习 · 计算机科学 2021-04-05 Dongha Lee , Sehun Yu , Hwanjo Yu

We study the Out-of-Distribution (OOD) generalization in machine learning and propose a general framework that establishes information-theoretic generalization bounds. Our framework interpolates freely between Integral Probability Metric…

信息论 · 计算机科学 2024-12-16 Wenliang Liu , Guanding Yu , Lele Wang , Renjie Liao

Deep Learning models possess two key traits that, in combination, make their use in the real world a risky prospect. One, they do not typically generalize well outside of the distribution for which they were trained, and two, they tend to…

机器学习 · 计算机科学 2021-09-29 Jonathan S. Kent , Bo Li

Current out-of-distribution (OOD) detection methods typically assume balanced in-distribution (ID) data, while most real-world data follow a long-tailed distribution. Previous approaches to long-tailed OOD detection often involve balancing…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Yina He , Lei Peng , Yongcun Zhang , Juanjuan Weng , Zhiming Luo , Shaozi Li

Modern deep learning techniques have illustrated their excellent capabilities in many areas, but relies on large training data. Optimization-based meta-learning train a model on a variety tasks, such that it can solve new learning tasks…

机器学习 · 计算机科学 2023-02-23 Penghao Jiang , Ke Xin , Zifeng Wang , Chunxi Li

The ability to detect Out-of-Distribution (OOD) data is important in safety-critical applications of deep learning. The aim is to separate In-Distribution (ID) data drawn from the training distribution from OOD data using a measure of…

机器学习 · 计算机科学 2022-09-21 Guoxuan Xia , Christos-Savvas Bouganis

In the context of classification problems, Deep Learning (DL) approaches represent state of art. Many DL approaches are based on variations of standard multi-layer feed-forward neural networks. These are also referred to as deep networks.…

机器学习 · 计算机科学 2023-11-21 Andrea Apicella , Francesco Isgrò , Roberto Prevete

Out-of-Distribution (OOD) detection is critical for safe deployment; however, existing detectors often struggle to generalize across datasets of varying scales and model architectures, and some can incur high computational costs in…

机器学习 · 计算机科学 2025-04-04 Litian Liu , Yao Qin

A major challenge in understanding the generalization of deep learning is to explain why (stochastic) gradient descent can exploit the network architecture to find solutions that have good generalization performance when using high capacity…

机器学习 · 计算机科学 2019-02-12 Yifan Wu , Barnabas Poczos , Aarti Singh

In this study, we propose a three-stage training approach of neural networks for both photometric redshift estimation of galaxies and detection of out-of-distribution (OOD) objects. Our approach comprises supervised and unsupervised…

天体物理仪器与方法 · 物理学 2022-02-04 Joongoo Lee , Min-Su Shin

Out-of-Distribution (OOD) generalization in machine learning is a burgeoning area of study. Its primary goal is to enhance the adaptability and resilience of machine learning models when faced with new, unseen, and potentially adversarial…

机器学习 · 计算机科学 2024-11-05 Chengtao Jian , Kai Yang , Yang Jiao