English
Related papers

Related papers: Likelihood-Aware Semantic Alignment for Full-Spect…

200 papers

Out-of-distribution (OOD) detection is critical for identifying test samples that deviate from in-distribution (ID) data, ensuring network robustness and reliability. This paper presents a flexible framework for OOD knowledge distillation…

Machine Learning · Computer Science 2025-06-30 Zhilin Zhao , Longbing Cao , Yixuan Zhang , Kun-Yu Lin , Wei-Shi Zheng

This paper introduces a novel method leveraging bi-encoder-based detectors along with a comprehensive study comparing different out-of-distribution (OOD) detection methods in NLP using different feature extractors. The feature extraction…

Computation and Language · Computer Science 2024-03-14 Louis Owen , Biddwan Ahmed , Abhay Kumar

Systematics contaminate observables, leading to distribution shifts relative to theoretically simulated signals-posing a major challenge for using pre-trained models to label such observables. Since systematics are often poorly understood…

Instrumentation and Methods for Astrophysics · Physics 2025-11-18 Sultan Hassan , Sambatra Andrianomena , Benjamin D. Wandelt

Despite outstanding semantic scene segmentation in closed-worlds, deep neural networks segment novel instances poorly, which is required for autonomous agents acting in an open world. To improve out-of-distribution (OOD) detection for…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Meghna Gummadi , Cassandra Kent , Karl Schmeckpeper , Eric Eaton

Efficient and effective Out-of-Distribution (OOD) detection is essential for the safe deployment of AI systems. Existing feature space methods, while effective, often incur significant computational overhead due to their reliance on…

Machine Learning · Computer Science 2024-06-05 Litian Liu , Yao Qin

Detecting out-of-distribution (OOD) examples is critical in many applications. We propose an unsupervised method to detect OOD samples using a $k$-NN density estimate with respect to a classification model's intermediate activations on…

Machine Learning · Computer Science 2021-02-11 Dara Bahri , Heinrich Jiang , Yi Tay , Donald Metzler

Two prevalent types of distributional shifts in machine learning are the covariate shift (as observed across different domains) and the semantic shift (as seen across different classes). Traditional OOD detection techniques typically…

Artificial Intelligence · Computer Science 2023-09-20 Haoliang Wang , Chen Zhao , Yunhui Guo , Kai Jiang , Feng Chen

State-of-the-art Object Detection (OD) methods predominantly operate under a closed-world assumption, where test-time categories match those encountered during training. However, detecting and localizing unknown objects is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Daniel Montoya , Aymen Bouguerra , Alexandra Gomez-Villa , Fabio Arnez

Advancements in synthesized speech have created a growing threat of impersonation, making it crucial to develop deepfake algorithm recognition. One significant aspect is out-of-distribution (OOD) detection, which has gained notable…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-05 Renmingyue Du , Jixun Yao , Qiuqiang Kong , Yin Cao

Recognizing out-of-distribution (OOD) samples is critical for machine learning systems deployed in the open world. The vast majority of OOD detection methods are driven by a single modality (e.g., either vision or language), leaving the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Yifei Ming , Ziyang Cai , Jiuxiang Gu , Yiyou Sun , Wei Li , Yixuan Li

Most classification and segmentation datasets assume a closed-world scenario in which predictions are expressed as distribution over a predetermined set of visual classes. However, such assumption implies unavoidable and often unnoticeable…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Petra Bevandić , Ivan Krešo , Marin Oršić , Siniša Šegvić

Generative recommendation has emerged as a scalable alternative to traditional retrieve-and-rank pipelines by operating in a compact token space. However, existing methods mainly rely on discrete code-level supervision, which leads to…

Information Retrieval · Computer Science 2026-03-03 Ziqi Xue , Dingxian Wang , Yimeng Bai , Shuai Zhu , Jialei Li , Xiaoyan Zhao , Frank Yang , Andrew Rabinovich , Yang Zhang , Pablo N. Mendes

Out-of-distribution (OOD) detection has attracted a large amount of attention from the machine learning research community in recent years due to its importance in deployed systems. Most of the previous studies focused on the detection of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Alon Zolfi , Guy Amit , Amit Baras , Satoru Koda , Ikuya Morikawa , Yuval Elovici , Asaf Shabtai

Out-of-distribution (OOD) detection is crucial for model reliability, as it identifies samples from unknown classes and reduces errors due to unexpected inputs. Vision-Language Models (VLMs) such as CLIP are emerging as powerful tools for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Yabin Zhang , Wenjie Zhu , Chenhang He , Lei Zhang

Out-of-distribution (OOD) detection is a task that detects OOD samples during inference to ensure the safety of deployed models. However, conventional benchmarks have reached performance saturation, making it difficult to compare recent OOD…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Shiho Noda , Atsuyuki Miyai , Qing Yu , Go Irie , Kiyoharu Aizawa

Uncertainty estimation is crucial in safety-critical applications, where robust out-of-distribution (OOD) detection is essential. Traditional Bayesian methods, though effective, are often hindered by high computational demands. As an…

Machine Learning · Computer Science 2024-11-06 Maksim Zhdanov , Stanislav Dereka , Sergey Kolesnikov

Deep neural classifiers trained with cross-entropy loss (CE loss) often suffer from poor calibration, necessitating the task of out-of-distribution (OOD) detection. Traditional supervised OOD detection methods require expensive manual…

Computation and Language · Computer Science 2023-05-25 Dheeraj Mekala , Adithya Samavedhi , Chengyu Dong , Jingbo Shang

During the forward pass of Deep Neural Networks (DNNs), inputs gradually transformed from low-level features to high-level conceptual labels. While features at different layers could summarize the important factors of the inputs at varying…

Machine Learning · Computer Science 2022-03-02 Haoliang Wang , Chen Zhao , Xujiang Zhao , Feng Chen

Out-of-distribution (OOD) detection is a critical task for reliable predictions over text. Fine-tuning with pre-trained language models has been a de facto procedure to derive OOD detectors with respect to in-distribution (ID) data. Despite…

Computation and Language · Computer Science 2023-05-23 Rheeya Uppaal , Junjie Hu , Yixuan Li

Detecting Out-of-Distribution (OOD) sensory data and covariate distribution shift aims to identify new test examples with different high-level image statistics to the captured, normal and In-Distribution (ID) set. Existing OOD detection…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Christiaan Viviers , Amaan Valiuddin , Francisco Caetano , Lemar Abdi , Lena Filatova , Peter de With , Fons van der Sommen