English
Related papers

Related papers: Towards IID representation learning and its applic…

200 papers

Detecting out-of-distribution (OOD) samples is important for deploying machine learning models in safety-critical applications such as autonomous driving and robot-assisted surgery. Existing research has mainly focused on unimodal scenarios…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Hao Dong , Yue Zhao , Eleni Chatzi , Olga Fink

State-of-the-art Object Detection (OD) methods predominantly operate under a closed-world assumption, where test-time categories match those encountered during training. However, detecting and localizing unknown objects is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Daniel Montoya , Aymen Bouguerra , Alexandra Gomez-Villa , Fabio Arnez

The crux of effective out-of-distribution (OOD) detection lies in acquiring a robust in-distribution (ID) representation, distinct from OOD samples. While previous methods predominantly leaned on recognition-based techniques for this…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Jingyao Li , Pengguang Chen , Shaozuo Yu , Shu Liu , Jiaya Jia

Out-of-distribution detection is a common issue in deploying vision models in practice and solving it is an essential building block in safety critical applications. Most of the existing OOD detection solutions focus on improving the OOD…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Tomas Vojir , Jan Sochman , Rahaf Aljundi , Jiri Matas

Generative information retrieval methods retrieve documents by directly generating their identifiers. Much effort has been devoted to developing effective generative IR models. Less attention has been paid to the robustness of these models.…

Information Retrieval · Computer Science 2024-12-30 Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Changjiang Zhou , Maarten de Rijke , Xueqi Cheng

Understanding the decision-making and trusting the reliability of Deep Machine Learning Models is crucial for adopting such methods to safety-relevant applications. We extend self-explainable Prototypical Variational models with…

Machine Learning · Computer Science 2025-06-18 Conrad Orglmeister , Erik Bochinski , Volker Eiselein , Elvira Fleig

Machine learning models often degrade when deployed on data distributions different from their training data. Challenging conventional validation paradigms, we demonstrate that higher in-distribution (ID) bias can lead to better…

Machine Learning · Computer Science 2025-06-03 Ruixuan Chen , Wentao Li , Jiahui Xiao , Yuchen Li , Yimin Tang , Xiaonan Wang

In recent years, machine learning models have achieved success based on the independently and identically distributed assumption. However, this assumption can be easily violated in real-world applications, leading to the Out-of-Distribution…

Machine Learning · Computer Science 2024-03-27 Yifan Hao , Yong Lin , Difan Zou , Tong Zhang

Self-supervised representation learning has proved to be a valuable component for out-of-distribution (OoD) detection with only the texts of in-distribution (ID) examples. These approaches either train a language model from scratch or…

Computation and Language · Computer Science 2023-06-05 Qianhui Wu , Huiqiang Jiang , Haonan Yin , Börje F. Karlsson , Chin-Yew Lin

Out-of-distribution (OOD) detection is a critical task to ensure the reliability and security of machine learning models deployed in real-world applications. Conventional methods for OOD detection that rely on single-modal information,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 K Huang , G Song , Hanwen Su , Jiyan Wang

By design, discriminatively trained neural network classifiers produce reliable predictions only for in-distribution samples. For their real-world deployments, detecting out-of-distribution (OOD) samples is essential. Assuming OOD to be…

Machine Learning · Computer Science 2019-10-11 Sachin Vernekar , Ashish Gaurav , Vahdat Abdelzad , Taylor Denouden , Rick Salay , Krzysztof Czarnecki

Learning general-purpose representations from perceptual inputs is a hallmark of human intelligence. For example, people can write out numbers or characters, or even draw doodles, by characterizing these tasks as different instantiations of…

Machine Learning · Computer Science 2022-06-28 Yichao Liang , Joshua B. Tenenbaum , Tuan Anh Le , N. Siddharth

Trajectory prediction is critical for autonomous driving vehicles. Most existing methods tend to model the correlation between history trajectory (input) and future trajectory (output). Since correlation is just a superficial description of…

Machine Learning · Computer Science 2023-07-13 Shengyi Li , Qifan Xue , Yezhuo Zhang , Xuanpeng Li

Out-of-Distribution (OOD) detection is critical for safe deployment; however, existing detectors often struggle to generalize across datasets of varying scales and model architectures, and some can incur high computational costs in…

Machine Learning · Computer Science 2025-04-04 Litian Liu , Yao Qin

Multimodal intent understanding is a significant research area that requires effective leveraging of multiple modalities to analyze human language. Existing methods face two main challenges in this domain. Firstly, they have limitations in…

Multimedia · Computer Science 2025-05-26 Hanlei Zhang , Qianrui Zhou , Hua Xu , Jianhua Su , Roberto Evans , Kai Gao

The task of out-of-distribution (OOD) detection is crucial for deploying machine learning models in real-world settings. In this paper, we observe that the singular value distributions of the in-distribution (ID) and OOD features are quite…

Machine Learning · Computer Science 2022-09-20 Yue Song , Nicu Sebe , Wei Wang

Detecting out-of-distribution (OOD) samples is a critical task for reliable machine learning. However, it becomes particularly challenging when the models are trained on long-tailed datasets, as the models often struggle to distinguish…

Machine Learning · Computer Science 2024-08-21 Dong Geun Shin , Hye Won Chung

Identifying unexpected domain-shifted instances in natural language processing is crucial in real-world applications. Previous works identify the out-of-distribution (OOD) instance by leveraging a single global feature embedding to…

Computation and Language · Computer Science 2024-03-20 Jinan Zou , Maihao Guo , Yu Tian , Yuhao Lin , Haiyao Cao , Lingqiao Liu , Ehsan Abbasnejad , Javen Qinfeng Shi

Out-of-distribution (OOD) detection is essential for reliably deploying machine learning models in the wild. Yet, most methods treat large pre-trained models as monolithic encoders and rely solely on their final-layer representations for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 I. M. De la Jara , C. Rodriguez-Opazo , D. Teney , D. Ranasinghe , E. Abbasnejad

Predictive machine learning models generally excel on in-distribution data, but their performance degrades on out-of-distribution (OOD) inputs. Reliable deployment therefore requires robust OOD detection, yet this is particularly…

Machine Learning · Computer Science 2026-02-19 David Graber , Victor Armegioiu , Rebecca Buller , Siddhartha Mishra