English
Related papers

Related papers: One Representation to Rule Them All: Identifying O…

200 papers

Few-shot classification which aims to recognize unseen classes using very limited samples has attracted more and more attention. Usually, it is formulated as a metric learning problem. The core issue of few-shot classification is how to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Xixi Wang , Xiao Wang , Bo Jiang , Bin Luo

With the availability of large pre-trained models, a modern workflow for building real-world machine learning solutions is to fine-tune such models on a downstream task with a relatively small domain-specific dataset. In such applications,…

Machine Learning · Computer Science 2024-05-28 Lu Tan , Huei Zhou , Yinxiang Huang , Zeming Zheng , Yujiu Yang

Deep generative models (DGMs) seem a natural fit for detecting out-of-distribution (OOD) inputs, but such models have been shown to assign higher probabilities or densities to OOD images than images from the training distribution. In this…

Machine Learning · Computer Science 2021-07-20 Lily H. Zhang , Mark Goldstein , Rajesh Ranganath

Contrastive representation learning has emerged as an outstanding approach for anomaly detection. In this work, we explore the $\ell_2$-norm of contrastive features and its applications in out-of-distribution detection. We propose a simple…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Tai Le-Gia , Jaehyun Ahn

Modern foundation models exhibit remarkable out-of-distribution (OOD) generalization, solving tasks far beyond the support of their training data. However, the theoretical principles underpinning this phenomenon remain elusive. This paper…

Machine Learning · Statistics 2025-05-29 Jiawei Ge , Amanda Wang , Shange Tang , Chi Jin

Out-of-distribution (OOD) detection is critical for ensuring the reliability of deep learning systems, particularly in safety-critical applications. Likelihood-based deep generative models have historically faced criticism for their…

Machine Learning · Computer Science 2025-07-11 Yifan Ding , Arturas Aleksandraus , Amirhossein Ahmadian , Jonas Unger , Fredrik Lindsten , Gabriel Eilertsen

Many neural network-based out-of-distribution (OoD) detection methods have been proposed. However, they require many training data for each target task. We propose a simple yet effective meta-learning method to detect OoD with small…

Machine Learning · Statistics 2022-06-22 Tomoharu Iwata , Atsutoshi Kumagai

A common problem with most zero and few-shot learning approaches is they suffer from bias towards seen classes resulting in sub-optimal performance. Existing efforts aim to utilize unlabeled images from unseen classes (i.e transductive…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Gaurav Bhatt , Shivam Chandhok , Vineeth N Balasubramanian

Recently proposed few-shot image classification methods have generally focused on use cases where the objects to be classified are the central subject of images. Despite success on benchmark vision datasets aligned with this use case, these…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Elliott Skomski , Aaron Tuor , Andrew Avila , Lauren Phillips , Zachary New , Henry Kvinge , Courtney D. Corley , Nathan Hodas

In Few-Shot Learning (FSL), models are trained to recognise unseen objects from a query set, given a few labelled examples from a support set. In standard FSL, models are evaluated on query instances sampled from the same class distribution…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Mateusz Ochal , Massimiliano Patacchiola , Malik Boudiaf , Sen Wang

We generalize the formulation of few-shot learning by introducing the concept of an aspect. In the traditional formulation of few-shot learning, there is an underlying assumption that a single "true" label defines the content of each data…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Tim van Engeland , Lu Yin , Vlado Menkovski

Out-of-distribution (OOD) detection empowers the model trained on the closed image set to identify unknown data in the open world. Though many prior techniques have yielded considerable improvements in this research direction, two crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Sen Pei

This paper identifies the flaws in existing open-world learning approaches and attempts to provide a complete picture in the form of \textbf{True Open-World Learning}. We accomplish this by proposing a comprehensive generalize-able…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Akshay Raj Dhamija , Touqeer Ahmad , Jonathan Schwan , Mohsen Jafarzadeh , Chunchun Li , Terrance E. Boult

A serious problem in image classification is that a trained model might perform well for input data that originates from the same distribution as the data available for model training, but performs much worse for out-of-distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Rajat Koner , Poulami Sinhamahapatra , Karsten Roscher , Stephan Günnemann , Volker Tresp

We study the ability of foundation models to learn representations for classification that are transferable to new, unseen classes. Recent results in the literature show that representations learned by a single classifier over many classes…

Machine Learning · Computer Science 2023-07-18 Tomer Galanti , András György , Marcus Hutter

We present a novel vision-language prompt learning approach for few-shot out-of-distribution (OOD) detection. Few-shot OOD detection aims to detect OOD images from classes that are unseen during training using only a few labeled…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Atsuyuki Miyai , Qing Yu , Go Irie , Kiyoharu Aizawa

Deep neural networks are increasingly used in a wide range of technologies and services, but remain highly susceptible to out-of-distribution (OOD) samples, that is, drawn from a different distribution than the original training set. A…

Machine Learning · Computer Science 2024-04-17 Pietro Recalcati , Fabio Garcea , Luca Piano , Fabrizio Lamberti , Lia Morra

Open-set few-shot image classification aims to train models using a small amount of labeled data, enabling them to achieve good generalization when confronted with unknown environments. Existing methods mainly use visual information from a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Kexuan Shi , Zhuang Qi , Jingjing Zhu , Lei Meng , Yaochen Zhang , Haibei Huang , Xiangxu Meng

The effective application of representation learning to real-world problems requires both techniques for learning useful representations, and also robust ways to evaluate properties of representations. Recent work in disentangled…

Machine Learning · Computer Science 2020-12-16 Salman Mohammadi , Anders Kirk Uhrenholt , Bjørn Sand Jensen

Out-of-distribution (OOD) generalization is critical for machine learning models deployed in the real world. However, achieving this can be fundamentally challenging, as it requires the ability to learn invariant features across different…

Machine Learning · Computer Science 2024-11-05 Haoyue Bai , Yifei Ming , Julian Katz-Samuels , Yixuan Li