English
Related papers

Related papers: Nearest-Class Mean and Logits Agreement for Wildli…

200 papers

Open set recognition problems exist in many domains. For example in security, new malware classes emerge regularly; therefore malware classification systems need to identify instances from unknown classes in addition to discriminating…

Machine Learning · Computer Science 2018-02-14 Mehadi Hassen , Philip K. Chan

In recent years, the remarkable success of deep neural networks (DNNs) in computer vision is largely due to large-scale, high-quality labeled datasets. Training directly on real-world datasets with label noise may result in overfitting. The…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Yuandi Zhao , Qianxi Xia , Yang Sun , Zhijie Wen , Liyan Ma , Shihui Ying

We study out-of-distribution (OOD) prediction behavior of neural networks when they classify images from unseen classes or corrupted images. To probe the OOD behavior, we introduce a new measure, nearest category generalization (NCG), where…

Machine Learning · Computer Science 2023-03-09 Yao-Yuan Yang , Cyrus Rashtchian , Ruslan Salakhutdinov , Kamalika Chaudhuri

As autonomous decision-making agents move from narrow operating environments to unstructured worlds, learning systems must move from a closed-world formulation to an open-world and few-shot setting in which agents continuously learn new…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 John Willes , James Harrison , Ali Harakeh , Chelsea Finn , Marco Pavone , Steven Waslander

In this paper, we argue that the unsatisfactory out-of-distribution (OOD) detection performance of neural networks is mainly due to the SoftMax loss anisotropy and propensity to produce low entropy probability distributions in disagreement…

Machine Learning · Computer Science 2021-10-05 David Macêdo , Tsang Ing Ren , Cleber Zanchettin , Adriano L. I. Oliveira , Teresa Ludermir

Open-world semi-supervised learning (OWSSL) extends conventional semi-supervised learning to open-world scenarios by taking account of novel categories in unlabeled datasets. Despite the recent advancements in OWSSL, the success often…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Seongheon Park , Hyuk Kwon , Kwanghoon Sohn , Kibok Lee

Designing deep neural network classifiers that perform robustly on distributions differing from the available training data is an active area of machine learning research. However, out-of-distribution generalization for regression-the…

Machine Learning · Computer Science 2024-01-01 Benjamin Eyre , Elliot Creager , David Madras , Vardan Papyan , Richard Zemel

Out-of-distribution (OOD) detection is a critical task for deploying machine learning models in the open world. Distance-based methods have demonstrated promise, where testing samples are detected as OOD if they are relatively far away from…

Machine Learning · Computer Science 2022-12-09 Yiyou Sun , Yifei Ming , Xiaojin Zhu , Yixuan Li

Commonly used AI networks are very self-confident in their predictions, even when the evidence for a certain decision is dubious. The investigation of a deep learning model output is pivotal for understanding its decision processes and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Damian Matuszewski , Ida-Maria Sintorn

Convolutional Neural Networks (CNNs) are commonly designed for closed set arrangements, where test instances only belong to some "Known Known" (KK) classes used in training. As such, they predict a class label for a test sample based on the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Md Tahmid Hossain , Shyh Wei Teng , Guojun Lu , Ferdous Sohel

Out-of-distribution (OOD) detection has seen significant advancements with zero-shot approaches by leveraging the powerful Vision-Language Models (VLMs) such as CLIP. However, prior research works have predominantly focused on enhancing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Pei-Kang Lee , Jun-Cheng Chen , Ja-Ling Wu

Modern machine learning models deployed in the wild can encounter both covariate and semantic shifts, giving rise to the problems of out-of-distribution (OOD) generalization and OOD detection respectively. While both problems have received…

Machine Learning · Computer Science 2025-12-22 Haoyue Bai , Gregory Canal , Xuefeng Du , Jeongyeol Kwon , Robert Nowak , Yixuan Li

Estimating model accuracy on unseen, unlabeled datasets is crucial for real-world machine learning applications, especially under distribution shifts that can degrade performance. Existing methods often rely on predicted class probabilities…

Machine Learning · Computer Science 2025-08-28 Chenzhi Liu , Mahsa Baktashmotlagh , Yanran Tang , Zi Huang , Ruihong Qiu

Open set recognition is an emerging research area that aims to simultaneously classify samples from predefined classes and identify the rest as 'unknown'. In this process, one of the key challenges is to reduce the risk of generalizing the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Guangyao Chen , Limeng Qiao , Yemin Shi , Peixi Peng , Jia Li , Tiejun Huang , Shiliang Pu , Yonghong Tian

Deep neural networks have achieved great success in computer vision, speech recognition and many other areas. The potential of recurrent neural networks especially the Long Short-Term Memory (LSTM) for open set communication signal…

Signal Processing · Electrical Eng. & Systems 2020-02-28 Youwei Guo , Hongyu Jiang , Jing Wu , Jie Zhou

Out-of-distribution (OOD) learning often relies heavily on statistical approaches or predefined assumptions about OOD data distributions, hindering their efficacy in addressing multifaceted challenges of OOD generalization and OOD detection…

Machine Learning · Computer Science 2024-08-16 Haoyue Bai , Xuefeng Du , Katie Rainey , Shibin Parameswaran , Yixuan Li

Deep networks are currently the state-of-the-art for sensory perception in autonomous driving and robotics. However, deep models often generate overconfident predictions precluding proper probabilistic interpretation which we argue is due…

Machine Learning · Computer Science 2020-08-25 G. Melotti , C. Premebida , J. J. Bird , D. R. Faria , N. Gonçalves

Out-of-distribution (OOD) detection is important for machine learning models deployed in the wild. Recent methods use auxiliary outlier data to regularize the model for improved OOD detection. However, these approaches make a strong…

Machine Learning · Computer Science 2022-06-30 Julian Katz-Samuels , Julia Nakhleh , Robert Nowak , Yixuan Li

Deep learning for object classification relies heavily on convolutional models. While effective, CNNs are rarely interpretable after the fact. An attention mechanism can be used to highlight the area of the image that the model focuses on…

Computer Vision and Pattern Recognition · Computer Science 2019-03-18 Paresh Malalur , Tommi Jaakkola

Offline reinforcement learning (RL) aims to optimize a policy by using pre-collected datasets, to maximize cumulative rewards. However, offline reinforcement learning suffers challenges due to the distributional shift between the learned…

Machine Learning · Computer Science 2025-03-10 Yunkai Gao , Jiaming Guo , Fan Wu , Rui Zhang