English
Related papers

Related papers: Known Meets Unknown: Mitigating Overconfidence in …

200 papers

Convolutional Neural Networks (CNNs) are commonly designed for closed set arrangements, where test instances only belong to some "Known Known" (KK) classes used in training. As such, they predict a class label for a test sample based on the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Md Tahmid Hossain , Shyh Wei Teng , Guojun Lu , Ferdous Sohel

Open-World Object Detection (OWOD) extends object detection problem to a realistic and dynamic scenario, where a detection model is required to be capable of detecting both known and unknown objects and incrementally learning newly…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Ruohuan Fang , Guansong Pang , Lei Zhou , Xiao Bai , Jin Zheng

Classical semantic segmentation methods, including the recent deep learning ones, assume that all classes observed at test time have been seen during training. In this paper, we tackle the more realistic scenario where unexpected objects of…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Krzysztof Lis , Krishna Nakka , Pascal Fua , Mathieu Salzmann

Open set classification (OSC) tackles the problem of determining whether the data are in-class or out-of-class during inference, when only provided with a set of in-class examples at training time. Traditional OSC methods usually train…

Machine Learning · Computer Science 2020-08-12 Yang Yang , Zhen-Qiang Sun , Hui Xiong , Jian Yang

Recent advancements in deep learning have greatly enhanced 3D object recognition, but most models are limited to closed-set scenarios, unable to handle unknown samples in real-world applications. Open-set recognition (OSR) addresses this…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Jinfeng Xu , Xianzhi Li , Yuan Tang , Xu Han , Qiao Yu , Yixue Hao , Long Hu , Min Chen

Recent efforts in deploying Deep Neural Networks for object detection in real world applications, such as autonomous driving, assume that all relevant object classes have been observed during training. Quantifying the performance of these…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Yimeng Li , Jana Kosecka

The black box nature of deep learning models complicate their usage in critical applications such as remote sensing. Conformal prediction is a method to ensure trust in such scenarios. Subject to data exchangeability, conformal prediction…

Machine Learning · Computer Science 2024-05-07 Protim Bhattacharjee , Peter Jung

Uncertainty estimation is essential to make neural networks trustworthy in real-world applications. Extensive research efforts have been made to quantify and reduce predictive uncertainty. However, most existing works are designed for…

Machine Learning · Computer Science 2022-10-07 Myong Chol Jung , He Zhao , Joanna Dipnall , Belinda Gabbe , Lan Du

In recent years there has been increasing interest in the field of Open-Set Recognition, which allows a classification model to identify inputs as "unknown" when it encounters an object or class not in the training set. This ability to flag…

Machine Learning · Computer Science 2024-09-20 Zachary Rabin , Jim Davis , Benjamin Lewis , Matthew Scherreik

Deep networks have produced significant gains for various visual recognition problems, leading to high impact academic and commercial applications. Recent work in deep networks highlighted that it is easy to generate images that humans…

Computer Vision and Pattern Recognition · Computer Science 2015-11-20 Abhijit Bendale , Terrance Boult

Deep learning (DL) has recently attracted increasing interest to improve object type classification for automotive radar.In addition to high accuracy, it is crucial for decision making in autonomous vehicles to evaluate the reliability of…

Machine Learning · Computer Science 2021-06-11 Kanil Patel , William Beluch , Kilian Rambach , Adriana-Eliza Cozma , Michael Pfeiffer , Bin Yang

This thesis makes considerable contributions to the realm of machine learning, specifically in the context of open-world scenarios where systems face previously unseen data and contexts. Traditional machine learning models are usually…

Machine Learning · Computer Science 2023-10-11 Yiyou Sun

Semi-supervised learning (SSL) is an effective means to leverage unlabeled data to improve a model's performance. Typical SSL methods like FixMatch assume that labeled and unlabeled data share the same label space. However, in practice,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Kuniaki Saito , Donghyun Kim , Kate Saenko

Classic supervised learning makes the closed-world assumption, meaning that classes seen in testing must have been seen in training. However, in the dynamic world, new or unseen class examples may appear constantly. A model working in such…

Computation and Language · Computer Science 2019-03-05 Hu Xu , Bing Liu , Lei Shu , P. Yu

We study the understanding of deep neural networks from the scope in which they are trained on. While the accuracy of these models is usually impressive on the aggregate level, they still make mistakes, sometimes on cases that appear to be…

Machine Learning · Computer Science 2023-12-12 Roozbeh Yousefzadeh

Model deficiency that results from incomplete training data is a form of structural blindness that leads to costly errors, oftentimes with high confidence. During the training of classification tasks, underrepresented class-conditional…

Machine Learning · Computer Science 2021-02-09 Bruno Abrahao , Zheng Wang , Haider Ahmed , Yuchen Zhu

Neural networks have proven successful at learning from complex data distributions by acting as universal function approximators. However, they are often overconfident in their predictions, which leads to inaccurate and miscalibrated…

Machine Learning · Computer Science 2021-02-23 Jeffrey Willette , Juho Lee , Sung Ju Hwang

Neural networks predictions are unreliable when the input sample is out of the training distribution or corrupted by noise. Being able to detect such failures automatically is fundamental to integrate deep learning algorithms into robotics.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Antonio Loquercio , Mattia Segù , Davide Scaramuzza

Open set recognition is designed to identify known classes and to reject unknown classes simultaneously. Specifically, identifying known classes and rejecting unknown classes correspond to reducing the empirical risk and the open space…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Ziheng Xia , Penghui Wang , Ganggang Dong , Hongwei Liu

Uncertainty-quantification methods are applied to estimate the confidence of deep-neural-networks classifiers over their predictions. However, most widely used methods are known to be overconfident. We address this problem by developing an…

Machine Learning · Computer Science 2023-05-19 Luigi Sbailò , Luca M. Ghiringhelli