English
Related papers

Related papers: Combining pre-trained Vision Transformers and CIDE…

200 papers

Recent vision-language pre-trained models (VL-PTMs) have shown remarkable success in open-vocabulary tasks. However, downstream use cases often involve further fine-tuning of VL-PTMs, which may distort their general knowledge and impair…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Lin Zhu , Yifeng Yang , Qinying Gu , Xinbing Wang , Chenghu Zhou , Nanyang Ye

Convolutional neural networks (CNN) have demonstrated remarkable performance when the training and testing data are from the same distribution. However, such trained CNN models often largely degrade on testing data which is unseen and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Haozhe Liu , Wentian Zhang , Jinheng Xie , Haoqian Wu , Bing Li , Ziqi Zhang , Yuexiang Li , Yawen Huang , Bernard Ghanem , Yefeng Zheng

Often, deep network models are purely inductive during training and while performing inference on unseen data. Thus, when such models are used for predictions, it is well known that they often fail to capture the semantic information and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Zhu Wang , Sourav Medya , Sathya N. Ravi

Out-of-distribution (OOD) detection is crucial to modern deep learning applications by identifying and alerting about the OOD samples that should not be tested or used for making predictions. Current OOD detection methods have made…

Machine Learning · Computer Science 2023-09-22 Xinheng Wu , Jie Lu , Zhen Fang , Guangquan Zhang

Neural networks (NNs) are widely used for object classification in autonomous driving. However, NNs can fail on input data not well represented by the training dataset, known as out-of-distribution (OOD) data. A mechanism to detect OOD…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Julia Nitsch , Masha Itkina , Ransalu Senanayake , Juan Nieto , Max Schmidt , Roland Siegwart , Mykel J. Kochenderfer , Cesar Cadena

The ability to generalize out-of-domain (OOD) is an important goal for deep neural network development, and researchers have proposed many high-performing OOD generalization methods from various foundations. While many OOD algorithms…

Machine Learning · Computer Science 2022-08-29 Zining Zhu , Soroosh Shahtalebi , Frank Rudzicz

Vision Transformers (ViTs) have achieved impressive performance on various vision tasks, yet their generalization under distribution shifts (DS) is rarely understood. In this work, we comprehensively study the out-of-distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Chongzhi Zhang , Mingyuan Zhang , Shanghang Zhang , Daisheng Jin , Qiang Zhou , Zhongang Cai , Haiyu Zhao , Xianglong Liu , Ziwei Liu

Out-of-distribution (OOD) detection is important for machine learning models deployed in the wild. Recent methods use auxiliary outlier data to regularize the model for improved OOD detection. However, these approaches make a strong…

Machine Learning · Computer Science 2022-06-30 Julian Katz-Samuels , Julia Nakhleh , Robert Nowak , Yixuan Li

Transformers have rapidly gained popularity in computer vision, especially in the field of object recognition and detection. Upon examining the outcomes of state-of-the-art object detection methods, we noticed that transformers consistently…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Aref Miri Rekavandi , Shima Rashidi , Farid Boussaid , Stephen Hoefs , Emre Akbas , Mohammed bennamoun

In this work, we propose CODE, an extension of existing work from the field of explainable AI that identifies class-specific recurring patterns to build a robust Out-of-Distribution (OoD) detection method for visual classifiers. CODE does…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Romain Xu-Darme , Julien Girard-Satabin , Darryl Hond , Gabriele Incorvaia , Zakaria Chihani

In domain classification for spoken dialog systems, correct detection of out-of-domain (OOD) utterances is crucial because it reduces confusion and unnecessary interaction costs between users and the systems. Previous work usually utilizes…

Computation and Language · Computer Science 2018-07-03 Joo-Kyung Kim , Young-Bum Kim

Vision transformers have shown remarkable performance in vision tasks, but enabling them for accessible and real-time use is still challenging. Quantization reduces memory and inference costs at the risk of performance loss. Strides have…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Joey Kuang , Alexander Wong

Highly complex deep learning models are increasingly integrated into modern cyber-physical systems (CPS), many of which have strict safety requirements. One problem arising from this is that deep learning lacks interpretability, operating…

Machine Learning · Computer Science 2021-07-27 Yeli Feng , Arvind Easwaran

Many neural network-based out-of-distribution (OoD) detection methods have been proposed. However, they require many training data for each target task. We propose a simple yet effective meta-learning method to detect OoD with small…

Machine Learning · Statistics 2022-06-22 Tomoharu Iwata , Atsutoshi Kumagai

State-of-the-art Object Detection (OD) methods predominantly operate under a closed-world assumption, where test-time categories match those encountered during training. However, detecting and localizing unknown objects is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Daniel Montoya , Aymen Bouguerra , Alexandra Gomez-Villa , Fabio Arnez

Recent object detectors have achieved impressive accuracy in identifying objects seen during training. However, real-world deployment often introduces novel and unexpected objects, referred to as out-of-distribution (OOD) objects, posing…

Machine Learning · Computer Science 2025-11-20 Quang-Huy Nguyen , Jin Peng Zhou , Zhenzhen Liu , Khanh-Huyen Bui , Kilian Q. Weinberger , Wei-Lun Chao , Dung D. Le

Surface defect detection is an extremely crucial step to ensure the quality of industrial products. Nowadays, convolutional neural networks (CNNs) based on encoder-decoder architecture have achieved tremendous success in various defect…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Junpu Wang , Guili Xu , Fuju Yan , Jinjin Wang , Zhengsheng Wang

Deep learning models such as convolutional neural networks and transformers have been widely applied to solve 3D object detection problems in the domain of autonomous driving. While existing models have achieved outstanding performance on…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Ruixiao Zhang , Juheon Lee , Xiaohao Cai , Adam Prugel-Bennett

There are many computer vision applications including object segmentation, classification, object detection, and reconstruction for which machine learning (ML) shows state-of-the-art performance. Nowadays, we can build ML tools for such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Hamza Riaz , Alan F. Smeaton

The ability to detect unfamiliar or unexpected images is essential for safe deployment of computer vision systems. In the context of classification, the task of detecting images outside of a model's training domain is known as…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Galadrielle Humblot-Renaux , Sergio Escalera , Thomas B. Moeslund