English
Related papers

Related papers: OpenDPR: Open-Vocabulary Change Detection via Visi…

200 papers

Open-Vocabulary Multi-Label Recognition (OV-MLR) aims to identify multiple seen and unseen object categories within an image, requiring both precise intra-class localization to pinpoint objects and effective inter-class reasoning to model…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Haijing Liu , Tao Pu , Hefeng Wu , Keze Wang , Liang Lin

Recently, Vision-Language Models (VLMs) have advanced segmentation techniques by shifting from the traditional segmentation of a closed-set of predefined object classes to open-vocabulary segmentation (OVS), allowing users to segment novel…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Gonca Yilmaz , Songyou Peng , Marc Pollefeys , Francis Engelmann , Hermann Blum

Open-vocabulary semantic segmentation aims at segmenting arbitrary categories expressed in textual form. Previous works have trained over large amounts of image-caption pairs to enforce pixel-level multimodal alignments. However, captions…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Luca Barsellotti , Roberto Amoroso , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

The nature of diversity in real-world environments necessitates neural network models to expand from closed category settings to accommodate novel emerging categories. In this paper, we study the open-vocabulary object detection (OVD),…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Sunyuan Qiang , Xianfei Li , Yanyan Liang , Wenlong Liao , Tao He , Pai Peng

Domain Generalization in Semantic Segmentation (DG-SS) aims to enable segmentation models to perform robustly in unseen environments. However, conventional DG-SS methods are restricted to a fixed set of known categories, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Dong Zhao , Qi Zang , Nan Pu , Wenjing Li , Nicu Sebe , Zhun Zhong

Out-of-distribution (OOD) detection is committed to delineating the classification boundaries between in-distribution (ID) and OOD images. Recent advances in vision-language models (VLMs) have demonstrated remarkable OOD detection…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Zhixia He , Chen Zhao , Minglai Shao , Xintao Wu , Xujiang Zhao , Dong Li , Qin Tian , Linlin Yu

We aim at advancing open-vocabulary object detection, which detects objects described by arbitrary text inputs. The fundamental challenge is the availability of training data. It is costly to further scale up the number of classes contained…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Xiuye Gu , Tsung-Yi Lin , Weicheng Kuo , Yin Cui

The challenge of Out-Of-Distribution (OOD) robustness remains a critical hurdle towards deploying deep vision models. Vision-Language Models (VLMs) have recently achieved groundbreaking results. VLM-based open-vocabulary object detection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Prakash Chandra Chhipa , Kanjar De , Meenakshi Subhash Chippa , Rajkumar Saini , Marcus Liwicki

To identify objects beyond predefined categories, open-vocabulary aerial object detection (OVAD) leverages the zero-shot capabilities of visual-language models (VLMs) to generalize from base to novel categories. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Jianhang Yao , Yongbin Zheng , Siqi Lu , Wanying Xu , Peng Sun

Remote sensing object detection has made significant progress, but most studies still focus on closed-set detection, limiting generalization across diverse datasets. Open-vocabulary object detection (OVD) provides a solution by leveraging…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Ziyue Huang , Yongchao Feng , Shuai Yang , Ziqi Liu , Qingjie Liu , Yunhong Wang

The goal of this paper is open-vocabulary object detection (OVOD) $\unicode{x2013}$ building a model that can detect objects beyond the set of categories seen at training, thus enabling the user to specify categories of interest at…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Prannay Kaul , Weidi Xie , Andrew Zisserman

As the most fundamental scene understanding tasks, object detection and segmentation have made tremendous progress in deep learning era. Due to the expensive manual labeling cost, the annotated categories in existing datasets are often…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Chaoyang Zhu , Long Chen

Traditional object detection models are typically trained on a fixed set of classes, limiting their flexibility and making it costly to incorporate new categories. Open-vocabulary object detection addresses this limitation by enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Jyoti Kini , Rohit Gupta , Mubarak Shah

Open-vocabulary object detection (OVOD) aims at localizing and recognizing visual objects from novel classes unseen at the training time. Whereas, empirical studies reveal that advanced detectors generally assign lower scores to those novel…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Yanhao Zheng , Kai Liu

Class-agnostic object detection (OD) can be a cornerstone or a bottleneck for many downstream vision tasks. Despite considerable advancements in bottom-up and multi-object discovery methods that leverage basic visual cues to identify…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Jia Syuen Lim , Zhuoxiao Chen , Mahsa Baktashmotlagh , Zhi Chen , Xin Yu , Zi Huang , Yadan Luo

Traditional object detection models in medical imaging operate within a closed-set paradigm, limiting their ability to detect objects of novel labels. Open-vocabulary object detection (OVOD) addresses this limitation but remains…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Tooba Tehreem Sheikh , Jean Lahoud , Rao Muhammad Anwer , Fahad Shahbaz Khan , Salman Khan , Hisham Cholakkal

Neural networks that are trained on limited category samples often mispredict out-of-distribution (OOD) objects. We observe that features of the same category are more tightly clustered in feature space, while those of different categories…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Junkun Chen , Jilin Mei , Liang Chen , Fangzhou Zhao , Yan Xing , Yu Hu

Existing open-vocabulary object detection (OVD) develops methods for testing unseen categories by aligning object region embeddings with corresponding VLM features. A recent study leverages the idea that VLMs implicitly learn compositional…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Hojun Choi , Junsuk Choe , Hyunjung Shim

This paper addresses the challenging problem of open-vocabulary object detection (OVOD) where an object detector must identify both seen and unseen classes in test images without labeled examples of the unseen classes in training. A typical…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Chau Pham , Truong Vu , Khoi Nguyen

Open-Vocabulary Object Detection (OVOD) aims to develop the capability to detect anything. Although myriads of large-scale pre-training efforts have built versatile foundation models that exhibit impressive zero-shot capabilities to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Guiying Zhu , Bowen Yang , Yin Zhuang , Tong Zhang , Guanqun Wang , Zhihao Che , He Chen , Lianlin Li