English
Related papers

Related papers: Taming Self-Training for Open-Vocabulary Object De…

200 papers

To date, the most powerful semi-supervised object detectors (SS-OD) are based on pseudo-boxes, which need a sequence of post-processing with fine-tuned hyper-parameters. In this work, we propose replacing the sparse pseudo-boxes with the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Hongyu Zhou , Zheng Ge , Songtao Liu , Weixin Mao , Zeming Li , Haiyan Yu , Jian Sun

Foundation models, especially vision-language models (VLMs), offer compelling zero-shot object detection for applications like autonomous driving, a domain where manual labelling is prohibitively expensive. However, their detection latency…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Uday Bhaskar , Rishabh Bhattacharya , Avinash Patel , Sarthak Khoche , Praveen Anil Kulkarni , Naresh Manwani

Open-vocabulary object detection (OVD) aims to scale up vocabulary size to detect objects of novel categories beyond the training vocabulary. Recent work resorts to the rich knowledge in pre-trained vision-language models. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Peixian Chen , Kekai Sheng , Mengdan Zhang , Mingbao Lin , Yunhang Shen , Shaohui Lin , Bo Ren , Ke Li

Open-vocabulary object detection (OVOD) aims to detect known and unknown objects in the open world by leveraging text prompts. Benefiting from the emergence of large-scale vision--language pre-trained models, OVOD has demonstrated strong…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jiaming Liang , Yifeng Zhan , Chunlin Liu , Weihua Zheng , Bingye Peng , Qiwei Liang , Boyang Cai , Xiaochun Mai , Qiang Nie

We aim at advancing open-vocabulary object detection, which detects objects described by arbitrary text inputs. The fundamental challenge is the availability of training data. It is costly to further scale up the number of classes contained…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Xiuye Gu , Tsung-Yi Lin , Weicheng Kuo , Yin Cui

The advancement of object detection (OD) in open-vocabulary and open-world scenarios is a critical challenge in computer vision. This work introduces OmDet, a novel language-aware object detection architecture, and an innovative training…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Tiancheng Zhao , Peng Liu , Kyusong Lee

Recently, Vision-Language Models (VLMs) have advanced segmentation techniques by shifting from the traditional segmentation of a closed-set of predefined object classes to open-vocabulary segmentation (OVS), allowing users to segment novel…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Gonca Yilmaz , Songyou Peng , Marc Pollefeys , Francis Engelmann , Hermann Blum

Despite the remarkable progress in open-vocabulary object detection (OVD), a significant gap remains between the training and testing phases. During training, the RPN and RoI heads often misclassify unlabeled novel-category objects as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yupeng Zhang , Ruize Han , Zhiwei Chen , Wei Feng , Liang Wan

The goal of this paper is open-vocabulary object detection (OVOD) $\unicode{x2013}$ building a model that can detect objects beyond the set of categories seen at training, thus enabling the user to specify categories of interest at…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Prannay Kaul , Weidi Xie , Andrew Zisserman

Existing object detection methods are bounded in a fixed-set vocabulary by costly labeled data. When dealing with novel categories, the model has to be retrained with more bounding box annotations. Natural language supervision is an…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Chuang Lin , Peize Sun , Yi Jiang , Ping Luo , Lizhen Qu , Gholamreza Haffari , Zehuan Yuan , Jianfei Cai

Recent developments for Semi-Supervised Object Detection (SSOD) have shown the promise of leveraging unlabeled data to improve an object detector. However, thus far these methods have assumed that the unlabeled data does not contain…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Yen-Cheng Liu , Chih-Yao Ma , Xiaoliang Dai , Junjiao Tian , Peter Vajda , Zijian He , Zsolt Kira

In this paper, we consider the problem of open-vocabulary semantic segmentation (OVS), which aims to segment objects of arbitrary classes instead of pre-defined, closed-set categories. The main contributions are as follows: First, we…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Jilan Xu , Junlin Hou , Yuejie Zhang , Rui Feng , Yi Wang , Yu Qiao , Weidi Xie

Open-vocabulary object detection (OVD) extends recognition beyond fixed taxonomies by aligning visual and textual features, as in MDETR, GLIP, or RegionCLIP. While effective, these models require updating all parameters of large…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Bilal Faye , Hanane Azzag , Mustapha Lebbah

Open-vocabulary object detection (OVD), detecting specific classes of objects using only their linguistic descriptions (e.g., class names) without any image samples, has garnered significant attention. However, in real-world applications,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Yusuke Hosoya , Masanori Suganuma , Takayuki Okatani

Open-vocabulary detection (OVD) is a challenging task to detect and classify objects from an unrestricted set of categories, including those unseen during training. Existing open-vocabulary detectors are limited by complex visual-textual…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Caixiong Li , Xiongwei Zhao , Jinhang Zhang , Xing Zhang , Qihao Sun , Zhou Wu

The task of LiDAR-based 3D Open-Vocabulary Detection (3D OVD) requires the detector to learn to detect novel objects from point clouds without off-the-shelf training labels. Previous methods focus on the learning of object-level…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Xingyu Peng , Si Liu , Chen Gao , Yan Bai , Beipeng Mu , Xiaofei Wang , Huaxia Xia

Open-Vocabulary Detection (OVD) is the task of detecting all interesting objects in a given scene without predefined object classes. Extensive work has been done to deal with the OVD for 2D RGB images, but the exploration of 3D OVD is still…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Xingyu Peng , Yan Bai , Chen Gao , Lirong Yang , Fei Xia , Beipeng Mu , Xiaofei Wang , Si Liu

Despite great progress in object detection, most existing methods work only on a limited set of object categories, due to the tremendous human effort needed for bounding-box annotations of training data. To alleviate the problem, recent…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Mingfei Gao , Chen Xing , Juan Carlos Niebles , Junnan Li , Ran Xu , Wenhao Liu , Caiming Xiong

Object detection (OD) in computer vision has made significant progress in recent years, transitioning from closed-set labels to open-vocabulary detection (OVD) based on large-scale vision-language pre-training (VLP). However, current…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Yiyang Yao , Peng Liu , Tiancheng Zhao , Qianqian Zhang , Jiajia Liao , Chunxin Fang , Kyusong Lee , Qing Wang

In recent years, aerial object detection has been increasingly pivotal in various earth observation applications. However, current algorithms are limited to detecting a set of pre-defined object categories, demanding sufficient annotated…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yan Li , Weiwei Guo , Xue Yang , Ning Liao , Shaofeng Zhang , Yi Yu , Wenxian Yu , Junchi Yan