English
Related papers

Related papers: VK-Det: Visual Knowledge Guided Prototype Learning…

200 papers

Open-vocabulary object detection (OVD) enables zero-shot recognition of novel categories through vision-language models, achieving strong performance on natural images. However, transferability to aerial imagery remains unexplored. We…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Christos Tsourveloudis

Open-vocabulary 3D object detection methods are able to localize 3D boxes of classes unseen during training. Despite the name, existing methods rely on user-specified classes both at training and inference. We propose to study…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Haomeng Zhang , Kuan-Chuan Peng , Suhas Lohit , Raymond A. Yeh

Mobile robots rely on object detectors for perception and object localization in indoor environments. However, standard closed-set methods struggle to handle the diverse objects and dynamic conditions encountered in real homes and labs.…

Robotics · Computer Science 2025-06-30 Xiangyu Shi , Yanyuan Qiao , Lingqiao Liu , Feras Dayoub

Open-vocabulary detection aims to detect objects from novel categories beyond the base categories on which the detector is trained. However, existing open-vocabulary detectors trained on base category data tend to assign higher confidence…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Junjie Wang , Bin Chen , Bin Kang , Yulin Li , YiChi Chen , Weizhi Xian , Huifeng Chang , Yong Xu

This paper presents DetCLIPv2, an efficient and scalable training framework that incorporates large-scale image-text pairs to achieve open-vocabulary object detection (OVD). Unlike previous OVD frameworks that typically rely on a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Lewei Yao , Jianhua Han , Xiaodan Liang , Dan Xu , Wei Zhang , Zhenguo Li , Hang Xu

Object detection (OD) in computer vision has made significant progress in recent years, transitioning from closed-set labels to open-vocabulary detection (OVD) based on large-scale vision-language pre-training (VLP). However, current…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Yiyang Yao , Peng Liu , Tiancheng Zhao , Qianqian Zhang , Jiajia Liao , Chunxin Fang , Kyusong Lee , Qing Wang

Despite weakly supervised object detection (WSOD) being a promising step toward evading strong instance-level annotations, its capability is confined to closed-set categories within a single training dataset. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Jianghang Lin , Yunhang Shen , Bingquan Wang , Shaohui Lin , Ke Li , Liujuan Cao

Traditional object detection models are typically trained on a fixed set of classes, limiting their flexibility and making it costly to incorporate new categories. Open-vocabulary object detection addresses this limitation by enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Jyoti Kini , Rohit Gupta , Mubarak Shah

Inspired by the outstanding zero-shot capability of vision language models (VLMs) in image classification tasks, open-vocabulary object detection has attracted increasing interest by distilling the broad VLM knowledge into detector…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Sheng Jin , Xueying Jiang , Jiaxing Huang , Lewei Lu , Shijian Lu

Vision-language modeling has enabled open-vocabulary tasks where predictions can be queried using any text prompt in a zero-shot manner. Existing open-vocabulary tasks focus on object classes, whereas research on object attributes is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 María A. Bravo , Sudhanshu Mittal , Simon Ging , Thomas Brox

3D object detection plays a crucial role in autonomous systems, yet existing methods are limited by closed-set assumptions and struggle to recognize novel objects and their attributes in real-world scenarios. We propose OVODA, a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xinhao Xiang , Kuan-Chuan Peng , Suhas Lohit , Michael J. Jones , Jiawei Zhang

Recently, vision-language pre-training shows great potential in open-vocabulary object detection, where detectors trained on base classes are devised for detecting new classes. The class text embedding is firstly generated by feeding…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yu Du , Fangyun Wei , Zihe Zhang , Miaojing Shi , Yue Gao , Guoqi Li

Open-vocabulary 3D Object Detection (OV-3DDet) aims to detect objects from an arbitrary list of categories within a 3D scene, which remains seldom explored in the literature. There are primarily two fundamental problems in OV-3DDet, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Yang Cao , Yihan Zeng , Hang Xu , Dan Xu

Open-vocabulary object detection focusing on detecting novel categories guided by natural language. In this report, we propose Open-Vocabulary Light-Weighted Detection Transformer (OVLW-DETR), a deployment friendly open-vocabulary detector…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yu Wang , Xiangbo Su , Qiang Chen , Xinyu Zhang , Teng Xi , Kun Yao , Errui Ding , Gang Zhang , Jingdong Wang

In this work, we tackle the limitations of current LiDAR-based 3D object detection systems, which are hindered by a restricted class vocabulary and the high costs associated with annotating new object classes. Our exploration of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Djamahl Etchegaray , Zi Huang , Tatsuya Harada , Yadan Luo

Existing open-vocabulary object detectors typically enlarge their vocabulary sizes by leveraging different forms of weak supervision. This helps generalize to novel objects at inference. Two popular forms of weak-supervision used in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Hanoona Rasheed , Muhammad Maaz , Muhammad Uzair Khattak , Salman Khan , Fahad Shahbaz Khan

Open-vocabulary detection (OVD) is an object detection task aiming at detecting objects from novel categories beyond the base categories on which the detector is trained. Recent OVD methods rely on large-scale visual-language pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Xiaoshi Wu , Feng Zhu , Rui Zhao , Hongsheng Li

As the most fundamental scene understanding tasks, object detection and segmentation have made tremendous progress in deep learning era. Due to the expensive manual labeling cost, the annotated categories in existing datasets are often…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Chaoyang Zhu , Long Chen

The nature of diversity in real-world environments necessitates neural network models to expand from closed category settings to accommodate novel emerging categories. In this paper, we study the open-vocabulary object detection (OVD),…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Sunyuan Qiang , Xianfei Li , Yanyan Liang , Wenlong Liao , Tao He , Pai Peng

Open-vocabulary 3D Object Detection (OV-3DDet) addresses the detection of objects from an arbitrary list of novel categories in 3D scenes, which remains a very challenging problem. In this work, we propose CoDAv2, a unified framework…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yang Cao , Yihan Zeng , Hang Xu , Dan Xu