English
Related papers

Related papers: Open Vocabulary Object Detection with Proposal Min…

200 papers

In this work, we tackle the limitations of current LiDAR-based 3D object detection systems, which are hindered by a restricted class vocabulary and the high costs associated with annotating new object classes. Our exploration of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Djamahl Etchegaray , Zi Huang , Tatsuya Harada , Yadan Luo

Open-Vocabulary Object Detection (OVOD) aims to detect novel objects beyond a given set of base categories on which the detection model is trained. Recent OVOD methods focus on adapting the image-level pre-trained vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Ruohuan Fang , Guansong Pang , Xiao Bai

Open-vocabulary object detection (OVD) models are considered to be Large Multi-modal Models (LMM), due to their extensive training data and a large number of parameters. Mainstream OVD models prioritize object coarse-grained category rather…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Yuqi Ma , Mengyin Liu , Chao Zhu , Xu-Cheng Yin

Open-vocabulary object detection aims to recognize objects from an open set of categories, which leverages vision-language models (VLMs) pre-trained on large-scale image-text data. The cooperative paradigm combines an object detector with a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Yazhe Wan , Changjae Oh

Recent vision-language pre-trained models (VL-PTMs) have shown remarkable success in open-vocabulary tasks. However, downstream use cases often involve further fine-tuning of VL-PTMs, which may distort their general knowledge and impair…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Lin Zhu , Yifeng Yang , Qinying Gu , Xinbing Wang , Chenghu Zhou , Nanyang Ye

Open-vocabulary detectors are proposed to locate and recognize objects in novel classes. However, variations in vision-aware language vocabulary data used for open-vocabulary learning can lead to unfair and unreliable evaluations. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Ying Liu , Yijing Hua , Haojiang Chai , Yanbo Wang , TengQi Ye

An increasingly massive number of remote-sensing images spurs the development of extensible object detectors that can detect objects beyond training categories without costly collecting new labeled data. In this paper, we aim to develop…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yan Li , Weiwei Guo , Xue Yang , Ning Liao , Dunyun He , Jiaqi Zhou , Wenxian Yu

Open-vocabulary object detection (OVD) has been studied with Vision-Language Models (VLMs) to detect novel objects beyond the pre-trained categories. Previous approaches improve the generalization ability to expand the knowledge of the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Jooyeon Kim , Eulrang Cho , Sehyung Kim , Hyunwoo J. Kim

Learning from pseudo-labels that generated with VLMs~(Vision Language Models) has been shown as a promising solution to assist open vocabulary detection (OVD) in recent studies. However, due to the domain gap between VLM and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Kuo Wang , Lechao Cheng , Weikai Chen , Pingping Zhang , Liang Lin , Fan Zhou , Guanbin Li

The goal of open-vocabulary detection is to identify novel objects based on arbitrary textual descriptions. In this paper, we address open-vocabulary 3D point-cloud detection by a dividing-and-conquering strategy, which involves: 1)…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Yuheng Lu , Chenfeng Xu , Xiaobao Wei , Xiaodong Xie , Masayoshi Tomizuka , Kurt Keutzer , Shanghang Zhang

In this paper, we for the first time explore helpful multi-modal contextual knowledge to understand novel categories for open-vocabulary object detection (OVD). The multi-modal contextual knowledge stands for the joint relationship across…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Yifan Xu , Mengdan Zhang , Xiaoshan Yang , Changsheng Xu

Open-Vocabulary Object Detection (OVOD) aims to develop the capability to detect anything. Although myriads of large-scale pre-training efforts have built versatile foundation models that exhibit impressive zero-shot capabilities to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Guiying Zhu , Bowen Yang , Yin Zhuang , Tong Zhang , Guanqun Wang , Zhihao Che , He Chen , Lianlin Li

Object detection is an important task in computer vision, which aims to detect the objects of interest. through the given category list or query images. In this work, we propose a new problem of language-visual-complementary open-set object…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yupeng Zhang , Ruize Han , Wei Feng , Song Wang , Liang Wan

Inspired by the success of vision-language methods (VLMs) in zero-shot classification, recent works attempt to extend this line of work into object detection by leveraging the localization ability of pre-trained VLMs and generating pseudo…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Yanxin Long , Jianhua Han , Runhui Huang , Xu Hang , Yi Zhu , Chunjing Xu , Xiaodan Liang

Open-vocabulary object perception has become an important topic in artificial intelligence, which aims to identify objects with novel classes that have not been seen during training. Under this setting, open-vocabulary object detection…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Haiji Liang , Ruize Han

We aim at advancing open-vocabulary object detection, which detects objects described by arbitrary text inputs. The fundamental challenge is the availability of training data. It is costly to further scale up the number of classes contained…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Xiuye Gu , Tsung-Yi Lin , Weicheng Kuo , Yin Cui

Open vocabulary object detection has been greatly advanced by the recent development of vision-language pretrained model, which helps recognize novel objects with only semantic categories. The prior works mainly focus on knowledge…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Tao Wang , Nan Li

Vision-language models such as CLIP have boosted the performance of open-vocabulary object detection, where the detector is trained on base categories but required to detect novel categories. Existing methods leverage CLIP's strong…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Cheng Shi , Sibei Yang

Open-vocabulary object detection (OVD) has made significant progress, enabling detectors to generalize from seen to unseen categories. However, real-world category spaces continually evolve, and existing OVD models still struggle with newly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yupeng Zhang , Ruize Han , Yuzhong Feng , Zixin Ren , Yuntong Tian , Liang Wan

Point cloud-based open-vocabulary 3D object detection aims to detect 3D categories that do not have ground-truth annotations in the training set. It is extremely challenging because of the limited data and annotations (bounding boxes with…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Chenming Zhu , Wenwei Zhang , Tai Wang , Xihui Liu , Kai Chen