English
Related papers

Related papers: Towards Open-Vocabulary Multimodal 3D Object Detec…

200 papers

Open-Vocabulary Segmentation (OVS) methods offer promising capabilities in detecting unseen object categories, but the category must be known and needs to be provided by a human, either via a text prompt or pre-labeled datasets, thus…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Weijie Wei , Osman Ülger , Fatemeh Karimi Nejadasl , Theo Gevers , Martin R. Oswald

3D object detection is fundamental for spatial understanding. Real-world environments demand models capable of recognizing diverse, previously unseen objects, which remains a major limitation of closed-set methods. Existing open-vocabulary…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Andrey Lemeshko , Bulat Gabdullin , Nikita Drozdov , Anton Konushin , Danila Rukhovich , Maksim Kolodiazhnyi

Remote sensing object detection has made significant progress, but most studies still focus on closed-set detection, limiting generalization across diverse datasets. Open-vocabulary object detection (OVD) provides a solution by leveraging…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Ziyue Huang , Yongchao Feng , Shuai Yang , Ziqi Liu , Qingjie Liu , Yunhong Wang

In the current state of 3D object detection research, the severe scarcity of annotated 3D data, substantial disparities across different data modalities, and the absence of a unified architecture, have impeded the progress towards the goal…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Zhenyu Wang , Yali Li , Taichi Liu , Hengshuang Zhao , Shengjin Wang

Open-vocabulary object detection (OVD) aims to detect objects beyond the training annotations, where detectors are usually aligned to a pre-trained vision-language model, eg, CLIP, to inherit its generalizable recognition ability so that…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Shenghao Fu , Junkai Yan , Qize Yang , Xihan Wei , Xiaohua Xie , Wei-Shi Zheng

Fine-grained open-vocabulary object detection (FG-OVD) aims to detect novel object categories described by attribute-rich texts. While existing open-vocabulary detectors show promise at the base-category level, they underperform in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jiaming Li , Zhijia Liang , Weikai Chen , Lin Ma , Guanbin Li

In this paper, we consider the problem of simultaneously detecting objects and inferring their visual attributes in an image, even for those with no manual annotations provided at the training stage, resembling an open-vocabulary scenario.…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Keyan Chen , Xiaolong Jiang , Yao Hu , Xu Tang , Yan Gao , Jianqi Chen , Weidi Xie

Recent advancements in 3D object detection and novel category detection have made significant progress, yet research on learning generalized 3D objectness remains insufficient. In this paper, we delve into learning open-world 3D objectness,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Taichi Liu , Zhenyu Wang , Ruofeng Liu , Guang Wang , Desheng Zhang

In this work, we address the challenging and emergent problem of novel object detection (NOD), focusing on the accurate detection of both known and novel object categories during inference. Traditional object detection algorithms are…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Rohit Bharadwaj , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan

Open World Object Detection(OWOD) addresses realistic scenarios where unseen object classes emerge, enabling detectors trained on known classes to detect unknown objects and incrementally incorporate the knowledge they provide. While…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Sunoh Lee , Minsik Jeon , Jihong Min , Junwon Seo

Open-vocabulary object detection (OVOD) aims to detect both seen and unseen categories, yet existing methods often struggle to generalize to novel objects due to limited integration of global and local contextual cues. We propose…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Soichiro Okazaki , Tatsuya Sasaki , Hiroki Ohashi

Aerial object detection plays a crucial role in numerous applications. However, most existing methods focus on detecting predefined object categories, limiting their applicability in real-world open scenarios. In this paper, we extend…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Guoting Wei , Xia Yuan , Yu Liu , Zhenhao Shang , Xizhe Xue , Peng Wang , Kelu Yao , Chunxia Zhao , Haokui Zhang , Rong Xiao

Prompt-OVD is an efficient and effective framework for open-vocabulary object detection that utilizes class embeddings from CLIP as prompts, guiding the Transformer decoder to detect objects in both base and novel classes. Additionally, our…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Hwanjun Song , Jihwan Bang

Open-vocabulary object detection (OVOD) enables models to recognize objects beyond predefined categories, but existing approaches remain limited in practical deployment. On the one hand, multimodal designs often incur substantial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Siheng Wang , Yanshu Li , Bohan Hu , Zhengdao Li , Haibo Zhan , Linshan Li , Weiming Liu , Ruizhi Qian , Guangxin Wu , Hao Zhang , Jifeng Shen , Piotr Koniusz , Zhengtao Yao , Junhao Dong , Qiang Sun

Open-vocabulary multi-object tracking (OVMOT) represents a critical new challenge involving the detection and tracking of diverse object categories in videos, encompassing both seen categories (base classes) and unseen categories (novel…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Zekun Qian , Ruize Han , Junhui Hou , Linqi Song , Wei Feng

Open-Vocabulary Object Detection (OVD) models break the limitations of closed-set detection, enabling the iden- tification of unseen categories through natural language prompts. However, they exhibit notable limitations in fine- grained…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Donghong Jiang , Endian Lin , Hanqing Liu , Mingjie Liu , Luoping Cui , Zhao Yang , Chuang Zhu

Despite the remarkable progress in open-vocabulary object detection (OVD), a significant gap remains between the training and testing phases. During training, the RPN and RoI heads often misclassify unlabeled novel-category objects as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yupeng Zhang , Ruize Han , Zhiwei Chen , Wei Feng , Liang Wan

An object detector's ability to detect and flag \textit{novel} objects during open-world deployments is critical for many real-world applications. Unfortunately, much of the work in open object detection today is disjointed and fails to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Matthew Inkawhich , Nathan Inkawhich , Hao Yang , Jingyang Zhang , Randolph Linderman , Yiran Chen

Open-vocabulary detection (OVD) is an object detection task aiming at detecting objects from novel categories beyond the base categories on which the detector is trained. Recent OVD methods rely on large-scale visual-language pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Xiaoshi Wu , Feng Zhu , Rui Zhao , Hongsheng Li

Open-vocabulary 3D object detection (OV-3DOD) aims at localizing and classifying novel objects beyond closed sets. The recent success of vision-language models (VLMs) has demonstrated their remarkable capabilities to understand open…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Youjun Zhao , Jiaying Lin , Rynson W. H. Lau