English
Related papers

Related papers: Towards Open-Vocabulary Multimodal 3D Object Detec…

200 papers

The ability to interpret and comprehend a 3D scene is essential for many vision and robotics systems. In numerous applications, this involves 3D object detection, i.e.~identifying the location and dimensions of objects belonging to a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Olivier Moliner , Viktor Larsson , Kalle Åström

Despite weakly supervised object detection (WSOD) being a promising step toward evading strong instance-level annotations, its capability is confined to closed-set categories within a single training dataset. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Jianghang Lin , Yunhang Shen , Bingquan Wang , Shaohui Lin , Ke Li , Liujuan Cao

Open-vocabulary object detection (OVD), detecting specific classes of objects using only their linguistic descriptions (e.g., class names) without any image samples, has garnered significant attention. However, in real-world applications,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Yusuke Hosoya , Masanori Suganuma , Takayuki Okatani

Traditional object detection systems are typically constrained to predefined categories, limiting their applicability in dynamic environments. In contrast, open-vocabulary object detection (OVD) enables the identification of objects from…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Tianyi Zhang , Antoine Simoulin , Kai Li , Sana Lakdawala , Shiqing Yu , Arpit Mittal , Hongyu Fu , Yu Lin

Modern 3D object detection datasets are constrained by narrow class taxonomies and costly manual annotations, limiting their ability to scale to open-world settings. In contrast, 2D vision-language models trained on web-scale image-text…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Atharv Goel , Mehar Khurana

Open-vocabulary object detection (OVOD) aims to detect the objects beyond the set of classes observed during training. This work introduces a straightforward and efficient strategy that utilizes pre-trained vision-language models (VLM),…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Shilin Xu , Xiangtai Li , Size Wu , Wenwei Zhang , Yunhai Tong , Chen Change Loy

The goal of open-vocabulary detection is to identify novel objects based on arbitrary textual descriptions. In this paper, we address open-vocabulary 3D point-cloud detection by a dividing-and-conquering strategy, which involves: 1)…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Yuheng Lu , Chenfeng Xu , Xiaobao Wei , Xiaodong Xie , Masayoshi Tomizuka , Kurt Keutzer , Shanghang Zhang

3D multi-object tracking plays a critical role in autonomous driving by enabling the real-time monitoring and prediction of multiple objects' movements. Traditional 3D tracking systems are typically constrained by predefined object…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Ayesha Ishaq , Mohamed El Amine Boudjoghra , Jean Lahoud , Fahad Shahbaz Khan , Salman Khan , Hisham Cholakkal , Rao Muhammad Anwer

Object detection traditionally relies on fixed category sets, requiring costly re-training to handle novel objects. While Open-World and Open-Vocabulary Object Detection (OWOD and OVOD) improve flexibility, OWOD lacks semantic labels for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Furkan Mumcu , Michael J. Jones , Anoop Cherian , Yasin Yilmaz

Object detection is integral to a bevy of real-world applications, from robotics to medical image analysis. To be used reliably in such applications, models must be capable of handling unexpected - or novel - objects. The open world object…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Orr Zohar , Alejandro Lozano , Shelly Goel , Serena Yeung , Kuan-Chieh Wang

Open-vocabulary detectors are proposed to locate and recognize objects in novel classes. However, variations in vision-aware language vocabulary data used for open-vocabulary learning can lead to unfair and unreliable evaluations. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Ying Liu , Yijing Hua , Haojiang Chai , Yanbo Wang , TengQi Ye

Open-vocabulary 3D object detection (OV-3Det) aims to generalize beyond the limited number of base categories labeled during the training phase. The biggest bottleneck is the scarcity of annotated 3D data, whereas 2D image datasets are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Timing Yang , Yuanliang Ju , Li Yi

An increasingly massive number of remote-sensing images spurs the development of extensible object detectors that can detect objects beyond training categories without costly collecting new labeled data. In this paper, we aim to develop…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yan Li , Weiwei Guo , Xue Yang , Ning Liao , Dunyun He , Jiaqi Zhou , Wenxian Yu

In this work, we tackle the limitations of current LiDAR-based 3D object detection systems, which are hindered by a restricted class vocabulary and the high costs associated with annotating new object classes. Our exploration of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Djamahl Etchegaray , Zi Huang , Tatsuya Harada , Yadan Luo

In recent years, aerial object detection has been increasingly pivotal in various earth observation applications. However, current algorithms are limited to detecting a set of pre-defined object categories, demanding sufficient annotated…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yan Li , Weiwei Guo , Xue Yang , Ning Liao , Shaofeng Zhang , Yi Yu , Wenxian Yu , Junchi Yan

This paper addresses the challenging problem of open-vocabulary object detection (OVOD) where an object detector must identify both seen and unseen classes in test images without labeled examples of the unseen classes in training. A typical…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Chau Pham , Truong Vu , Khoi Nguyen

The nature of diversity in real-world environments necessitates neural network models to expand from closed category settings to accommodate novel emerging categories. In this paper, we study the open-vocabulary object detection (OVD),…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Sunyuan Qiang , Xianfei Li , Yanyan Liang , Wenlong Liao , Tao He , Pai Peng

Open-vocabulary 3D object detection has recently attracted considerable attention due to its broad applications in autonomous driving and robotics, which aims to effectively recognize novel classes in previously unseen domains. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Rui Huang , Henry Zheng , Yan Wang , Zhuofan Xia , Marco Pavone , Gao Huang

Open-Vocabulary Object Detection (OVOD) aims to enable detectors to generalize across categories by leveraging semantic information. Although existing methods are pretrained on large vision-language datasets, their inference is still…

Artificial Intelligence · Computer Science 2026-04-21 Chujie Wang , Jianyu Lu , Zhiyuan Luo , Xi Chen , Chu He

Traditional LiDAR-based object detection research primarily focuses on closed-set scenarios, which falls short in complex real-world applications. Directly transferring existing 2D open-vocabulary models with some known LiDAR classes for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Hu Zhang , Jianhua Xu , Tao Tang , Haiyang Sun , Xin Yu , Zi Huang , Kaicheng Yu