English
Related papers

Related papers: From Open Vocabulary to Open World: Teaching Visio…

200 papers

Object detection is integral to a bevy of real-world applications, from robotics to medical image analysis. To be used reliably in such applications, models must be capable of handling unexpected - or novel - objects. The open world object…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Orr Zohar , Alejandro Lozano , Shelly Goel , Serena Yeung , Kuan-Chieh Wang

Traditional semi-supervised object detection methods assume a fixed set of object classes (in-distribution or ID classes) during training and deployment, which limits performance in real-world scenarios where unseen classes…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Garvita Allabadi , Ana Lucic , Siddarth Aananth , Tiffany Yang , Yu-Xiong Wang , Vikram Adve

Open World Object Detection (OWOD) is a novel and challenging computer vision task that enables object detection with the ability to detect unknown objects. Existing methods typically estimate the object likelihood with an additional…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Yulin He , Wei Chen , Yusong Tan , Siqi Wang

Open-vocabulary object detection (OVOD) aims to detect known and unknown objects in the open world by leveraging text prompts. Benefiting from the emergence of large-scale vision--language pre-trained models, OVOD has demonstrated strong…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jiaming Liang , Yifeng Zhan , Chunlin Liu , Weihua Zheng , Bingye Peng , Qiwei Liang , Boyang Cai , Xiaochun Mai , Qiang Nie

Open-vocabulary 3D object detection (OV-3DDet) aims to localize and recognize both seen and previously unseen object categories within any new 3D scene. While language and vision foundation models have achieved success in handling various…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Pengkun Jiao , Na Zhao , Jingjing Chen , Yu-Gang Jiang

Open World Object Detection (OWOD) is a new and challenging computer vision task that bridges the gap between classic object detection (OD) benchmarks and object detection in the real world. In addition to detecting and classifying…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Orr Zohar , Kuan-Chieh Wang , Serena Yeung

Open vocabulary object detection (OVD) aims at seeking an optimal object detector capable of recognizing objects from both base and novel categories. Recent advances leverage knowledge distillation to transfer insightful knowledge from…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Jiaming Li , Jiacheng Zhang , Jichang Li , Ge Li , Si Liu , Liang Lin , Guanbin Li

Humans have a natural instinct to identify unknown object instances in their environments. The intrinsic curiosity about these unknown instances aids in learning about them, when the corresponding knowledge is eventually available. This…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 K J Joseph , Salman Khan , Fahad Shahbaz Khan , Vineeth N Balasubramanian

Open-vocabulary object detection (OVOD) aims to detect the objects beyond the set of classes observed during training. This work introduces a straightforward and efficient strategy that utilizes pre-trained vision-language models (VLM),…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Shilin Xu , Xiangtai Li , Size Wu , Wenwei Zhang , Yunhai Tong , Chen Change Loy

This paper addresses the challenging problem of open-vocabulary object detection (OVOD) where an object detector must identify both seen and unseen classes in test images without labeled examples of the unseen classes in training. A typical…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Chau Pham , Truong Vu , Khoi Nguyen

Object detection is crucial for ensuring safe autonomous driving. However, data-driven approaches face challenges when encountering minority or novel objects in the 3D driving scene. In this paper, we propose VisLED, a language-driven…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Ross Greer , Bjørk Antoniussen , Andreas Møgelmose , Mohan Trivedi

Open-Vocabulary Object Detection (OVOD) aims to develop the capability to detect anything. Although myriads of large-scale pre-training efforts have built versatile foundation models that exhibit impressive zero-shot capabilities to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Guiying Zhu , Bowen Yang , Yin Zhuang , Tong Zhang , Guanqun Wang , Zhihao Che , He Chen , Lianlin Li

We address the challenging problem of open world object detection (OWOD), where object detectors must identify objects from known classes while also identifying and continually learning to detect novel objects. Prior work has resulted in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 David Pershouse , Feras Dayoub , Dimity Miller , Niko Sünderhauf

Open-Set Object Detection (OSOD) has emerged as a contemporary research direction to address the detection of unknown objects. Recently, few works have achieved remarkable performance in the OSOD task by employing contrastive clustering to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Hiran Sarkar , Vishal Chudasama , Naoyuki Onoe , Pankaj Wasnik , Vineeth N Balasubramanian

We introduce One-shot Open Affordance Learning (OOAL), where a model is trained with just one example per base object category, but is expected to identify novel objects and affordances. While vision-language models excel at recognizing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Gen Li , Deqing Sun , Laura Sevilla-Lara , Varun Jampani

Object detection is a pivotal task in computer vision that has received significant attention in previous years. Nonetheless, the capability of a detector to localise objects out of the training distribution remains unexplored. Whilst…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Brian K. S. Isaac-Medina , Yona Falinie A. Gaus , Neelanjan Bhowmik , Toby P. Breckon

Open world object detection aims at detecting objects that are absent in the object classes of the training data as unknown objects without explicit supervision. Furthermore, the exact classes of the unknown objects must be identified…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Na Dong , Yongqiang Zhang , Mingli Ding , Gim Hee Lee

Despite great progress in object detection, most existing methods work only on a limited set of object categories, due to the tremendous human effort needed for bounding-box annotations of training data. To alleviate the problem, recent…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Mingfei Gao , Chen Xing , Juan Carlos Niebles , Junnan Li , Ran Xu , Wenhao Liu , Caiming Xiong

Classical object detectors are incapable of detecting novel class objects that are not encountered before. Regarding this issue, Open-Vocabulary Object Detection (OVOD) is proposed, which aims to detect the objects in the candidate class…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Zhao Wang , Aoxue Li , Fengwei Zhou , Zhenguo Li , Qi Dou

Open-world object detection (OWOD), as a more general and challenging goal, requires the model trained from data on known objects to detect both known and unknown objects and incrementally learn to identify these unknown objects. The…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Shuailei Ma , Yuefeng Wang , Jiaqi Fan , Ying Wei , Thomas H. Li , Hongli Liu , Fanbing Lv