English
Related papers

Related papers: DitHub: A Modular Framework for Incremental Open-V…

200 papers

Open-vocabulary detection (OVD) is a new object detection paradigm, aiming to localize and recognize unseen objects defined by an unbounded vocabulary. This is challenging since traditional detectors can only learn from pre-defined…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Jincheng Li , Chunyu Xie , Xiaoyu Wu , Bin Wang , Dawei Leng

Out-of-distribution (OOD) object detection is a critical task focused on detecting objects that originate from a data distribution different from that of the training data. In this study, we investigate to what extent state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Sadia Ilyas , Ido Freeman , Matthias Rottmann

In this work, we propose an open-vocabulary object detection method that, based on image-caption pairs, learns to detect novel object classes along with a given set of known classes. It is a two-stage training approach that first uses a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Maria A. Bravo , Sudhanshu Mittal , Thomas Brox

Object detection has been expanded from a limited number of categories to open vocabulary. Moving forward, a complete intelligent vision system requires understanding more fine-grained object descriptions, object parts. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Peize Sun , Shoufa Chen , Chenchen Zhu , Fanyi Xiao , Ping Luo , Saining Xie , Zhicheng Yan

Recent advancements in large vision-language models enabled visual object detection in open-vocabulary scenarios, where object classes are defined in free-text formats during inference. In this paper, we aim to probe the state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Lorenzo Bianchi , Fabio Carrara , Nicola Messina , Claudio Gennaro , Fabrizio Falchi

Open-vocabulary object detection, which is concerned with the problem of detecting novel objects guided by natural language, has gained increasing attention from the community. Ideally, we would like to extend an open-vocabulary detector…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Yuhang Zang , Wei Li , Kaiyang Zhou , Chen Huang , Chen Change Loy

Detecting objects based on language information is a popular task that includes Open-Vocabulary object Detection (OVD) and Referring Expression Comprehension (REC). In this paper, we advance them to a more practical setting called Described…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Chi Xie , Zhao Zhang , Yixuan Wu , Feng Zhu , Rui Zhao , Shuang Liang

Open World Object Detection(OWOD) addresses realistic scenarios where unseen object classes emerge, enabling detectors trained on known classes to detect unknown objects and incrementally incorporate the knowledge they provide. While…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Sunoh Lee , Minsik Jeon , Jihong Min , Junwon Seo

Open-vocabulary object detection aims to detect arbitrary classes via text prompts. Methods without cross-modal fusion layers (non-fusion) offer faster inference by treating recognition as a retrieval problem, \ie, matching regions to text…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Shenghao Fu , Yukun Su , Fengyun Rao , Jing Lyu , Xiaohua Xie , Wei-Shi Zheng

Open-vocabulary object detection (OVOD) aims to detect known and unknown objects in the open world by leveraging text prompts. Benefiting from the emergence of large-scale vision--language pre-trained models, OVOD has demonstrated strong…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jiaming Liang , Yifeng Zhan , Chunlin Liu , Weihua Zheng , Bingye Peng , Qiwei Liang , Boyang Cai , Xiaochun Mai , Qiang Nie

3D object detection plays a crucial role in autonomous systems, yet existing methods are limited by closed-set assumptions and struggle to recognize novel objects and their attributes in real-world scenarios. We propose OVODA, a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xinhao Xiang , Kuan-Chuan Peng , Suhas Lohit , Michael J. Jones , Jiawei Zhang

Enabling models to recognize vast open-world categories has been a longstanding pursuit in object detection. By leveraging the generalization capabilities of vision-language models, current open-world detectors can recognize a broader range…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yitong Chen , Wenhao Yao , Lingchen Meng , Sihong Wu , Zuxuan Wu , Yu-Gang Jiang

Traditional object detection models in medical imaging operate within a closed-set paradigm, limiting their ability to detect objects of novel labels. Open-vocabulary object detection (OVOD) addresses this limitation but remains…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Tooba Tehreem Sheikh , Jean Lahoud , Rao Muhammad Anwer , Fahad Shahbaz Khan , Salman Khan , Hisham Cholakkal

This paper addresses the challenging problem of open-vocabulary object detection (OVOD) where an object detector must identify both seen and unseen classes in test images without labeled examples of the unseen classes in training. A typical…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Chau Pham , Truong Vu , Khoi Nguyen

An object detector's ability to detect and flag \textit{novel} objects during open-world deployments is critical for many real-world applications. Unfortunately, much of the work in open object detection today is disjointed and fails to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Matthew Inkawhich , Nathan Inkawhich , Hao Yang , Jingyang Zhang , Randolph Linderman , Yiran Chen

Open-vocabulary object detection focusing on detecting novel categories guided by natural language. In this report, we propose Open-Vocabulary Light-Weighted Detection Transformer (OVLW-DETR), a deployment friendly open-vocabulary detector…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yu Wang , Xiangbo Su , Qiang Chen , Xinyu Zhang , Teng Xi , Kun Yao , Errui Ding , Gang Zhang , Jingdong Wang

In this paper, we for the first time explore helpful multi-modal contextual knowledge to understand novel categories for open-vocabulary object detection (OVD). The multi-modal contextual knowledge stands for the joint relationship across…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Yifan Xu , Mengdan Zhang , Xiaoshan Yang , Changsheng Xu

Despite the growing interest in open-vocabulary object detection in recent years, most existing methods rely heavily on manually curated fine-grained training datasets as well as resource-intensive layer-wise cross-modal feature extraction.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Hao Zhang , Yiqun Wang , Qinran Lin , Runze Fan , Yong Li

Open-vocabulary object detection (OVOD) aims to detect the objects beyond the set of classes observed during training. This work introduces a straightforward and efficient strategy that utilizes pre-trained vision-language models (VLM),…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Shilin Xu , Xiangtai Li , Size Wu , Wenwei Zhang , Yunhai Tong , Chen Change Loy

Traditional object detection methods operate under the closed-set assumption, where models can only detect a fixed number of objects predefined in the training set. Recent works on open vocabulary object detection (OVD) enable the detection…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Zizhao Li , Zhengkang Xiang , Joseph West , Kourosh Khoshelham