English
Related papers

Related papers: Open-Vocabulary Object Detection with Meta Prompt …

200 papers

Open-Vocabulary Object Detection (OVOD) aims to enable detectors to generalize across categories by leveraging semantic information. Although existing methods are pretrained on large vision-language datasets, their inference is still…

Artificial Intelligence · Computer Science 2026-04-21 Chujie Wang , Jianyu Lu , Zhiyuan Luo , Xi Chen , Chu He

In a real-world setting, object instances from new classes can be continuously encountered by object detectors. When existing object detectors are applied to such scenarios, their performance on old classes deteriorates significantly. A few…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 K J Joseph , Jathushan Rajasegaran , Salman Khan , Fahad Shahbaz Khan , Vineeth N Balasubramanian

To break through the limitations of pre-training models on fixed categories, Open-Set Object Detection (OSOD) and Open-Set Segmentation (OSS) have attracted a surge of interest from researchers. Inspired by large language models, mainstream…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jinrong Zhang , Penghui Wang , Chunxiao Liu , Wei Liu , Dian Jin , Qiong Zhang , Erli Meng , Zhengnan Hu

Vision-language models (VLMs) offer flexible object detection through natural language prompts but suffer from performance variability depending on prompt phrasing. In this paper, we introduce a method for automated prompt refinement using…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Lucas Choi , Ross Greer

Open-vocabulary detection (OVD) is a challenging task to detect and classify objects from an unrestricted set of categories, including those unseen during training. Existing open-vocabulary detectors are limited by complex visual-textual…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Caixiong Li , Xiongwei Zhao , Jinhang Zhang , Xing Zhang , Qihao Sun , Zhou Wu

Open-world object detection (OWOD) is a challenging computer vision problem, where the task is to detect a known set of object categories while simultaneously identifying unknown objects. Additionally, the model must incrementally learn new…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Akshita Gupta , Sanath Narayan , K J Joseph , Salman Khan , Fahad Shahbaz Khan , Mubarak Shah

Detecting Out-of-Domain (OOD) or unknown intents from user queries is essential in a task-oriented dialog system. A key challenge of OOD detection is to learn discriminative semantic features. Traditional cross-entropy loss only focuses on…

Computation and Language · Computer Science 2021-06-01 Zhiyuan Zeng , Keqing He , Yuanmeng Yan , Zijun Liu , Yanan Wu , Hong Xu , Huixing Jiang , Weiran Xu

Object detection (OD) in computer vision has made significant progress in recent years, transitioning from closed-set labels to open-vocabulary detection (OVD) based on large-scale vision-language pre-training (VLP). However, current…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Yiyang Yao , Peng Liu , Tiancheng Zhao , Qianqian Zhang , Jiajia Liao , Chunxin Fang , Kyusong Lee , Qing Wang

To identify objects beyond predefined categories, open-vocabulary aerial object detection (OVAD) leverages the zero-shot capabilities of visual-language models (VLMs) to generalize from base to novel categories. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Jianhang Yao , Yongbin Zheng , Siqi Lu , Wanying Xu , Peng Sun

Open-vocabulary object detection (OVD) aims to recognize and localize object categories beyond the training set. Recent approaches leverage vision-language models to generate pseudo-labels using image-text alignment, allowing detectors to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Hojun Choi , Youngsun Lim , Jaeyo Shin , Hyunjung Shim

Open-vocabulary object detection in remote sensing commonly relies on text-only prompting to specify target categories, implicitly assuming that inference-time category queries can be reliably grounded through pretraining-induced…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Shuai Yang , Ziyue Huang , Jiaxin Chen , Qingjie Liu , Yunhong Wang

Detecting objects based on language information is a popular task that includes Open-Vocabulary object Detection (OVD) and Referring Expression Comprehension (REC). In this paper, we advance them to a more practical setting called Described…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Chi Xie , Zhao Zhang , Yixuan Wu , Feng Zhu , Rui Zhao , Shuang Liang

We propose and study open-vocabulary monocular 3D detection, a novel task that aims to detect objects of any categores in metric 3D space from a single RGB image. Existing 3D object detectors either rely on costly sensors such as LiDAR or…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jin Yao , Hao Gu , Xuweiyi Chen , Jiayun Wang , Zezhou Cheng

Open-vocabulary object detection (OVOD) enables models to recognize objects beyond predefined categories, but existing approaches remain limited in practical deployment. On the one hand, multimodal designs often incur substantial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Siheng Wang , Yanshu Li , Bohan Hu , Zhengdao Li , Haibo Zhan , Linshan Li , Weiming Liu , Ruizhi Qian , Guangxin Wu , Hao Zhang , Jifeng Shen , Piotr Koniusz , Zhengtao Yao , Junhao Dong , Qiang Sun

Visual prompted object detection enables interactive and flexible definition of target categories, thereby facilitating open-vocabulary detection. Since visual prompts are derived directly from image features, they often outperform text…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Bo Qian , Dahu Shi , Xing Wei

Zero-shot out-of-vocabulary detection (ZS-OOVD) aims to accurately recognize objects of in-vocabulary (IV) categories provided at zero-shot inference, while simultaneously rejecting undefined ones (out-of-vocabulary, OOV) that lack…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Binyi Su , Chenghao Huang , Haiyong Chen

Open-World Object Detection (OWOD) enriches traditional object detectors by enabling continual discovery and integration of unknown objects via human guidance. However, existing OWOD approaches frequently suffer from semantic confusion…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Anay Majee , Amitesh Gangrade , Rishabh Iyer

Open-vocabulary object detectors (OVODs) unify vision and language to detect arbitrary object categories based on text prompts, enabling strong zero-shot generalization to novel concepts. As these models gain traction in high-stakes…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Ankita Raj , Chetan Arora

Recent advancements in 3D object detection and novel category detection have made significant progress, yet research on learning generalized 3D objectness remains insufficient. In this paper, we delve into learning open-world 3D objectness,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Taichi Liu , Zhenyu Wang , Ruofeng Liu , Guang Wang , Desheng Zhang

The nature of diversity in real-world environments necessitates neural network models to expand from closed category settings to accommodate novel emerging categories. In this paper, we study the open-vocabulary object detection (OVD),…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Sunyuan Qiang , Xianfei Li , Yanyan Liang , Wenlong Liao , Tao He , Pai Peng