English
Related papers

Related papers: Enhancing Open-Vocabulary Object Detection through…

200 papers

Open-vocabulary object detection (OVD), detecting specific classes of objects using only their linguistic descriptions (e.g., class names) without any image samples, has garnered significant attention. However, in real-world applications,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Yusuke Hosoya , Masanori Suganuma , Takayuki Okatani

X-ray prohibited item detection is an essential component of security check and categories of prohibited item are continuously increasing in accordance with the latest laws. Previous works all focus on close-set scenarios, which can only…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Shuyang Lin , Tong Jia , Hao Wang , Bowen Ma , Mingyuan Li , Dongyue Chen

In recent years, aerial object detection has been increasingly pivotal in various earth observation applications. However, current algorithms are limited to detecting a set of pre-defined object categories, demanding sufficient annotated…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yan Li , Weiwei Guo , Xue Yang , Ning Liao , Shaofeng Zhang , Yi Yu , Wenxian Yu , Junchi Yan

Object detection (OD) in computer vision has made significant progress in recent years, transitioning from closed-set labels to open-vocabulary detection (OVD) based on large-scale vision-language pre-training (VLP). However, current…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Yiyang Yao , Peng Liu , Tiancheng Zhao , Qianqian Zhang , Jiajia Liao , Chunxin Fang , Kyusong Lee , Qing Wang

Existing methods enhance open-vocabulary object detection by leveraging the robust open-vocabulary recognition capabilities of Vision-Language Models (VLMs), such as CLIP.However, two main challenges emerge:(1) A deficiency in concept…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Penghui Du , Yu Wang , Yifan Sun , Luting Wang , Yue Liao , Gang Zhang , Errui Ding , Yan Wang , Jingdong Wang , Si Liu

We aim at advancing open-vocabulary object detection, which detects objects described by arbitrary text inputs. The fundamental challenge is the availability of training data. It is costly to further scale up the number of classes contained…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Xiuye Gu , Tsung-Yi Lin , Weicheng Kuo , Yin Cui

Fine-grained open-vocabulary object detection (FG-OVD) aims to detect novel object categories described by attribute-rich texts. While existing open-vocabulary detectors show promise at the base-category level, they underperform in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jiaming Li , Zhijia Liang , Weikai Chen , Lin Ma , Guanbin Li

Open-vocabulary object detection (OVD) models are considered to be Large Multi-modal Models (LMM), due to their extensive training data and a large number of parameters. Mainstream OVD models prioritize object coarse-grained category rather…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Yuqi Ma , Mengyin Liu , Chao Zhu , Xu-Cheng Yin

Classical object detectors are incapable of detecting novel class objects that are not encountered before. Regarding this issue, Open-Vocabulary Object Detection (OVOD) is proposed, which aims to detect the objects in the candidate class…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Zhao Wang , Aoxue Li , Fengwei Zhou , Zhenguo Li , Qi Dou

Prompt-OVD is an efficient and effective framework for open-vocabulary object detection that utilizes class embeddings from CLIP as prompts, guiding the Transformer decoder to detect objects in both base and novel classes. Additionally, our…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Hwanjun Song , Jihwan Bang

To address the limitations of existing open-vocabulary object recognition methods, specifically high system complexity, substantial training costs, and limited generalization, this paper proposes a novel Open-Vocabulary Object Recognition…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Wei Yu Chen , Ying Dai

Open-vocabulary object detection (OVD) has made significant progress, enabling detectors to generalize from seen to unseen categories. However, real-world category spaces continually evolve, and existing OVD models still struggle with newly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yupeng Zhang , Ruize Han , Yuzhong Feng , Zixin Ren , Yuntong Tian , Liang Wan

The video visual relation detection (VidVRD) task is to identify objects and their relationships in videos, which is challenging due to the dynamic content, high annotation costs, and long-tailed distribution of relations. Visual language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Qi Liu , Weiying Xue , Yuxiao Wang , Zhenao Wei

Open-Vocabulary Object Detection (OVOD) aims to develop the capability to detect anything. Although myriads of large-scale pre-training efforts have built versatile foundation models that exhibit impressive zero-shot capabilities to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Guiying Zhu , Bowen Yang , Yin Zhuang , Tong Zhang , Guanqun Wang , Zhihao Che , He Chen , Lianlin Li

Open-vocabulary detection (OVD) is an object detection task aiming at detecting objects from novel categories beyond the base categories on which the detector is trained. Recent OVD methods rely on large-scale visual-language pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Xiaoshi Wu , Feng Zhu , Rui Zhao , Hongsheng Li

The goal of open-vocabulary detection is to identify novel objects based on arbitrary textual descriptions. In this paper, we address open-vocabulary 3D point-cloud detection by a dividing-and-conquering strategy, which involves: 1)…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Yuheng Lu , Chenfeng Xu , Xiaobao Wei , Xiaodong Xie , Masayoshi Tomizuka , Kurt Keutzer , Shanghang Zhang

Object detection is an important task in computer vision, which aims to detect the objects of interest. through the given category list or query images. In this work, we propose a new problem of language-visual-complementary open-set object…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yupeng Zhang , Ruize Han , Wei Feng , Song Wang , Liang Wan

Recognizing and grasping novel-category objects remains a crucial yet challenging problem in real-world robotic applications. Despite its significance, limited research has been conducted in this specific domain. To address this, we…

Robotics · Computer Science 2024-07-19 Li Meng , Zhao Qi , Lyu Shuchang , Wang Chunlei , Ma Yujing , Cheng Guangliang , Yang Chenguang

The nature of diversity in real-world environments necessitates neural network models to expand from closed category settings to accommodate novel emerging categories. In this paper, we study the open-vocabulary object detection (OVD),…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Sunyuan Qiang , Xianfei Li , Yanyan Liang , Wenlong Liao , Tao He , Pai Peng

In recent years, open-vocabulary (OV) object detection has attracted increasing research attention. Unlike traditional detection, which only recognizes fixed-category objects, OV detection aims to detect objects in an open category set.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Hengcan Shi , Munawar Hayat , Jianfei Cai