English
Related papers

Related papers: Open-Vocabulary Object Detection Using Captions

200 papers

In this work, we present a novel and effective framework to facilitate object detection with the instance-level segmentation information that is only supervised by bounding box annotation. Starting from the joint object detection and…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Xiangyun Zhao , Shuang Liang , Yichen Wei

Weakly supervised segmentation methods using bounding box annotations focus on obtaining a pixel-level mask from each box containing an object. Existing methods typically depend on a class-agnostic mask generator, which operates on the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Jungbeom Lee , Jihun Yi , Chaehun Shin , Sungroh Yoon

The current trend in object detection and localization is to learn predictions with high capacity deep neural networks trained on a very large amount of annotated data and using a high amount of processing power. In this work, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Bastien Moysset , Christoper Kermorvant , Christian Wolf

Rotated bounding boxes drastically reduce output ambiguity of elongated objects, making it superior to axis-aligned bounding boxes. Despite the effectiveness, rotated detectors are not widely employed. Annotating rotated bounding boxes is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Tianyu Zhu , Bryce Ferenczi , Pulak Purkait , Tom Drummond , Hamid Rezatofighi , Anton van den Hengel

We present a new, simple yet effective approach to uplift video object detection. We observe that prior works operate on instance-level feature aggregation that imminently neglects the refined pixel-level representation, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Khurram Azeem Hashmi , Alain Pagani , Didier Stricker , Muhammamd Zeshan Afzal

Weakly supervised object detection has recently received much attention, since it only requires image-level labels instead of the bounding-box labels consumed in strongly supervised learning. Nevertheless, the save in labeling expense is…

Computer Vision and Pattern Recognition · Computer Science 2018-02-13 Jiajie Wang , Jiangchao Yao , Ya Zhang , Rui Zhang

Vision-language models such as CLIP have boosted the performance of open-vocabulary object detection, where the detector is trained on base categories but required to detect novel categories. Existing methods leverage CLIP's strong…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Cheng Shi , Sibei Yang

Object detectors trained with weak annotations are affordable alternatives to fully-supervised counterparts. However, there is still a significant performance gap between them. We propose to narrow this gap by fine-tuning a base pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Huy V. Vo , Oriane Siméoni , Spyros Gidaris , Andrei Bursuc , Patrick Pérez , Jean Ponce

Object detection is one of the major problems in computer vision, and has been extensively studied. Most of the existing detection works rely on labor-intensive supervision, such as ground truth bounding boxes of objects or at least…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Qingyi Tao , Hao Yang , Jianfei Cai

The ability to recognize, localize and track dynamic objects in a scene is fundamental to many real-world applications, such as self-driving and robotic systems. Yet, traditional multiple object tracking (MOT) benchmarks rely only on a few…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Siyuan Li , Tobias Fischer , Lei Ke , Henghui Ding , Martin Danelljan , Fisher Yu

Open-vocabulary 3D object detection methods are able to localize 3D boxes of classes unseen during training. Despite the name, existing methods rely on user-specified classes both at training and inference. We propose to study…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Haomeng Zhang , Kuan-Chuan Peng , Suhas Lohit , Raymond A. Yeh

The nature of diversity in real-world environments necessitates neural network models to expand from closed category settings to accommodate novel emerging categories. In this paper, we study the open-vocabulary object detection (OVD),…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Sunyuan Qiang , Xianfei Li , Yanyan Liang , Wenlong Liao , Tao He , Pai Peng

Open vocabulary object detection (OVD) aims at seeking an optimal object detector capable of recognizing objects from both base and novel categories. Recent advances leverage knowledge distillation to transfer insightful knowledge from…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Jiaming Li , Jiacheng Zhang , Jichang Li , Ge Li , Si Liu , Liang Lin , Guanbin Li

Conventional object detectors typically operate under a closed-set assumption, limiting recognition to a predefined set of base classes seen during training. Open-vocabulary object detection (OVD) addresses this limitation by leveraging…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Sanghoon Lee , Geon Lee , Hyekang Park , Bumsub Ham

Recent advancements in large vision-language models enabled visual object detection in open-vocabulary scenarios, where object classes are defined in free-text formats during inference. In this paper, we aim to probe the state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Lorenzo Bianchi , Fabio Carrara , Nicola Messina , Claudio Gennaro , Fabrizio Falchi

A critical object detection task is finetuning an existing model to detect novel objects, but the standard workflow requires bounding box annotations which are time-consuming and expensive to collect. Weakly supervised object detection…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Tyler LaBonte , Yale Song , Xin Wang , Vibhav Vineet , Neel Joshi

Object detection traditionally relies on fixed category sets, requiring costly re-training to handle novel objects. While Open-World and Open-Vocabulary Object Detection (OWOD and OVOD) improve flexibility, OWOD lacks semantic labels for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Furkan Mumcu , Michael J. Jones , Anoop Cherian , Yasin Yilmaz

This paper introduces self-taught object localization, a novel approach that leverages deep convolutional networks trained for whole-image recognition to localize objects in images without additional human supervision, i.e., without using…

Computer Vision and Pattern Recognition · Computer Science 2016-02-03 Loris Bazzani , Alessandro Bergamo , Dragomir Anguelov , Lorenzo Torresani

Object detection is a critical part of visual scene understanding. The representation of the object in the detection task has important implications on the efficiency and feasibility of annotation, robustness to occlusion, pose, lighting,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Li Ding , Lex Fridman

Tiny objects, with their limited spatial resolution, often resemble point-like distributions. As a result, bounding box prediction using point-level supervision emerges as a natural and cost-effective alternative to traditional box-level…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Haoran Zhu , Chang Xu , Ruixiang Zhang , Fang Xu , Wen Yang , Haijian Zhang , Gui-Song Xia