English
Related papers

Related papers: Open-Vocabulary Object Detection Using Captions

200 papers

As we move towards large-scale object detection, it is unrealistic to expect annotated training data, in the form of bounding box annotations around objects, for all object classes at sufficient scale, and so methods capable of unseen…

Computer Vision and Pattern Recognition · Computer Science 2019-03-20 Pengkai Zhu , Hanxiao Wang , Venkatesh Saligrama

After learning a new object category from image-level annotations (with no object bounding boxes), humans are remarkably good at precisely localizing those objects. However, building good object localizers (i.e., detectors) currently…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Zitian Chen , Zhiqiang Shen , Jiahui Yu , Erik Learned-Miller

Weakly supervised object detection aims at learning precise object detectors, given image category labels. In recent prevailing works, this problem is generally formulated as a multiple instance learning module guided by an image…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Xiaoyan Li , Meina Kan , Shiguang Shan , Xilin Chen

Open-vocabulary object detection has benefited greatly from pretrained vision-language models, but is still limited by the amount of available detection training data. While detection training data can be expanded by using Web image-text…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Matthias Minderer , Alexey Gritsenko , Neil Houlsby

Recent open-vocabulary detection methods aim to detect novel objects by distilling knowledge from vision-language models (VLMs) trained on a vast amount of image-text pairs. To improve the effectiveness of these methods, researchers have…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Han-Cheol Cho , Won Young Jhoo , Wooyoung Kang , Byungseok Roh

The ability to interpret and comprehend a 3D scene is essential for many vision and robotics systems. In numerous applications, this involves 3D object detection, i.e.~identifying the location and dimensions of objects belonging to a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Olivier Moliner , Viktor Larsson , Kalle Åström

Learning an object detector or retrieval requires a large data set with manual annotations. Such data sets are expensive and time consuming to create and therefore difficult to obtain on a large scale. In this work, we propose to exploit…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Elad Amrani , Rami Ben-Ari , Tal Hakim , Alex Bronstein

The goal of this paper is open-vocabulary object detection (OVOD) $\unicode{x2013}$ building a model that can detect objects beyond the set of categories seen at training, thus enabling the user to specify categories of interest at…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Prannay Kaul , Weidi Xie , Andrew Zisserman

Object category localization is a challenging problem in computer vision. Standard supervised training requires bounding box annotations of object instances. This time-consuming annotation process is sidestepped in weakly supervised…

Computer Vision and Pattern Recognition · Computer Science 2016-05-30 Ramazan Gokberk Cinbis , Jakob Verbeek , Cordelia Schmid

Unsupervised and open-vocabulary 3D object detection has recently gained attention, particularly in autonomous driving, where reducing annotation costs and recognizing unseen objects are critical for both safety and scalability. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 In-Jae Lee , Mungyeom Kim , Kwonyoung Ryu , Pierre Musacchio , Jaesik Park

Weakly-supervised object localization methods tend to fail for object classes that consistently co-occur with the same background elements, e.g. trains on tracks. We propose a method to overcome these failures by adding a very small amount…

Computer Vision and Pattern Recognition · Computer Science 2016-05-19 Alexander Kolesnikov , Christoph H. Lampert

In the field of visual scene understanding, deep neural networks have made impressive advancements in various core tasks like segmentation, tracking, and detection. However, most approaches operate on the close-set assumption, meaning that…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Jianzong Wu , Xiangtai Li , Shilin Xu , Haobo Yuan , Henghui Ding , Yibo Yang , Xia Li , Jiangning Zhang , Yunhai Tong , Xudong Jiang , Bernard Ghanem , Dacheng Tao

Object detection is a fundamental task in computer vision, requiring large annotated datasets that are difficult to collect, as annotators need to label objects and their bounding boxes. Thus, it is a significant challenge to use cheaper…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Achiya Jerbi , Roei Herzig , Jonathan Berant , Gal Chechik , Amir Globerson

Recently, the availability of remote sensing imagery from aerial vehicles and satellites constantly improved. For an automated interpretation of such data, deep-learning-based object detectors achieve state-of-the-art performance. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Maximilian Bernhard , Matthias Schubert

As the most fundamental scene understanding tasks, object detection and segmentation have made tremendous progress in deep learning era. Due to the expensive manual labeling cost, the annotated categories in existing datasets are often…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Chaoyang Zhu , Long Chen

Learning accurate object detectors often requires large-scale training data with precise object bounding boxes. However, labeling such data is expensive and time-consuming. As the crowd-sourcing labeling process and the ambiguities of the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Chengxin Liu , Kewei Wang , Hao Lu , Zhiguo Cao , Ziming Zhang

Multimodal supervision has achieved promising results in many visual language understanding tasks, where the language plays an essential role as a hint or context for recognizing and locating instances. However, due to the defects of the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Weixin Feng , Xingyuan Bu , Chenchen Zhang , Xubin Li

Traditional object detection models are typically trained on a fixed set of classes, limiting their flexibility and making it costly to incorporate new categories. Open-vocabulary object detection addresses this limitation by enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Jyoti Kini , Rohit Gupta , Mubarak Shah

We tackle the problem of learning object detectors without supervision. Differently from weakly-supervised object detection, we do not assume image-level class labels. Instead, we extract a supervisory signal from audio-visual data, using…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Triantafyllos Afouras , Yuki M. Asano , Francois Fagan , Andrea Vedaldi , Florian Metze

Object detectors are typically learned on fully-annotated training data with fixed predefined categories. However, categories are often required to be increased progressively. Usually, only the original training set annotated with old…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Bowen Zhao , Chen Chen , Xi Xiao , Shutao Xia