English
Related papers

Related papers: Learning to Detect and Segment for Open Vocabulary…

200 papers

We present Pix2Seq, a simple and generic framework for object detection. Unlike existing approaches that explicitly integrate prior knowledge about the task, we cast object detection as a language modeling task conditioned on the observed…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Ting Chen , Saurabh Saxena , Lala Li , David J. Fleet , Geoffrey Hinton

The combination of a CNN detector and a search framework forms the basis for local object/pattern detection. To handle the waste of regional information and the defective compromise between efficiency and accuracy, this paper proposes a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Fang-Qi Li , Xu-Die Ren , Hao-Nan Guo

Due to object detection's close relationship with video analysis and image understanding, it has attracted much research attention in recent years. Traditional object detection methods are built on handcrafted features and shallow trainable…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Zhong-Qiu Zhao , Peng Zheng , Shou-tao Xu , Xindong Wu

Modeling implicit feature interaction patterns is of significant importance to object detection tasks. However, in the two-stage detectors, due to the excessive use of hand-crafted components, it is very difficult to reason about the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Wenchao Zhang , Chong Fu , Xiangshi Chang , Tengfei Zhao , Xiang Li , Chiu-Wing Sham

This paper presents a novel training-free framework for open-vocabulary image segmentation and object recognition (OVSR), which leverages EfficientNetB0, a convolutional neural network, for unsupervised segmentation and CLIP, a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Ying Dai , Wei Yu Chen

Open-vocabulary 3D Object Detection (OV-3DDet) aims to detect objects from an arbitrary list of categories within a 3D scene, which remains seldom explored in the literature. There are primarily two fundamental problems in OV-3DDet, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Yang Cao , Yihan Zeng , Hang Xu , Dan Xu

Open-vocabulary semantic segmentation enables models to identify novel object categories beyond their training data. While this flexibility represents a significant advancement, current approaches still rely on manually specified class…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Klara Reichard , Giulia Rizzoli , Stefano Gasperini , Lukas Hoyer , Pietro Zanuttigh , Nassir Navab , Federico Tombari

Recent progress in deep learning has significantly advanced CT image analysis, particularly for segmentation tasks. However, these advances are largely confined to image-level pattern recognition, with most methods lacking explicit…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Yuyuan Liu , Can Peng , Yingyu Yang , Qianye Yang , Cheng Ouyang , J. Alison Noble

The pre-trained text-image discriminative models, such as CLIP, has been explored for open-vocabulary semantic segmentation with unsatisfactory results due to the loss of crucial localization information and awareness of object shapes.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Jinglong Wang , Xiawei Li , Jing Zhang , Qingyuan Xu , Qin Zhou , Qian Yu , Lu Sheng , Dong Xu

Personal robots and driverless cars need to be able to operate in novel environments and thus quickly and efficiently learn to recognise new object classes. We address this problem by considering the task of video object segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Harkirat Singh Behl , Mohammad Najafi , Anurag Arnab , Philip H. S. Torr

Open-vocabulary object detection aims to detect arbitrary classes via text prompts. Methods without cross-modal fusion layers (non-fusion) offer faster inference by treating recognition as a retrieval problem, \ie, matching regions to text…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Shenghao Fu , Yukun Su , Fengyun Rao , Jing Lyu , Xiaohua Xie , Wei-Shi Zheng

We propose a novel recurrent attentional structure to localize and recognize objects jointly. The network can learn to extract a sequence of local observations with detailed appearance and rough context, instead of sliding windows or…

Computer Vision and Pattern Recognition · Computer Science 2017-12-20 Jie Lyu , Zejian Yuan , Dapeng Chen

Exploring new knowledge is a fundamental human ability that can be mirrored in the development of deep neural networks, especially in the field of object detection. Open world object detection (OWOD) is an emerging area of research that…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yiming Li , Yi Wang , Wenqian Wang , Dan Lin , Bingbing Li , Kim-Hui Yap

We present lazy visual grounding, a two-stage approach of unsupervised object mask discovery followed by object grounding, for open-vocabulary semantic segmentation. Plenty of the previous art casts this task as pixel-to-text classification…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Dahyun Kang , Minsu Cho

Semantic segmentation and object detection research have recently achieved rapid progress. However, the former task has no notion of different instances of the same object, and the latter operates at a coarse, bounding-box level. We propose…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Anurag Arnab , Philip H. S Torr

Varying density of point clouds increases the difficulty of 3D detection. In this paper, we present a context-aware dynamic network (CADNet) to capture the variance of density by considering both point context and semantic context.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Yonglin Tian , Lichao Huang , Xuesong Li , Kunfeng Wang , Zilei Wang , Fei-Yue Wang

Semantic segmentation and instance level segmentation made substantial progress in recent years due to the emergence of deep neural networks (DNNs). A number of deep architectures with Convolution Neural Networks (CNNs) were proposed that…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Pulak Purkait , Christopher Zach , Ian Reid

Recent Multimodal Large Language Models (MLLMs) are remarkable in vision-language tasks, such as image captioning and question answering, but lack the essential perception ability, i.e., object detection. In this work, we address this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Yuhang Zang , Wei Li , Jun Han , Kaiyang Zhou , Chen Change Loy

Deep-learning and large scale language-image training have produced image object detectors that generalise well to diverse environments and semantic classes. However, single-image object detectors trained on internet data are not optimally…

Robotics · Computer Science 2024-02-07 Nicolas Harvey Chapman , Feras Dayoub , Will Browne , Chris Lehnert

The goal of this paper is open-vocabulary object detection (OVOD) $\unicode{x2013}$ building a model that can detect objects beyond the set of categories seen at training, thus enabling the user to specify categories of interest at…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Prannay Kaul , Weidi Xie , Andrew Zisserman