English
Related papers

Related papers: Real-time Visual Object Tracking with Natural Lang…

200 papers

This paper introduces a novel deep learning based approach for vision based single target tracking. We address this problem by proposing a network architecture which takes the input video frames and directly computes the tracking score for…

Computer Vision and Pattern Recognition · Computer Science 2016-07-12 Mengyao Zhai , Mehrsan Javan Roshtkhari , Greg Mori

Following the recent progress in image classification and captioning using deep learning, we develop a novel natural language person retrieval system based on an attention mechanism. More specifically, given the description of a person, the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-26 Tao Zhou , Muhao Chen , Jie Yu , Demetri Terzopoulos

Visual language tracking (VLT) has emerged as a cutting-edge research area, harnessing linguistic data to enhance algorithms with multi-modal inputs and broadening the scope of traditional single object tracking (SOT) to encompass video…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Xuchen Li , Shiyu Hu , Xiaokun Feng , Dailing Zhang , Meiqi Wu , Jing Zhang , Kaiqi Huang

Vision-language tracking aims to locate the target object in the video sequence using a template patch and a language description provided in the initial frame. To achieve robust tracking, especially in complex long-term scenarios that…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 X. Feng , S. Hu , X. Li , D. Zhang , M. Wu , J. Zhang , X. Chen , K. Huang

We present a fast and accurate visual tracking algorithm based on the multi-domain convolutional neural network (MDNet). The proposed approach accelerates feature extraction procedure and learns more discriminative models for instance…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Ilchae Jung , Jeany Son , Mooyeol Baek , Bohyung Han

Deep learning has recently started being applied to visual tracking of generic objects in video streams. For the purposes of robotics applications, it is very important for a target tracker to recover its track if it is lost due to heavy or…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Pranoy Panda , Martin Barczyk

In this paper we address the problem of tracking non-rigid objects whose local appearance and motion changes as a function of time. This class of objects includes dynamic textures such as steam, fire, smoke, water, etc., as well as…

Computer Vision and Pattern Recognition · Computer Science 2012-04-23 Rizwan Chaudhry , Gregory Hager , Rene Vidal

Most existing multi-object tracking methods typically learn visual tracking features via maximizing dis-similarities of different instances and minimizing similarities of the same instance. While such a feature learning scheme achieves…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Yuhao Li , Jiale Cao , Muzammal Naseer , Yu Zhu , Jinqiu Sun , Yanning Zhang , Fahad Shahbaz Khan

One of the major challenges of model-free visual tracking problem has been the difficulty originating from the unpredictable and drastic changes in the appearance of objects we target to track. Existing methods tackle this problem by…

Computer Vision and Pattern Recognition · Computer Science 2018-08-20 Janghoon Choi , Junseok Kwon , Kyoung Mu Lee

Multimodal vision-language (VL) learning has noticeably pushed the tendency toward generic intelligence owing to emerging large foundation models. However, tracking, as a fundamental vision problem, surprisingly enjoys less bonus from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Mingzhe Guo , Zhipeng Zhang , Liping Jing , Haibin Ling , Heng Fan

Machine learning techniques are often used in computer vision due to their ability to leverage large amounts of training data to improve performance. Unfortunately, most generic object trackers are still trained from scratch online and do…

Computer Vision and Pattern Recognition · Computer Science 2016-08-17 David Held , Sebastian Thrun , Silvio Savarese

Vision-language models (VLMs) excel in visual understanding but often lack reliable grounding capabilities and actionable inference rates. Integrating them with open-vocabulary object detection (OVD), instance segmentation, and tracking…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Bastian Pätzold , Jan Nogga , Sven Behnke

In this paper, we propose a novel on-line visual tracking framework based on the Siamese matching network and meta-learner network, which run at real-time speeds. Conventional deep convolutional feature-based discriminative visual tracking…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Janghoon Choi , Junseok Kwon , Kyoung Mu Lee

Object search is a challenging task because when given complex language descriptions (e.g., "find the white cup on the table"), the robot must move its camera through the environment and recognize the described object. Previous works map…

Robotics · Computer Science 2023-09-15 Thao Nguyen , Vladislav Hrosinkov , Eric Rosen , Stefanie Tellex

Visual object tracking plays a critical role in visual-based autonomous systems, as it aims to estimate the position and size of the object of interest within a live video. Despite significant progress made in this field, state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Jianlang Chen , Xuhong Ren , Qing Guo , Felix Juefei-Xu , Di Lin , Wei Feng , Lei Ma , Jianjun Zhao

LVLMs have been shown to perform excellently in image-level tasks such as VQA and caption. However, in many instance-level tasks, such as visual grounding and object detection, LVLMs still show performance gaps compared to previous expert…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Teng Fu , Mengyang Zhao , Ke Niu , Kaixin Peng , Bin Li

In dynamic environments, performance of visual SLAM techniques can be impaired by visual features taken from moving objects. One solution is to identify those objects so that their visual features can be removed for localization and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Jonathan Vincent , Mathieu Labbé , Jean-Samuel Lauzon , François Grondin , Pier-Marc Comtois-Rivet , François Michaud

In this paper we introduce a fully end-to-end approach for visual tracking in videos that learns to predict the bounding box locations of a target object at every frame. An important insight is that the tracking problem can be considered as…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Da Zhang , Hamid Maei , Xin Wang , Yuan-Fang Wang

Vision-Language Tracking (VLT) aims to localize a target in video sequences using a visual template and language description. While textual cues enhance tracking potential, current datasets typically contain much more image data than text,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 X. Feng , D. Zhang , S. Hu , X. Li , M. Wu , J. Zhang , X. Chen , K. Huang

The current strive towards end-to-end trainable computer vision systems imposes major challenges for the task of visual tracking. In contrast to most other vision problems, tracking requires the learning of a robust target-specific…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Goutam Bhat , Martin Danelljan , Luc Van Gool , Radu Timofte