English
Related papers

Related papers: Visual Object Tracking on Multi-modal RGB-D Videos…

200 papers

Visual object tracking aims to localize the target object of each frame based on its initial appearance in the first frame. Depending on the input modility, tracking tasks can be divided into RGB tracking and RGB+X (e.g. RGB+N, and RGB+D)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Lingyi Hong , Shilin Yan , Renrui Zhang , Wanyun Li , Xinyu Zhou , Pinxue Guo , Kaixun Jiang , Yiting Chen , Jinglun Li , Zhaoyu Chen , Wenqiang Zhang

We present a method for temporally consistent motion segmentation from RGB-D videos assuming a piecewise rigid motion model. We formulate global energies over entire RGB-D sequences in terms of the segmentation of each frame into a number…

Computer Vision and Pattern Recognition · Computer Science 2016-08-17 Peter Bertholet , Alexandru-Eugen Ichim , Matthias Zwicker

Existing multi-modal object tracking approaches primarily focus on dual-modal paradigms, such as RGB-Depth or RGB-Thermal, yet remain challenged in complex scenarios due to limited input modalities. To address this gap, this work introduces…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xue-Feng Zhu , Tianyang Xu , Yifan Pan , Jinjie Gu , Xi Li , Jiwen Lu , Xiao-Jun Wu , Josef Kittler

Understanding human-object interactions is fundamental in First Person Vision (FPV). Tracking algorithms which follow the objects manipulated by the camera wearer can provide useful cues to effectively model such interactions. Visual…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Matteo Dunnhofer , Antonino Furnari , Giovanni Maria Farinella , Christian Micheloni

RGB-D data is essential for solving many problems in computer vision. Hundreds of public RGB-D datasets containing various scenes, such as indoor, outdoor, aerial, driving, and medical, have been proposed. These datasets are useful for…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Alexandre Lopes , Roberto Souza , Helio Pedrini

Understanding human-object interactions is fundamental in First Person Vision (FPV). Tracking algorithms which follow the objects manipulated by the camera wearer can provide useful cues to effectively model such interactions. Despite a few…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Matteo Dunnhofer , Antonino Furnari , Giovanni Maria Farinella , Christian Micheloni

Single object tracking aims to localize target object with specific reference modalities (bounding box, natural language or both) in a sequence of specific video modalities (RGB, RGB+Depth, RGB+Thermal or RGB+Event.). Different reference…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yinchao Ma , Yuyang Tang , Wenfei Yang , Tianzhu Zhang , Xu Zhou , Feng Wu

Compared with traditional RGB-only visual tracking, few datasets have been constructed for RGB-D tracking. In this paper, we propose ARKitTrack, a new RGB-D tracking dataset for both static and dynamic scenes captured by consumer-grade…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Haojie Zhao , Junsong Chen , Lijun Wang , Huchuan Lu

Recent years have seen an explosion of interest in analyzing the motion of objects in video data as a way for students to connect the concepts of physics to something tangible like a video recording of an experiment. A variety of software…

We present a novel solution to the problem of 3D tracking of the articulated motion of human hand(s), possibly in interaction with other objects. The vast majority of contemporary relevant work capitalizes on depth information provided by…

Computer Vision and Pattern Recognition · Computer Science 2017-05-16 Paschalis Panteleris , Antonis Argyros

To be useful in everyday environments, robots must be able to identify and locate real-world objects. In recent years, video object segmentation has made significant progress on densely separating such objects from background in real and…

Robotics · Computer Science 2020-01-13 Brent A. Griffin , Victoria Florence , Jason J. Corso

The problem of multi-object tracking is a fundamental computer vision research focus, widely used in public safety, transport, autonomous vehicles, robotics, and other regions involving artificial intelligence. Because of the complexity of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Kai Ren , Chuanping Hu

Object tracking is one of the most important problems in computer vision. The aim of video tracking is to extract the trajectories of a target or object of interest, i.e. accurately locate a moving target in a video sequence and…

Computer Vision and Pattern Recognition · Computer Science 2020-03-19 Niloufar Salehi Dastjerdi , M. Omair Ahmad

We address the problem of multi-modal object tracking in video and explore various options of fusing the complementary information conveyed by the visible (RGB) and thermal infrared (TIR) modalities including pixel-level, feature-level and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Zhangyong Tang , Tianyang Xu , Hui Li , Xiao-Jun Wu , Xuefeng Zhu , Josef Kittler

Glass surfaces are becoming increasingly ubiquitous as modern buildings tend to use a lot of glass panels. This, however, poses substantial challenges to the operations of autonomous systems such as robots, self-driving cars, and drones, as…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jiaying Lin , Yuen-Hei Yeung , Shuquan Ye , Rynson W. H. Lau

A long-term visual object tracking performance evaluation methodology and a benchmark are proposed. Performance measures are designed by following a long-term tracking definition to maximize the analysis probing strength. The new measures…

Computer Vision and Pattern Recognition · Computer Science 2019-07-02 Alan Lukežič , Ugur Kart , Jani Käpylä , Ahmed Durmush , Joni-Kristian Kämäräinen , Jiří Matas , Matej Kristan

Deep networks have brought significant advances in robot perception, enabling to improve the capabilities of robots in several visual tasks, ranging from object detection and recognition to pose estimation, semantic scene segmentation and…

Robotics · Computer Science 2019-04-03 Fabio Cermelli , Massimiliano Mancini , Elisa Ricci , Barbara Caputo

Standard RGB-D trackers treat the target as an inherently 2D structure, which makes modelling appearance changes related even to simple out-of-plane rotation highly challenging. We address this limitation by proposing a novel long-term…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Ugur Kart , Alan Lukezic , Matej Kristan , Joni-Kristian Kamarainen , Jiri Matas

Visual object tracking is an important computer vision problem with numerous real-world applications including human-computer interaction, autonomous vehicles, robotics, motion-based recognition, video indexing, surveillance and security.…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Mustansar Fiaz , Arif Mahmood , Soon Ki Jung

The integration of dual-modal features has been pivotal in advancing RGB-Depth (RGB-D) tracking. However, current trackers are less efficient and focus solely on single-level features, resulting in weaker robustness in fusion and slower…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Boyue Xu , Yi Xu , Ruichao Hou , Jia Bei , Tongwei Ren , Gangshan Wu