English
Related papers

Related papers: STURE: Spatial-Temporal Mutual Representation Lear…

200 papers

We propose ST-DETR, a Spatio-Temporal Transformer-based architecture for object detection from a sequence of temporal frames. We treat the temporal frames as sequences in both space and time and employ the full attention mechanisms to take…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Eslam Mohamed , Ahmad El-Sallab

Multi-sensor perception is crucial to ensure the reliability and accuracy in autonomous driving system, while multi-object tracking (MOT) improves that by tracing sequential movement of dynamic objects. Most current approaches for…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Wenwei Zhang , Hui Zhou , Shuyang Sun , Zhe Wang , Jianping Shi , Chen Change Loy

Tracking multiple objects in videos relies on modeling the spatial-temporal interactions of the objects. In this paper, we propose a solution named TransMOT, which leverages powerful graph transformers to efficiently model the spatial and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Peng Chu , Jiang Wang , Quanzeng You , Haibin Ling , Zicheng Liu

Standardized benchmarks have been crucial in pushing the performance of computer vision algorithms, especially since the advent of deep learning. Although leaderboards should not be over-claimed, they often provide the most objective…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Patrick Dendorfer , Aljoša Ošep , Anton Milan , Konrad Schindler , Daniel Cremers , Ian Reid , Stefan Roth , Laura Leal-Taixé

Autonomous driving holds great promise in addressing traffic safety concerns by leveraging artificial intelligence and sensor technology. Multi-Object Tracking plays a critical role in ensuring safer and more efficient navigation through…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Lei Cheng , Arindam Sengupta , Siyang Cao

We introduce Spatial-Temporal Memory Networks for video object detection. At its core, a novel Spatial-Temporal Memory module (STMM) serves as the recurrent computation unit to model long-term temporal appearance and motion dynamics. The…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Fanyi Xiao , Yong Jae Lee

In visual Reinforcement Learning (RL), learning from pixel-based observations poses significant challenges on sample efficiency, primarily due to the complexity of extracting informative state representations from high-dimensional data.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Jiarui Sun , M. Ugur Akcal , Wei Zhang , Girish Chowdhary

In the current demand for automation in the agro-food industry, accurately detecting and localizing relevant objects in 3D is essential for successful robotic operations. However, this is a challenge due the presence of occlusions.…

Robotics · Computer Science 2024-12-19 David Rapado-Rincon , Henk Nap , Katarina Smolenova , Eldert J. van Henten , Gert Kootstra

End-to-end multi-object tracking (MOT) methods have recently achieved remarkable progress by unifying detection and association within a single framework. Despite their strong detection performance, these methods suffer from relatively low…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yuqing Shao , Yuchen Yang , Rui Yu , Weilong Li , Xu Guo , Huaicheng Yan , Wei Wang , Xiao Sun

3D object detection is a common function within the perception system of an autonomous vehicle and outputs a list of 3D bounding boxes around objects of interest. Various 3D object detection methods have relied on fusion of different sensor…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Eduardo Arnold , Mehrdad Dianati , Robert de Temple , Saber Fallah

We propose a data-driven approach to online multi-object tracking (MOT) that uses a convolutional neural network (CNN) for data association in a tracking-by-detection framework. The problem of multi-target tracking aims to assign noisy…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Erkan Baser , Venkateshwaran Balasubramanian , Prarthana Bhattacharyya , Krzysztof Czarnecki

The ever-increasing use of artificial intelligence in autonomous systems has significantly contributed to advance the research on multi-object tracking, adopted in several real-time applications (e.g., autonomous driving, surveillance…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Edoardo Cittadini , Alessandro De Siena , Giorgio Buttazzo

Despite rapid progress in scene segmentation in recent years, 3D segmentation methods are still limited when there is severe occlusion. The key challenge is estimating the segment boundaries of (partially) occluded objects, which are…

Robotics · Computer Science 2021-04-02 Andrew Price , Kun Huang , Dmitry Berenson

Identification of the vehicles passing over the roads is a very important component of traffic monitoring/surveillance. There have been many attempts to design and develop efficient strategies to carry out the job. However, from the point…

Networking and Internet Architecture · Computer Science 2023-09-06 Chandra Shekhar , Manish Kausik H , Sudipta Saha

Trajectory Representation Learning (TRL) is a powerful tool for spatial-temporal data analysis and management. TRL aims to convert complicated raw trajectories into low-dimensional representation vectors, which can be applied to various…

Machine Learning · Computer Science 2024-03-08 Jiawei Jiang , Dayan Pan , Houxing Ren , Xiaohan Jiang , Chao Li , Jingyuan Wang

The DEtection TRansformer (DETR) opened new possibilities for object detection by modeling it as a translation task: converting image features into object-level representations. Previous works typically add expensive modules to DETR to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Pierre-François De Plaen , Nicola Marinello , Marc Proesmans , Tinne Tuytelaars , Luc Van Gool

In recent years, anchor-free object detection models combined with matching algorithms are used to achieve real-time muti-object tracking and also ensure high tracking accuracy. However, there are still great challenges in multi-object…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Huilan Luo , Zehua Zeng

Tracking of objects in 3D is a fundamental task in computer vision that finds use in a wide range of applications such as autonomous driving, robotics or augmented reality. Most recent approaches for 3D multi object tracking (MOT) from…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Jan-Nico Zaech , Dengxin Dai , Alexander Liniger , Martin Danelljan , Luc Van Gool

In this paper, we present a spatio-temporal tendency reasoning (STR) network for recovering human body pose and shape from videos. Previous approaches have focused on how to extend 3D human datasets and temporal-based learning to promote…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Boyang Zhang , SuPing Wu , Hu Cao , Kehua Ma , Pan Li , Lei Lin

Object tracking is divided into single-object tracking (SOT) and multi-object tracking (MOT). MOT aims to maintain the identities of multiple objects across a series of continuous video sequences. In recent years, MOT has made rapid…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Yukuan Zhang , Yunhua Jia , Housheng Xie , Mengzhen Li , Limin Zhao , Yang Yang , Shan Zhao