English
Related papers

Related papers: Graph Neural Networks for 3D Multi-Object Tracking

200 papers

Multiobject tracking (MOT) is an important task in robotics, autonomous driving, and maritime surveillance. Traditional work on MOT is model-based and aims to establish algorithms in the framework of sequential Bayesian estimation. More…

Signal Processing · Electrical Eng. & Systems 2024-10-10 Shaoxiu Wei , Mingchao Liang , Florian Meyer

In recent times, the scope of LIDAR (Light Detection and Ranging) sensor-based technology has spread across numerous fields. It is popularly used to map terrain and navigation information into reliable 3D point cloud data, potentially…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Aakash Kumar , Jyoti Kini , Mubarak Shah , Ajmal Mian

Infrared and visible image fusion has gradually proved to be a vital fork in the field of multi-modality imaging technologies. In recent developments, researchers not only focus on the quality of fused images but also evaluate their…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Jiawei Li , Jiansheng Chen , Jinyuan Liu , Huimin Ma

State-of-the-art multi-object tracking~(MOT) methods follow the tracking-by-detection paradigm, where object trajectories are obtained by associating per-frame outputs of object detectors. In crowded scenes, however, detectors often fail to…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Weihong Ren , Xinchao Wang , Jiandong Tian , Yandong Tang , Antoni B. Chan

Human-Object Interaction (HOI) recognition in videos requires understanding both visual patterns and geometric relationships as they evolve over time. Visual and geometric features offer complementary strengths. Visual features capture…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Tanqiu Qiao , Ruochen Li , Frederick W. B. Li , Yoshiki Kubotani , Shigeo Morishima , Hubert P. H. Shum

Autonomous driving requires 3D perception of vehicles and other objects in the in environment. Much of the current methods support 2D vehicle detection. This paper proposes a flexible pipeline to adopt any 2D detection network and fuse it…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Xinxin Du , Marcelo H. Ang , Sertac Karaman , Daniela Rus

Accurate interpretation of street-level imagery is essential for large-scale urban mapping and the creation of Spatial Digital Twin (SDT) environments. This work presents a unified framework for joint 2D-3D segmentation and association that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Amir Melnikov , Masayuki Tanaka , Yusuke Monno , Masatoshi Okutomi

Objects rarely sit in isolation in human environments. As such, we'd like our robots to reason about how multiple objects relate to one another and how those relations may change as the robot interacts with the world. To this end, we…

Robotics · Computer Science 2023-03-20 Yixuan Huang , Adam Conkey , Tucker Hermans

In the existing literature, most 3D multi-object tracking algorithms based on the tracking-by-detection framework employed deterministic tracks and detections for similarity calculation in the data association stage. Namely, the inherent…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Jiawei He , Chunyun Fu , Xiyang Wang

Feature-based image matching has extensive applications in computer vision. Keypoints detected in images can be naturally represented as graph structures, and Graph Neural Networks (GNNs) have been shown to outperform traditional deep…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Xianfeng Song , Yi Zou , Zheng Shi , Zheng Liu

The advancement of computer vision has pushed visual analysis tasks from still images to the video domain. In recent years, video instance segmentation, which aims to track and segment multiple objects in video frames, has drawn much…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Yiming Cui , Cheng Han , Dongfang Liu

Bottom-up approaches for image-based multi-person pose estimation consist of two stages: (1) keypoint detection and (2) grouping of the detected keypoints to form person instances. Current grouping approaches rely on learned embedding from…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Jiahao Lin , Gim Hee Lee

Graph neural network (GNN) is a popular tool to learn the lower-dimensional representation of a graph. It facilitates the applicability of machine learning tasks on graphs by incorporating domain-specific features. There are various options…

Machine Learning · Computer Science 2020-08-21 Md. Khaledur Rahman

We propose a novel approach for joint 3D multi-object tracking and reconstruction from RGB-D sequences in indoor environments. To this end, we detect and reconstruct objects in each frame while predicting dense correspondences mappings into…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Dominik Schmauser , Zeju Qiu , Norman Müller , Matthias Nießner

In this paper we propose a novel approach to tracking by detection that can exploit both cameras as well as LIDAR data to produce very accurate 3D trajectories. Towards this goal, we formulate the problem as a linear program that can be…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Davi Frossard , Raquel Urtasun

We address the problem of merging graph and feature-space information while learning a metric from structured data. Existing algorithms tackle the problem in an asymmetric way, by either extracting vectorized summaries of the graph…

Machine Learning · Computer Science 2020-02-17 Nicolo Colombo

Multi-object tracking (MOT) is a core task in computer vision that involves detecting objects in video frames and associating them across time. The rise of deep learning has significantly advanced MOT, particularly within the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Momir Adžemović

Multi-object tracking (MOT) is a vital component of intelligent video analytics applications such as surveillance and autonomous driving. The time and storage complexity required to execute deep learning models for visual object tracking…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Keivan Nalaie , Rong Zheng

Designing a robust affinity model is the key issue in multiple target tracking (MTT). This paper proposes a novel affinity model by learning feature representation and distance metric jointly in a unified deep architecture. Specifically, we…

Computer Vision and Pattern Recognition · Computer Science 2018-02-12 Jun Xiang , Guoshuai Zhang , Jianhua Hou , Nong Sang , Rui Huang

Learning data-efficient object dynamics models for robotic manipulation remains challenging, especially for deformable objects. A popular approach is to model objects as sets of 3D particles and learn their motion using graph neural…

Robotics · Computer Science 2026-05-05 Sergio Orozco , Tushar Kusnur , Brandon May , George Konidaris , Laura Herlant