English
Related papers

Related papers: Multimodal Trajectory Representation Learning for …

200 papers

Trajectory representation learning on a network enhances our understanding of vehicular traffic patterns and benefits numerous downstream applications. Existing approaches using classic machine learning or deep learning embed trajectories…

Machine Learning · Computer Science 2023-12-14 Yuanbo Tang , Zhiyuan Peng , Yang Li

The perception system for autonomous driving generally requires to handle multiple diverse sub-tasks. However, current algorithms typically tackle individual sub-tasks separately, which leads to low efficiency when aiming at obtaining…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xuesong Chen , Shaoshuai Shi , Tao Ma , Jingqiu Zhou , Simon See , Ka Chun Cheung , Hongsheng Li

Enabling resilient autonomous motion planning requires robust predictions of surrounding road users' future behavior. In response to this need and the associated challenges, we introduce our model titled MTP-GO. The model encodes the scene…

Robotics · Computer Science 2023-12-12 Theodor Westny , Joel Oskarsson , Björn Olofsson , Erik Frisk

Multimodal transportation systems can be represented as time-resolved multilayer networks where different transportation modes connecting the same set of nodes are associated to distinct network layers. Their quantitative description became…

Physics and Society · Physics 2015-09-29 Laura Alessandretti , Márton Karsai , Laetitia Gauvin

The estimation of origin-destination (OD) matrices is a crucial aspect of Intelligent Transport Systems (ITS). It involves adjusting an initial OD matrix by regressing the current observations like traffic counts of road sections (e.g.,…

Artificial Intelligence · Computer Science 2023-10-10 Zheli Xiong , Defu Lian , Enhong Chen , Gang Chen , Xiaomin Cheng

Trajectory forecasting, or trajectory prediction, of multiple interacting agents in dynamic scenes, is an important problem for many applications, such as robotic systems and autonomous driving. The problem is a great challenge because of…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Yanliang Zhu , Dongchun Ren , Mingyu Fan , Deheng Qian , Xin Li , Huaxia Xia

Multi-variate time series (MTS) data is a ubiquitous class of data abstraction in the real world. Any instance of MTS is generated from a hybrid dynamical system and their specific dynamics are usually unknown. The hybrid nature of such a…

Machine Learning · Computer Science 2021-09-07 Jinliang Deng , Xiusi Chen , Renhe Jiang , Xuan Song , Ivor W. Tsang

Trajectory prediction is a challenging task that aims to predict the future trajectory of vehicles or pedestrians over a short time horizon based on their historical positions. The main reason is that the trajectory is a kind of complex…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Pengqian Han , Jiamou Liu , Tianzhe Bao , Yifei Wang

Accurate traffic prediction, especially predicting traffic conditions several days in advance is essential for intelligent transportation systems (ITS). Such predictions enable mid- and long-term traffic optimization, which is crucial for…

Artificial Intelligence · Computer Science 2024-12-24 Hangli Ge , Xiaojie Yang , Itsuki Matsunaga , Dizhi Huang , Noboru Koshizuka

3D multi-object tracking and trajectory prediction are two crucial modules in autonomous driving systems. Generally, the two tasks are handled separately in traditional paradigms and a few methods have started to explore modeling these two…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Jiaheng Zhuang , Guoan Wang , Siyu Zhang , Xiyang Wang , Hangning Zhou , Ziyao Xu , Chi Zhang , Zhiheng Li

Vision-language models enable the understanding and reasoning of complex traffic scenarios through multi-source information fusion, establishing it as a core technology for autonomous driving. However, existing vision-language models are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Minghui Hou , Wei-Hsing Huang , Shaofeng Liang , Daizong Liu , Tai-Hao Wen , Gang Wang , Runwei Guan , Weiping Ding

Large Multimodal Models (LMMs) have recently gained prominence in autonomous driving research, showcasing promising capabilities across various emerging benchmarks. LMMs specifically designed for this domain have demonstrated effective…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Ayesha Ishaq , Jean Lahoud , Fahad Shahbaz Khan , Salman Khan , Hisham Cholakkal , Rao Muhammad Anwer

Off-road environments remain significant challenges for autonomous ground vehicles, due to the lack of structured roads and the presence of complex obstacles, such as uneven terrain, vegetation, and occlusions. Traditional perception…

Robotics · Computer Science 2025-08-07 Zitong Chen , Chao Sun , Shida Nie , Chen Min , Changjiu Ning , Haoyu Li , Bo Wang

Recent research in time series forecasting has explored integrating multimodal features into models to improve accuracy. However, the accuracy of such methods is constrained by three key challenges: inadequate extraction of fine-grained…

Machine Learning · Computer Science 2025-10-21 Shule Hao , Junpeng Bao , Wenli Li

Recently, deep learning have achieved promising results in Estimated Time of Arrival (ETA), which is considered as predicting the travel time from the origin to the destination along a given path. One of the key techniques is to use…

Machine Learning · Computer Science 2020-06-25 Yiwen Sun , Kun Fu , Zheng Wang , Changshui Zhang , Jieping Ye

Traffic safety remains a critical global challenge, with traditional Advanced Driver-Assistance Systems (ADAS) often struggling in dynamic real-world scenarios due to fragmented sensor processing and susceptibility to adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Mohammad Abu Tami , Mohammed Elhenawy , Huthaifa I. Ashqar

Trajectory analysis is essential in many applications. In this paper, we address the problem of representing motion trajectories in a highly informative way, and consequently utilize it for analyzing trajectories. Our approach first…

Computer Vision and Pattern Recognition · Computer Science 2017-04-27 Weiyao Lin , Yang Zhou , Hongteng Xu , Junchi Yan , Mingliang Xu , Jianxin Wu , Zicheng Liu

This paper introduces a data-driven time embedding method for modeling long-range seasonal dependencies in spatiotemporal forecasting tasks. The proposed approach employs Dynamic Mode Decomposition (DMD) to extract temporal modes directly…

Machine Learning · Computer Science 2025-08-05 Menglin Kong , Vincent Zhihao Zheng , Xudong Wang , Lijun Sun

Robust multimodal visual analytics remains challenging when heterogeneous modalities provide complementary but input-dependent evidence for decision-making.Existing multimodal learning methods mainly rely on fixed fusion modules or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Tianyi Liu , Yiming Li , Wenqian Wang , Jiaojiao Wang , Chen Cai , Yi Wang , Kim-Hui Yap

Multi-modal behaviors exhibited by surrounding vehicles (SVs) can typically lead to traffic congestion and reduce the travel efficiency of autonomous vehicles (AVs) in dense traffic. This paper proposes a real-time parallel trajectory…

Robotics · Computer Science 2023-09-12 Lei Zheng , Rui Yang , Zengqi Peng , Haichao Liu , Michael Yu Wang , Jun Ma