English
Related papers

Related papers: Multimodal Trajectory Representation Learning for …

200 papers

Video-and-language understanding has a variety of applications in the industry, such as video question answering, text-video retrieval, and multi-label classification. Existing video-and-language understanding methods generally adopt heavy…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Jiaqi Xu , Bo Liu , Yunkuo Chen , Mengli Cheng , Xing Shi

The wide spread use of positioning and photographing devices gives rise to a deluge of traffic trajectory data (e.g., vehicle passage records and taxi trajectory data), with each record having at least three attributes: object ID, location…

Machine Learning · Computer Science 2020-03-18 Meng Chen , Xiaohui Yu , Yang Liu

Accurate vehicle trajectory prediction is crucial for ensuring safe and efficient autonomous driving. This work explores the integration of Transformer based model with Long Short-Term Memory (LSTM) based technique to enhance spatial and…

Robotics · Computer Science 2024-12-19 Chandra Raskoti , Weizi Li

Trajectory representation learning (TRL) maps trajectories to vectors that can then be used for various downstream tasks, including trajectory similarity computation, trajectory classification, and travel-time estimation. However, existing…

Machine Learning · Computer Science 2024-12-02 Silin Zhou , Shuo Shang , Lisi Chen , Christian S. Jensen , Panos Kalnis

We present a method for trajectory planning for autonomous driving, learning image-based context embeddings that align with motion prediction frameworks and planning-based intention input. Within our method, a ViT encoder takes raw images…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Maitrayee Keskar , Mohan Trivedi , Ross Greer

Predicting the behavior of road users accurately is crucial to enable the safe operation of autonomous vehicles in urban or densely populated areas. Therefore, there has been a growing interest in time series motion prediction research,…

Machine Learning · Computer Science 2024-10-22 Camiel Oerlemans , Bram Grooten , Michiel Braat , Alaa Alassi , Emilia Silvas , Decebal Constantin Mocanu

Multimodal intelligent transportation systems (M-ITS) encompass a range of transportation services that utilise various modes of transport and incorporate intelligent technologies for enhanced efficiency and user experience. There are…

Systems and Control · Electrical Eng. & Systems 2024-02-15 Muhammad Farooq , Nima Afraz , Fatemeh Golpayegani

Multi-modal learning has emerged as an increasingly promising avenue in vision recognition, driving innovations across diverse domains ranging from media and education to healthcare and transportation. Despite its success, the robustness of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Tiantian Feng , Daniel Yang , Digbalay Bose , Shrikanth Narayanan

Multivariate time series(MTS) is a universal data type related to many practical applications. However, MTS suffers from missing data problems, which leads to degradation or even collapse of the downstream tasks, such as prediction and…

Machine Learning · Computer Science 2022-09-19 Kai Zhang , Qinmin Yang , Chao Li

The problem of travel time estimation is widely considered as the fundamental challenge of modern logistics. The complex nature of interconnections between spatial aspects of roads and temporal dynamics of ground transport still preserves…

Machine Learning · Computer Science 2022-07-14 Natalia Semenova , Vadim Porvatov , Vladislav Tishin , Artyom Sosedka , Vladislav Zamkovoy

Discriminative representation is crucial for the association step in multi-object tracking. Recent work mainly utilizes features in single or neighboring frames for constructing metric loss and empowering networks to extract representation…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 En Yu , Zhuoling Li , Shoudong Han

Multivariate Time Series (MTS) data capture temporal behaviors to provide invaluable insights into various physical dynamic phenomena. In smart mobility, MTS plays a crucial role in providing temporal dynamics of behaviors such as maneuver…

Machine Learning · Computer Science 2024-09-12 Thabang Lebese

Trajectory Representation Learning (TRL) is a powerful tool for spatial-temporal data analysis and management. TRL aims to convert complicated raw trajectories into low-dimensional representation vectors, which can be applied to various…

Machine Learning · Computer Science 2024-03-08 Jiawei Jiang , Dayan Pan , Houxing Ren , Xiaohan Jiang , Chao Li , Jingyuan Wang

This paper introduces a novel deep learning-based multimodal fusion architecture aimed at enhancing the perception capabilities of autonomous navigation robots in complex environments. By utilizing innovative feature extraction modules,…

Machine Learning · Computer Science 2025-04-29 Delun Lai , Yeyubei Zhang , Yunchong Liu , Chaojie Li , Huadong Mo

Given the wide adoption of multimodal sensors (e.g., camera, lidar, radar) by autonomous vehicles (AVs), deep analytics to fuse their outputs for a robust perception become imperative. However, existing fusion methods often make two…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Pengfei Hu , Yuhang Qian , Tianyue Zheng , Ang Li , Zhe Chen , Yue Gao , Xiuzhen Cheng , Jun Luo

The inherently diverse and uncertain nature of trajectories presents a formidable challenge in accurately modeling them. Motion prediction systems must effectively learn spatial and temporal information from the past to forecast the future…

Robotics · Computer Science 2023-11-28 Pranav Singh Chib , Pravendra Singh

This paper introduces a novel spatiotemporal feature representation model designed to address the limitations of traditional methods in multidimensional time series (MTS) analysis. The proposed approach converts MTS into one-dimensional…

Machine Learning · Computer Science 2024-10-10 Xu Yan , Yaoting Jiang , Wenyi Liu , Didi Yi , Jianjun Wei

With rapid urbanization in the modern era, traffic signals from various sensors have been playing a significant role in monitoring the states of cities, which provides a strong foundation in ensuring safe travel, reducing traffic congestion…

Artificial Intelligence · Computer Science 2025-11-18 Haolong Xiang , Peisi Wang , Xiaolong Xu , Kun Yi , Xuyun Zhang , Quanzheng Sheng , Amin Beheshti , Wei Fan

Due to the rapid development of Internet of Things (IoT) technologies, many online web apps (e.g., Google Map and Uber) estimate the travel time of trajectory data collected by mobile devices. However, in reality, complex factors, such as…

Artificial Intelligence · Computer Science 2022-06-22 Zhiwen Zhang , Hongjun Wang , Zipei Fan , Jiyuan Chen , Xuan Song , Ryosuke Shibasaki

Domain-adaptive trajectory imitation is a skill that some predators learn for survival, by mapping dynamic information from one domain (their speed and steering direction) to a different domain (current position of the moving prey). An…

Machine Learning · Computer Science 2023-04-21 Edgardo Solano-Carrillo , Jannis Stoppe