English
Related papers

Related papers: Multimodal Trajectory Representation Learning for …

200 papers

Existing multimodal tasks mostly target at the complete input modality setting, i.e., each modality is either complete or completely missing in both training and test sets. However, the randomly missing situations have still been…

Computation and Language · Computer Science 2022-10-25 Wei Han , Hui Chen , Min-Yen Kan , Soujanya Poria

Nowadays, our mobility systems are evolving into the era of intelligent vehicles that aim to improve road safety. Due to their vulnerability, pedestrians are the users who will benefit the most from these developments. However, predicting…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Lina Achaji , Thierno Barry , Thibault Fouqueray , Julien Moreau , Francois Aioun , Francois Charpillet

Advanced Driver Assistance Systems (ADAS) need to understand human driver behavior while perceiving their navigation context, but jointly learning these heterogeneous tasks would cause inter-task negative transfer and impair system…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Wenzhuo Liu , Qiannan Guo , Zhen Wang , Wenshuo Wang , Lei Yang , Yicheng Qiao , Lening Wang , Zhiwei Li , Chen Lv , Shanghang Zhang , Junqiang Xi , Huaping Liu

Transformer-based multi-object tracking (MOT) methods have captured the attention of many researchers in recent years. However, these models often suffer from slow inference speeds due to their structure or other issues. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Pan Liao , Feng Yang , Di Wu , Jinwen Yu , Wenhui Zhao , Dingwen Zhang

Individual mobility trajectories are difficult to measure and often incur long periods of missingness. Aggregation of this mobility data without accounting for the missingness leads to erroneous results, underestimating travel behavior.…

Methodology · Statistics 2024-10-22 Danielle McCool , Peter Lugtig , Barry Schouten

Multi-agent trajectory data collected from domains such as team sports often suffer from missing values due to various factors. While many imputation methods have been proposed for spatiotemporal data, they are not well-suited for…

Artificial Intelligence · Computer Science 2025-07-16 Han-Jun Choi , Hyunsung Kim , Minho Lee , Minchul Jeong , Chang-Jo Kim , Jinsung Yoon , Sang-Ki Ko

Traffic forecasting in Intelligent Transportation Systems (ITS) is vital for intelligent traffic prediction. Yet, ITS often relies on data from traffic sensors or vehicle devices, where certain cities might not have all those smart devices…

Machine Learning · Computer Science 2024-10-22 Kishor Kumar Bhaumik , Minha Kim , Fahim Faisal Niloy , Amin Ahsan Ali , Simon S. Woo

Intelligent transportation systems (ITSs) will be a major component of tomorrow's smart cities. However, realizing the true potential of ITSs requires ultra-low latency and reliable data analytics solutions that can combine, in real-time, a…

Information Theory · Computer Science 2017-12-13 Aidin Ferdowsi , Ursula Challita , Walid Saad

In recent years, the rise of autonomous driving technologies has highlighted the critical importance of reliable software for ensuring safety and performance. This paper proposes a novel approach for just-in-time software defect prediction…

Software Engineering · Computer Science 2025-03-03 Faisal Mohammad , Duksan Ryu

Deep Neural Networks (DNNs) have achieved remarkable success in a variety of tasks, especially when it comes to prediction accuracy. However, in complex real-world scenarios, particularly in safety-critical applications, high accuracy alone…

Artificial Intelligence · Computer Science 2024-05-31 Han Liu , Peng Cui , Bingning Wang , Jun Zhu , Xiaolin Hu

Predicting the future behavior of road users is one of the most challenging and important problems in autonomous driving. Applying deep learning to this problem requires fusing heterogeneous world state in the form of rich perception…

Vehicle arrival time prediction has been studied widely. With the emergence of IoT devices and deep learning techniques, estimated time of arrival (ETA) has become a critical component in intelligent transportation systems. Though many…

Machine Learning · Computer Science 2022-06-20 Hieu Tran , Son Nguyen , I-Ling Yen , Farokh Bastani

Universal Multimodal Retrieval requires unified embedding models capable of interpreting diverse user intents, ranging from simple keywords to complex compositional instructions. While Multimodal Large Language Models (MLLMs) possess strong…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Xiangzhao Hao , Shijie Wang , Tianyu Yang , Tianyue Wang , Haiyun Guo , Jinqiao Wang

Trajectory representation learning (TRL) aims to encode raw trajectory data into low-dimensional embeddings for downstream tasks such as travel time estimation, mobility prediction, and trajectory similarity analysis. From a behavioral…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Ji Cao , Yu Wang , Tongya Zheng , Jie Song , Qinghong Guo , Zujie Ren , Canghong Jin , Gang Chen , Mingli Song

Current research on trajectory prediction primarily relies on data collected by onboard sensors of an ego vehicle. With the rapid advancement in connected technologies, such as vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I)…

Artificial Intelligence · Computer Science 2025-03-13 Xi Chen , Rahul Bhadani , Larry Head

The trajectory on the road traffic is commonly collected at a low sampling rate, and trajectory recovery aims to recover a complete and continuous trajectory from the sparse and discrete inputs. Recently, sequential language models have…

Machine Learning · Computer Science 2023-11-07 Dedong Li , Ziyue Li , Zhishuai Li , Lei Bai , Qingyuan Gong , Lijun Sun , Wolfgang Ketter , Rui Zhao

Mixed-type time series (MTTS) is a bimodal data type that is common in many domains, such as healthcare, finance, environmental monitoring, and social media. It consists of regularly sampled continuous time series and irregularly sampled…

Machine Learning · Computer Science 2026-02-04 Simon Dietz , Thomas Altstidl , Dario Zanca , Björn Eskofier , An Nguyen

With the advancements of sensor hardware, traffic infrastructure and deep learning architectures, trajectory prediction of vehicles has established a solid foundation in intelligent transportation systems. However, existing solutions are…

Artificial Intelligence · Computer Science 2024-11-13 Jia Quan Loh , Xuewen Luo , Fan Ding , Hwa Hui Tew , Junn Yong Loo , Ze Yang Ding , Susilawati Susilawati , Chee Pin Tan

Visual Multi-Object Tracking (MOT) is a crucial component of robotic perception, yet existing Tracking-By-Detection (TBD) methods often rely on 2D cues, such as bounding boxes and motion modeling, which struggle under occlusions and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Buyin Deng , Lingxin Huang , Kai Luo , Fei Teng , Kailun Yang

Navigating dense and dynamic environments poses a significant challenge for autonomous driving systems, owing to the intricate nature of multimodal interaction, wherein the actions of various traffic participants and the autonomous vehicle…

Robotics · Computer Science 2024-08-29 Tong Li , Lu Zhang , Sikang Liu , Shaojie Shen