English
Related papers

Related papers: Multimodal Trajectory Representation Learning for …

200 papers

Joint Detection and Embedding (JDE) trackers have demonstrated excellent performance in Multi-Object Tracking (MOT) tasks by incorporating the extraction of appearance features as auxiliary tasks through embedding Re-Identification task…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Yunfei Zhang , Chao Liang , Jin Gao , Zhipeng Zhang , Weiming Hu , Stephen Maybank , Xue Zhou , Liang Li

Most existing multimodal trackers adopt uniform fusion strategies, overlooking the inherent differences between modalities. Moreover, they propagate temporal information through mixed tokens, leading to entangled and less discriminative…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Shilei Wang , Pujian Lai , Dong Gao , Jifeng Ning , Gong Cheng

Missing data is a challenge in many applications, including intelligent transportation systems (ITS). In this paper, we study traffic speed and travel time estimations in ITS, where portions of the collected data are missing due to sensor…

Machine Learning · Computer Science 2022-11-21 Bahareh Najafi , Saeedeh Parsaeefard , Alberto Leon-Garcia

Transfer learning has the potential to reduce the burden of data collection and to decrease the unavoidable risks of the training phase. In this letter, we introduce a multirobot, multitask transfer learning framework that allows a system…

Robotics · Computer Science 2018-04-04 Karime Pereida , Mohamed K. Helwa , Angela P. Schoellig

Many learning tasks involve multi-modal data streams, where continuous data from different modes convey a comprehensive description about objects. A major challenge in this context is how to efficiently interpret multi-modal information in…

Machine Learning · Computer Science 2020-07-24 Amila Silva , Shanika Karunasekera , Christopher Leckie , Ling Luo

The capability to jointly process multi-modal information is becoming an essential task. However, the limited number of paired multi-modal data and the large computational requirements in multi-modal learning hinder the development. We…

Computation and Language · Computer Science 2025-06-09 Minsu Kim , Jee-weon Jung , Hyeongseop Rha , Soumi Maiti , Siddhant Arora , Xuankai Chang , Shinji Watanabe , Yong Man Ro

Predicting future human motion is critical for intelligent robots to interact with humans in the real world, and human motion has the nature of multi-granularity. However, most of the existing work either implicitly modeled…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Xiaoli Liu , Jianqin Yin

Vehicle trajectory prediction is essential for enabling safety-critical intelligent transportation systems (ITS) applications used in management and operations. While there have been some promising advances in the field, there is a need for…

Machine Learning · Computer Science 2022-05-27 Vinit Katariya , Mohammadreza Baharani , Nichole Morris , Omidreza Shoghli , Hamed Tabkhi

Accurate prediction of drug-target interactions (DTI) is pivotal in drug discovery. However, existing approaches often fail to capture deep intra-modal feature interactions or achieve effective cross-modal alignment, limiting predictive…

Multimedia · Computer Science 2025-10-22 Xiangyu Li , Ran Su , Liangliang Liu

Vision-based trajectory prediction is an important task that supports safe and intelligent behaviours in autonomous systems. Many advanced approaches have been proposed over the years with improved spatial and temporal feature extraction.…

Robotics · Computer Science 2025-03-27 Renhao Huang , Hao Xue , Maurice Pagnucco , Flora Salim , Yang Song

Modern transportation systems face growing challenges in managing traffic flow, ensuring safety, and maintaining operational efficiency amid dynamic traffic patterns. Addressing these challenges requires intelligent solutions capable of…

Machine Learning · Computer Science 2025-02-26 Hiya Bhatt , Sahil , Karthik Vaidhyanathan , Rahul Biju , Deepak Gangadharan , Ramona Trestian , Purav Shah

Addressing the Integrated Timetabling and Vehicle Scheduling (TTVS) problem is important for improving transit operations. Recently, the emerging modular autonomous vehicles composed of modular autonomous units have made it possible to…

Optimization and Control · Mathematics 2026-02-09 Dongyang Xia , Jihui Ma , Shadi Sharif Azadeh

In real-world sequential decision making tasks like autonomous driving, robotics, and healthcare, learning from observed state-action trajectories is critical for tasks like imitation, classification, and clustering. For example,…

Machine Learning · Computer Science 2025-01-20 Zichang Ge , Changyu Chen , Arunesh Sinha , Pradeep Varakantham

A multi-modal transport system is acknowledged to have robust failure tolerance and can effectively relieve urban congestion issues. However, estimating the impact of disruptions across multi-transport modes is a challenging problem due to…

Predicting multimodal future behavior of traffic participants is essential for robotic vehicles to make safe decisions. Existing works explore to directly predict future trajectories based on latent features or utilize dense goal candidates…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Shaoshuai Shi , Li Jiang , Dengxin Dai , Bernt Schiele

Traffic demand forecasting by deep neural networks has attracted widespread interest in both academia and industry society. Among them, the pairwise Origin-Destination (OD) demand prediction is a valuable but challenging problem due to…

Machine Learning · Computer Science 2022-07-01 Liangzhe Han , Xiaojian Ma , Leilei Sun , Bowen Du , Yanjie Fu , Weifeng Lv , Hui Xiong

Predicting ego vehicle trajectories remains a critical challenge, especially in urban and dense areas due to the unpredictable behaviours of other vehicles and pedestrians. Multimodal trajectory prediction enhances decision-making by…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Sushil Sharma , Arindam Das , Ganesh Sistu , Mark Halton , Ciarán Eising

Trajectory similarity computation has drawn massive attention, as it is core functionality in a wide range of applications such as ride-sharing, traffic analysis, and social recommendation. Motivated by the recent success of deep learning…

Machine Learning · Computer Science 2022-03-01 Ziquan Fang , Yuntao Du , Xinjun Zhu , Lu Chen , Yunjun Gao , Christian S. Jensen

Trajectory computing is a pivotal domain encompassing trajectory data management and mining, garnering widespread attention due to its crucial role in various practical applications such as location services, urban traffic, and public…

Accurately predicting spatio-temporal network traffic is essential for dynamically managing computing resources in modern communication systems and minimizing energy consumption. Although spatio-temporal traffic prediction has received…

Machine Learning · Computer Science 2026-03-24 Xintong Wang , Haihan Nan , Ruidong Li , Huaming Wu