English
Related papers

Related papers: Three Steps to Multimodal Trajectory Prediction: M…

200 papers

We present convolutional neural network (CNN) based approaches for unsupervised multimodal subspace clustering. The proposed framework consists of three main stages - multimodal encoder, self-expressive layer, and multimodal decoder. The…

Machine Learning · Computer Science 2025-10-13 Mahdi Abavisani , Vishal M. Patel

Multimodal sentiment analysis relies on textual, acoustic, and visual signals, yet real-world data often suffer from modality missing and quality imbalance. Existing methods generate features for modality missing from available ones, but…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Chenglizhao Chen , Yuchen Cao , Xinyu Liu , Mengke Song , Guisheng Zhang , Xiaomin Yu

This paper studies the problem of multi-agent trajectory prediction in crowded unknown environments. A novel energy function optimization-based framework is proposed to generate prediction trajectories. Firstly, a new energy function is…

Robotics · Computer Science 2024-07-15 Xiuye Tao , Huiping Li , Bin Liang , Yang Shi , Demin Xu

Visual navigation is fundamental to autonomous systems, yet generating reliable trajectories in cluttered and uncertain environments remains a core challenge. Recent generative models promise end-to-end synthesis, but their reliance on…

Robotics · Computer Science 2026-02-04 Xubo Luo , Aodi Wu , Haodong Han , Xue Wan , Wei Zhang , Leizheng Shu , Ruisuo Wang

Accurate travel time estimation (TTE) plays a crucial role in intelligent transportation systems. However, it remains challenging due to heterogeneous data sources and complex traffic dynamics. Moreover, traditional approaches typically…

Machine Learning · Computer Science 2026-01-27 Zhi Liu , Xuyuan Hu , Xiao Han , Zhehao Dai , Zhaolin Deng , Guojiang Shen , Xiangjie Kong

Pedestrian behavior prediction is one of the major challenges for intelligent driving systems in urban environments. Pedestrians often exhibit a wide range of behaviors and adequate interpretations of those depend on various sources of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Amir Rasouli , Tiffany Yau , Mohsen Rohani , Jun Luo

Modality selection is an important step when designing multimodal systems, especially in the case of cross-domain activity recognition as certain modalities are more robust to domain shift than others. However, selecting only the modalities…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Zdravko Marinov , Alina Roitberg , David Schneider , Rainer Stiefelhagen

Recently, there has been tremendous progress in developing each individual module of the standard perception-planning robot autonomy pipeline, including detection, tracking, prediction of other agents' trajectories, and ego-agent trajectory…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Xinshuo Weng , Boris Ivanovic , Marco Pavone

In its simplest form, the traffic flow prediction problem is restricted to predicting a single time-step into the future. Multi-step traffic flow prediction extends this set-up to the case where predicting multiple time-steps into the…

Artificial Intelligence · Computer Science 2018-05-18 Arief Koesdwiady , Fakhri Karray

3D multi-object tracking and trajectory prediction are two crucial modules in autonomous driving systems. Generally, the two tasks are handled separately in traditional paradigms and a few methods have started to explore modeling these two…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Jiaheng Zhuang , Guoan Wang , Siyu Zhang , Xiyang Wang , Hangning Zhou , Ziyao Xu , Chi Zhang , Zhiheng Li

We present our submission to the Hume-ABAW10 Emotional Mimicry Intensity (EMI) Challenge, which aims to predict six continuous emotion intensity dimensions: Admiration, Amusement, Determination, Empathic Pain, Excitement, and Joy, from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Dinithi Dissanayake , Shaveen Silva , Ovindu Atukorala , Prasanth Sasikumar , Suranga Nanayakkara

Predicting future human motion is critical for intelligent robots to interact with humans in the real world, and human motion has the nature of multi-granularity. However, most of the existing work either implicitly modeled…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Xiaoli Liu , Jianqin Yin

Recent deep trajectory predictors (e.g., Jiang et al., 2023; Zhou et al., 2022) have achieved strong average accuracy but remain unreliable in complex long-tail driving scenarios. These limitations reveal the weakness of the prevailing…

Machine Learning · Computer Science 2025-11-04 Lu Bowen

In this modern technological era, categorization and ranking of research journals is gaining popularity among researchers and scientists. It plays a significant role for publication of their research findings in a quality journal. Although,…

Digital Libraries · Computer Science 2022-10-07 Rabia Shabbir Ranjha , Arshad Ali , Shahid Yousaf

When fitting statistical models, some predictors are often found to be correlated with each other, and functioning together. Many group variable selection methods are developed to select the groups of predictors that are closely related to…

Methodology · Statistics 2021-03-25 Zhiyuan Li

Recently, there has been growing interest in incorporating textual information into foundation models for time series forecasting. However, it remains unclear whether and under what conditions such multimodal integration consistently yields…

Multimodal learning has seen remarkable progress, particularly with the emergence of large-scale pre-training across various modalities. However, most current approaches are built on the assumption of a deterministic, one-to-one alignment…

Machine Learning · Computer Science 2025-05-27 Sanghyuk Chun

Training a multimodal network is challenging and it requires complex architectures to achieve reasonable performance. We show that one reason for this phenomena is the difference between the convergence rate of various modalities. We…

Artificial Intelligence · Computer Science 2020-11-13 Aya Abdelsalam Ismail , Mahmudul Hasan , Faisal Ishtiaq

We present a novel clustering approach for moving object trajectories that are constrained by an underlying road network. The approach builds a similarity graph based on these trajectories then uses modularity-optimization hiearchical graph…

Machine Learning · Statistics 2012-10-08 Mohamed Khalil El Mahrsi , Fabrice Rossi

Temporal prediction is critical for making intelligent and robust decisions in complex dynamic environments. Motion prediction needs to model the inherently uncertain future which often contains multiple potential outcomes, due to…

Machine Learning · Computer Science 2019-12-10 Yichuan Charlie Tang , Ruslan Salakhutdinov