English
Related papers

Related papers: Multi-modal Motion Prediction using Temporal Ensem…

200 papers

Finding sustainable and novel solutions to predict city-wide mobility behaviour is an ever-growing problem given increased urban complexity and growing populations. This paper seeks to address this by describing a traffic frame prediction…

Machine Learning · Computer Science 2020-12-01 Jay Santokhi , Pankaj Daga , Joned Sarwar , Anna Jordan , Emil Hewage

Audio-visual emotion recognition (AVER) methods typically fuse utterance-level features, and even frame-level attention models seldom address the frame-rate mismatch across modalities. In this paper, we propose a Transformer-based framework…

Multimedia · Computer Science 2026-03-13 Inyong Koo , yeeun Seong , Minseok Son , Jaehyuk Jang , Changick Kim

Ensemble of predictions is known to perform better than individual predictions taken separately. However, for tasks that require heavy computational resources, e.g. semantic segmentation, creating an ensemble of learners that needs to be…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Walid Bousselham , Guillaume Thibault , Lucas Pagano , Archana Machireddy , Joe Gray , Young Hwan Chang , Xubo Song

We address the problem of learning on sets of features, motivated by the need of performing pooling operations in long biological sequences of varying sizes, with long-range dependencies, and possibly few labeled data. To address this…

Machine Learning · Computer Science 2021-02-11 Grégoire Mialon , Dexiong Chen , Alexandre d'Aspremont , Julien Mairal

Autonomous vehicle navigation in shared pedestrian environments requires the ability to predict future crowd motion both accurately and with minimal delay. Understanding the uncertainty of the prediction is also crucial. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Kunming Li , Stuart Eiffert , Mao Shan , Francisco Gomez-Donoso , Stewart Worrall , Eduardo Nebot

A new trend uses LLMs as dense text encoders via contrastive learning. However, since LLM embeddings predict the probability distribution of the next token, they are inherently generative and distributive, conflicting with contrastive…

Computation and Language · Computer Science 2025-10-17 Jingcheng Deng , Zhongtao Jiang , Liang Pang , Liwei Chen , Kun Xu , Zihao Wei , Huawei Shen , Xueqi Cheng

Predicting multiple plausible future trajectories of the nearby vehicles is crucial for the safety of autonomous driving. Recent motion prediction approaches attempt to achieve such multimodal motion prediction by implicitly regularizing…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Yicheng Liu , Jinghuai Zhang , Liangji Fang , Qinhong Jiang , Bolei Zhou

Multivariate time series forecasting enables the prediction of future states by leveraging historical data, thereby facilitating decision-making processes. Each data node in a multivariate time series encompasses a sequence of multiple…

Machine Learning · Computer Science 2025-05-02 Xinlong Zhao , Liying Zhang , Tianbo Zou , Yan Zhang

Trajectory sampling in the Frenet(road-aligned) frame, is one of the most popular methods for motion planning of autonomous vehicles. It operates by sampling a set of behavioural inputs, such as lane offset and forward speed, before solving…

Robotics · Computer Science 2023-10-24 Jatan Shrestha , Simon Idoko , Basant Sharma , Arun Kumar Singh

Accurate beam prediction is essential for mitigating signalling overhead and latency in integrated sensing and communication-enabled massive multi-input multi-output systems. With the aid of multimodal learning, the prediction accuracy can…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Zijian Zheng , Wenqiang Yi , Hyundong Shin , Arumugam Nallanathan

Better machine understanding of pedestrian behaviors enables faster progress in modeling interactions between agents such as autonomous vehicles and humans. Pedestrian trajectories are not only influenced by the pedestrian itself but also…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Abduallah Mohamed , Kun Qian , Mohamed Elhoseiny , Christian Claudel

Estimating the joint distribution of on-road agents' future trajectories is essential for autonomous driving. In this technical report, we propose a next-generation framework for joint multi-agent trajectory prediction called QCNeXt. First,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Zikang Zhou , Zihao Wen , Jianping Wang , Yung-Hui Li , Yu-Kai Huang

Multimodal prediction results are essential for trajectory prediction task as there is no single correct answer for the future. Previous frameworks can be divided into three categories: regression, generation and classification frameworks.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Jianhua Sun , Yuxuan Li , Hao-Shu Fang , Cewu Lu

In recent times, with the exception of sporadic cases, the trend in Computer Vision is to achieve minor improvements compared to considerable increases in complexity. To reverse this trend, we propose a novel method to boost image…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Antonio Bruno , Davide Moroni , Massimo Martinelli

It has been challenging to model the complex temporal-spatial dependencies between agents for trajectory prediction. As each state of an agent is closely related to the states of adjacent time steps, capturing the local temporal dependency…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yixin Yan , Yang Li , Yuanfan Wang , Xiaozhou Zhou , Beihao Xia , Manjiang Hu , Hongmao Qin

Accurate Vehicle Trajectory Prediction is critical for automated vehicles and advanced driver assistance systems. Vehicle trajectory prediction consists of two essential tasks, i.e., longitudinal position prediction and lateral position…

Machine Learning · Computer Science 2023-12-04 Renteng Yuan , Mohamed Abdel-Aty , Qiaojun Xiang , Zijin Wang , Ou Zheng

Efficient long-short temporal modeling is key for enhancing the performance of action recognition task. In this paper, we propose a new two-stream action recognition network, termed as MENet, consisting of a Motion Enhancement (ME) module…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Liyu Wu , Yuexian Zou , Can Zhang

Expressive representation of pose sequences is crucial for accurate motion modeling in human motion prediction (HMP). While recent deep learning-based methods have shown promise in learning motion representations, these methods tend to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Jiexin Wang , Wenwen Qiang , Zhao Yang , Bing Su

Accurate traffic congestion classification requires models that jointly capture roadway scene context and non-stationary traffic motion, yet most prior work treats these requirements in isolation. Vision-based methods often depend on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Eugene Kofi Okrah Denteh , Blessing Agyei Kyem , Joshua Kofi Asamoah , Armstrong Aboah

Moving Object Detection (MOD) is a crucial task for the Autonomous Driving pipeline. MOD is usually handled via 2-stream convolutional architectures that incorporates both appearance and motion cues, without considering the inter-relations…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Eslam Mohamed , Ahmad El-Sallab