English
Related papers

Related papers: ReCoAt: A Deep Learning-based Framework for Multi-…

200 papers

This paper proposes a modular framework to generate robust biped locomotion using a tight coupling between an analytical walking approach and deep reinforcement learning. This framework is composed of six main modules which are…

Robotics · Computer Science 2021-12-23 Mohammadreza Kasaei , Miguel Abreu , Nuno Lau , Artur Pereira , Luis Paulo Reis

Predicting the behaviour (i.e., manoeuvre/trajectory) of other road users, including vehicles, is critical for the safe and efficient operation of autonomous vehicles (AVs), a.k.a., automated driving systems (ADSs). Due to the uncertain…

Machine Learning · Computer Science 2023-07-27 Sajjad Mozaffari , Mreza Alipour Sormoli , Konstantinos Koufos , Mehrdad Dianati

Motion forecasting and planning are tasked with estimating the trajectories of traffic agents and the ego vehicle, respectively, to ensure the safety and efficiency of autonomous driving systems in dynamically changing environments.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Bozhou Zhang , Nan Song , Xiatian Zhu , Li Zhang

Automated vehicles are deemed to be the key element for the intelligent transportation system in the future. Many studies have been made to improve the Automated vehicles' ability of environment recognition and vehicle control, while the…

Artificial Intelligence · Computer Science 2018-04-18 Yingjun Ye , Xiaohui Zhang , Jian Sun

Predicting the possible future trajectories of the surrounding dynamic agents is an essential requirement in autonomous driving. These trajectories mainly depend on the surrounding static environment, as well as the past movements of those…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Bimsara Pathiraja , Shehan Munasinghe , Malshan Ranawella , Maleesha De Silva , Ranga Rodrigo , Peshala Jayasekara

In this report, we present the 1st place solution for motion prediction track in 2022 Waymo Open Dataset Challenges. We propose a novel Motion Transformer framework for multimodal motion prediction, which introduces a small set of novel…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Shaoshuai Shi , Li Jiang , Dengxin Dai , Bernt Schiele

Detection and segmentation of moving obstacles, along with prediction of the future occupancy states of the local environment, are essential for autonomous vehicles to proactively make safe and informed decisions. In this paper, we propose…

Robotics · Computer Science 2022-09-28 Maneekwan Toyungyernsub , Esen Yel , Jiachen Li , Mykel J. Kochenderfer

The multi-modality and stochastic characteristics of human behavior make motion prediction a highly challenging task, which is critical for autonomous driving. While deep learning approaches have demonstrated their great potential in this…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Xiaqiang Tang , Weigao Sun , Siyuan Hu , Yiyang Sun , Yafeng Guo

Autonomous driving requires operation in different behavioral modes ranging from lane following and intersection crossing to turning and stopping. However, most existing deep learning approaches to autonomous driving do not consider the…

Machine Learning · Computer Science 2019-01-15 Sauhaarda Chowdhuri , Tushar Pankaj , Karl Zipser

Predicting future trajectories of road agents is a critical task for autonomous driving. Recent goal-based trajectory prediction methods, such as DenseTNT and PECNet, have shown good performance on prediction tasks on public datasets.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Qiujing Lu , Weiqiao Han , Jeffrey Ling , Minfa Wang , Haoyu Chen , Balakrishnan Varadarajan , Paul Covington

Predicting the future motion of road participants is a critical task in autonomous driving. In this work, we address the challenge of low-quality generation of low-probability modes in multi-agent joint prediction. To tackle this issue, we…

Robotics · Computer Science 2025-07-24 Fangze Lin , Ying He , Fei Yu , Hong Zhang

The ability of intelligent systems to predict human behaviors is crucial, particularly in fields such as autonomous vehicle navigation and social robotics. However, the complexity of human motion have prevented the development of a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Yang Gao , Po-Chien Luan , Alexandre Alahi

Accurate and robust trajectory prediction of neighboring agents is critical for autonomous vehicles traversing in complex scenes. Most methods proposed in recent years are deep learning-based due to their strength in encoding complex…

Robotics · Computer Science 2023-03-27 Yujun Jiao , Mingze Miao , Zhishuai Yin , Chunyuan Lei , Xu Zhu , Linzhen Nie , Bo Tao

Existing top-performance autonomous driving systems typically rely on the multi-modal fusion strategy for reliable scene understanding. This design is however fundamentally restricted due to overlooking the modality-specific strengths and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Zeyu Yang , Nan Song , Wei Li , Xiatian Zhu , Li Zhang , Philip H. S. Torr

Accurate beam prediction is essential for mitigating signalling overhead and latency in integrated sensing and communication-enabled massive multi-input multi-output systems. With the aid of multimodal learning, the prediction accuracy can…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Zijian Zheng , Wenqiang Yi , Hyundong Shin , Arumugam Nallanathan

High-level driving behavior decision-making is an open-challenging problem for connected vehicle technology, especially in heterogeneous traffic scenarios. In this paper, a deep reinforcement learning based high-level driving behavior…

Machine Learning · Computer Science 2019-02-27 Zhengwei Bai , Baigen Cai , Wei Shangguan , Linguo Chai

As autonomous driving technology progresses, the need for precise trajectory prediction models becomes paramount. This paper introduces an innovative model that infuses cognitive insights into trajectory prediction, focusing on perceived…

We present CoverNet, a new method for multimodal, probabilistic trajectory prediction for urban driving. Previous work has employed a variety of methods, including multimodal regression, occupancy maps, and 1-step stochastic policies. We…

Machine Learning · Computer Science 2020-04-03 Tung Phan-Minh , Elena Corina Grigore , Freddy A. Boulton , Oscar Beijbom , Eric M. Wolff

In this paper, we introduce a novel framework that can learn to make visual predictions about the motion of a robotic agent from raw video frames. Our proposed motion prediction network (PROM-Net) can learn in a completely unsupervised…

Robotics · Computer Science 2019-06-26 Meenakshi Sarkar , Prabhu Pradhan , Debasish Ghose

We address the decision-making capability within an end-to-end planning framework that focuses on motion prediction, decision-making, and trajectory planning. Specifically, we formulate decision-making and trajectory planning as a…

Robotics · Computer Science 2024-12-03 Wenru Liu , Yongkang Song , Chengzhen Meng , Zhiyu Huang , Haochen Liu , Chen Lv , Jun Ma