English
Related papers

Related papers: BiFF: Bi-level Future Fusion with Polyline-based C…

200 papers

Multi-agent trajectory forecasting in autonomous driving requires an agent to accurately anticipate the behaviors of the surrounding vehicles and pedestrians, for safe and reliable decision-making. Due to partial observability in these…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Seong Hyeon Park , Gyubok Lee , Manoj Bhat , Jimin Seo , Minseok Kang , Jonathan Francis , Ashwin R. Jadhav , Paul Pu Liang , Louis-Philippe Morency

This paper presents a novel approach to improving autonomous vehicle control in environments lacking clear road markings by integrating a diffusion-based motion predictor within an Active Inference Framework (AIF). Using a simulated parking…

Robotics · Computer Science 2024-06-04 Yufei Huang , Yulin Li , Andrea Matta , Mohsen Jafari

Behavior prediction plays an important role in integrated autonomous driving software solutions. In behavior prediction research, interactive behavior prediction is a less-explored area, compared to single-agent behavior prediction.…

Artificial Intelligence · Computer Science 2022-11-01 Yutian Pang , Zehua Guo , Binnan Zhuang

Temporal prediction is critical for making intelligent and robust decisions in complex dynamic environments. Motion prediction needs to model the inherently uncertain future which often contains multiple potential outcomes, due to…

Machine Learning · Computer Science 2019-12-10 Yichuan Charlie Tang , Ruslan Salakhutdinov

In autonomous driving, recent research has increasingly focused on collaborative perception based on deep learning to overcome the limitations of individual perception systems. Although these methods achieve high accuracy, they rely on high…

Robotics · Computer Science 2025-07-04 Maryem Fadili , Mohamed Anis Ghaoui , Louis Lecrosnier , Steve Pechberti , Redouane Khemmar

Trajectory prediction is crucial for autonomous driving as it aims to forecast the future movements of traffic participants. Traditional methods usually perform holistic inference on the trajectories of agents, neglecting the differences in…

Robotics · Computer Science 2024-12-20 Guipeng Xin , Duanfeng Chu , Liping Lu , Zejian Deng , Yuang Lu , Xigang Wu

For autonomous agents to successfully operate in real world, the ability to anticipate future motions of surrounding entities in the scene can greatly enhance their safety levels since potentially dangerous situations could be avoided in…

Machine Learning · Computer Science 2019-06-04 Yeping Hu , Wei Zhan , Liting Sun , Masayoshi Tomizuka

In a given scenario, simultaneously and accurately predicting every possible interaction of traffic participants is an important capability for autonomous vehicles. The majority of current researches focused on the prediction of an single…

Machine Learning · Computer Science 2018-10-31 Yeping Hu , Wei Zhan , Masayoshi Tomizuka

Motion prediction is highly relevant to the perception of dynamic objects and static map elements in the scenarios of autonomous driving. In this work, we propose PIP, the first end-to-end Transformer-based framework which jointly and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Bo Jiang , Shaoyu Chen , Xinggang Wang , Bencheng Liao , Tianheng Cheng , Jiajie Chen , Helong Zhou , Qian Zhang , Wenyu Liu , Chang Huang

Reasoning with occluded traffic agents is a significant open challenge for planning for autonomous vehicles. Recent deep learning models have shown impressive results for predicting occluded agents based on the behaviour of nearby visible…

Machine Learning · Computer Science 2022-10-27 Filippos Christianos , Peter Karkus , Boris Ivanovic , Stefano V. Albrecht , Marco Pavone

Pedestrian crossing intention prediction is essential for autonomous vehicles to improve pedestrian safety and reduce traffic accidents. However, accurate pedestrian intention prediction in urban environments remains challenging due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yuanzhe Li , Hang Zhong , Steffen Müller

Motion forecasting for autonomous driving is a challenging task because complex driving scenarios result in a heterogeneous mix of static and dynamic inputs. It is an open problem how best to represent and fuse information about road…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Nigamaa Nayakanti , Rami Al-Rfou , Aurick Zhou , Kratarth Goel , Khaled S. Refaat , Benjamin Sapp

Predicting future motions of road participants is an important task for driving autonomously. Most existing models excel at predicting the marginal trajectory of a single agent, but predicting joint trajectories for multiple agents that are…

Robotics · Computer Science 2024-11-26 Mingyi Wang , Hongqun Zou , Yifan Liu , You Wang , Guang Li

Predicting the trajectories of surrounding agents is an essential ability for autonomous vehicles navigating through complex traffic scenes. The future trajectories of agents can be inferred using two important cues: the locations and past…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Kaouther Messaoud , Nachiket Deo , Mohan M. Trivedi , Fawzi Nashashibi

Many robotics applications, from object manipulation to locomotion, require planning methods that are capable of handling the dynamics of contact. Trajectory optimization has been shown to be a viable approach that can be made to support…

Robotics · Computer Science 2019-09-09 Benoit Landry , Joseph Lorenzetti , Zachary Manchester , Marco Pavone

Existing top-performance autonomous driving systems typically rely on the multi-modal fusion strategy for reliable scene understanding. This design is however fundamentally restricted due to overlooking the modality-specific strengths and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Zeyu Yang , Nan Song , Wei Li , Xiatian Zhu , Li Zhang , Philip H. S. Torr

In this paper, we address the problem of predicting the future motion of a dynamic agent (called a target agent) given its current and past states as well as the information on its environment. It is paramount to develop a prediction model…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 ByeoungDo Kim , Seong Hyeon Park , Seokhwan Lee , Elbek Khoshimjonov , Dongsuk Kum , Junsoo Kim , Jeong Soo Kim , Jun Won Choi

Pedestrian crossing intention prediction is essential for the deployment of autonomous vehicles (AVs) in urban environments. Ideal prediction provides AVs with critical environmental cues, thereby reducing the risk of pedestrian-related…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yuanzhe Li , Steffen Müller

A complex visual navigation task puts an agent in different situations which call for a diverse range of visual perception abilities. For example, to "go to the nearest chair", the agent might need to identify a chair in a living room using…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Bokui Shen , Danfei Xu , Yuke Zhu , Leonidas J. Guibas , Li Fei-Fei , Silvio Savarese

Autonomous driving holds transformative potential but remains fundamentally constrained by the limited perception and isolated decision-making with standalone intelligence. While recent multi-agent approaches introduce cooperation, they…

Robotics · Computer Science 2025-11-13 Ziyi Song , Chen Xia , Chenbing Wang , Haibao Yu , Sheng Zhou , Zhisheng Niu