English
Related papers

Related papers: BehaviorGPT: Smart Agent Simulation for Autonomous…

200 papers

Simulation has the potential to massively scale evaluation of self-driving systems enabling rapid development as well as safe deployment. To close the gap between simulation and the real world, we need to simulate realistic multi-agent…

Robotics · Computer Science 2021-01-19 Simon Suo , Sebastian Regalado , Sergio Casas , Raquel Urtasun

Motion forecasting for agents in autonomous driving is highly challenging due to the numerous possibilities for each agent's next action and their complex interactions in space and time. In real applications, motion forecasting takes place…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Nan Song , Bozhou Zhang , Xiatian Zhu , Li Zhang

Realistic scene-level multi-agent motion simulations are crucial for developing and evaluating self-driving algorithms. However, most existing works focus on generating trajectories for a certain single agent type, and typically ignore the…

Robotics · Computer Science 2023-11-28 Zhiming Guo , Xing Gao , Jianlan Zhou , Xinyu Cai , Botian Shi

A major challenge in autonomous vehicle research is modeling agent behaviors, which has critical applications including constructing realistic and reliable simulations for off-board evaluation and forecasting traffic agents motion for…

Artificial Intelligence · Computer Science 2024-09-30 Zhenghao Peng , Wenjie Luo , Yiren Lu , Tianyi Shen , Cole Gulino , Ari Seff , Justin Fu

Recent breakthroughs in autonomous driving have been propelled by advances in robust world modeling, fundamentally transforming how vehicles interpret dynamic scenes and execute safe decision-making. World models have emerged as a linchpin…

Robotics · Computer Science 2025-09-11 Tuo Feng , Wenguan Wang , Yi Yang

People's transportation choices reflect complex trade-offs shaped by personal preferences, social norms, and technology acceptance. Predicting such behavior at scale is a critical challenge with major implications for urban planning and…

Human-Computer Interaction · Computer Science 2026-01-28 Simon Lämmer , Mark Colley , Patrick Ebel

Forecasting future trajectories of agents in complex traffic scenes requires reliable and efficient predictions for all agents in the scene. However, existing methods for trajectory prediction are either inefficient or sacrifice accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Görkay Aydemir , Adil Kaan Akan , Fatma Güney

Understanding human behavior in built environments is critical for designing functional, user centered urban spaces. Traditional approaches, such as manual observations, surveys, and simplified simulations, often fail to capture the…

Artificial Intelligence · Computer Science 2024-12-30 Ariel Noyman , Kai Hu , Kent Larson

As the foundation of closed-loop training and evaluation in autonomous driving, traffic simulation still faces two fundamental challenges: covariate shift introduced by open-loop imitation learning and limited capacity to reflect the…

Robotics · Computer Science 2026-02-03 Keyu Chen , Wenchao Sun , Hao Cheng , Zheng Fu , Sifa Zheng

Scalable and realistic simulation of multi-agent traffic behavior is critical for advancing autonomous driving technologies. Although existing data-driven simulators have made significant strides in this domain, they predominantly rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Muleilan Pei , Shaoshuai Shi , Shaojie Shen

Simulation environments are good for learning different driving tasks like lane changing, parking or handling intersections etc. in an abstract manner. However, these simulation environments often restrict themselves to operate under…

Machine Learning · Computer Science 2021-11-01 Ashish Rana , Avleen Malhi

Predicting the motion of other agents in a scene is highly relevant for autonomous driving, as it allows a self-driving car to anticipate. Inspired by the success of decoder-only models for language modeling, we propose DONUT, a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Markus Knoche , Daan de Geus , Bastian Leibe

Realistic and diverse simulation scenarios with reactive and feasible agent behaviors can be used for validation and verification of self-driving system performance without relying on expensive and time-consuming real-world testing.…

Robotics · Computer Science 2022-04-01 Qichao Zhang , Yinfeng Gao , Yikang Zhang , Youtian Guo , Dawei Ding , Yunpeng Wang , Peng Sun , Dongbin Zhao

The next generation of active safety features in autonomous vehicles should be capable of safely executing evasive hazard-avoidance maneuvers akin to those performed by professional stunt drivers to achieve high-agility motion at the limits…

Robotics · Computer Science 2026-04-09 Shawn Azdam , Pranav Doma , Aliasghar Moj Arab

Multi-agent trajectory prediction is a fundamental problem in autonomous driving. The key challenges in prediction are accurately anticipating the behavior of surrounding agents and understanding the scene context. To address these…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Elmira Amirloo , Amir Rasouli , Peter Lakner , Mohsen Rohani , Jun Luo

Multi-agent trajectory forecasting in autonomous driving requires an agent to accurately anticipate the behaviors of the surrounding vehicles and pedestrians, for safe and reliable decision-making. Due to partial observability in these…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Seong Hyeon Park , Gyubok Lee , Manoj Bhat , Jimin Seo , Minseok Kang , Jonathan Francis , Ashwin R. Jadhav , Paul Pu Liang , Louis-Philippe Morency

Behavior prediction in dynamic, multi-agent systems is an important problem in the context of self-driving cars, due to the complex representations and interactions of road components, including moving agents (e.g. pedestrians and vehicles)…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Jiyang Gao , Chen Sun , Hang Zhao , Yi Shen , Dragomir Anguelov , Congcong Li , Cordelia Schmid

The precise prediction of multi-scale traffic is a ubiquitous challenge in the urbanization process for car owners, road administrators, and governments. In the case of complex road networks, current and past traffic information from both…

Machine Learning · Computer Science 2024-05-13 Jinhui Ouyang , Yijie Zhu , Xiang Yuan , Di Wu

Behavior prediction models have proliferated in recent years, especially in the popular real-world robotics application of autonomous driving, where representing the distribution over possible futures of moving agents is essential for safe…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 DiJia Su , Bertrand Douillard , Rami Al-Rfou , Cheolho Park , Benjamin Sapp

Predicting the motion of multiple traffic participants has always been one of the most challenging tasks in autonomous driving. The recently proposed occupancy flow field prediction method has shown to be a more effective and scalable…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Zhan Chen , Chen Tang , Lu Xiong