English
Related papers

Related papers: Trajeglish: Traffic Modeling as Next-Token Predict…

200 papers

Realistic scene-level multi-agent motion simulations are crucial for developing and evaluating self-driving algorithms. However, most existing works focus on generating trajectories for a certain single agent type, and typically ignore the…

Robotics · Computer Science 2023-11-28 Zhiming Guo , Xing Gao , Jianlan Zhou , Xinyu Cai , Botian Shi

Autonomous driving relies on a huge volume of real-world data to be labeled to high precision. Alternative solutions seek to exploit driving simulators that can generate large amounts of labeled data with a plethora of content variations.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 David Acuna , Jonah Philion , Sanja Fidler

We focus on the problem of analyzing multiagent interactions in traffic domains. Understanding the space of behavior of real-world traffic may offer significant advantages for algorithmic design, data-driven methodologies, and benchmarking.…

Robotics · Computer Science 2022-05-20 Christoforos Mavrogiannis , Jonathan DeCastro , Siddhartha S. Srinivasa

Modeling interactive driving behaviors in complex scenarios remains a fundamental challenge for autonomous driving planning. Learning-based approaches attempt to address this challenge with advanced generative models, removing the…

World models have become increasingly popular in acting as learned traffic simulators. Recent work has explored replacing traditional traffic simulators with world models for policy training. In this work, we explore the robustness of…

Robotics · Computer Science 2025-08-05 Hunter Schofield , Mohammed Elmahgiubi , Kasra Rezaee , Jinjun Shan

Interpretation of common-yet-challenging interaction scenarios can benefit well-founded decisions for autonomous vehicles. Previous research achieved this using their prior knowledge of specific scenarios with predefined models, limiting…

Robotics · Computer Science 2022-05-31 Chengyuan Zhang , Jiacheng Zhu , Wenshuo Wang , Junqiang Xi

In autonomous driving tasks, scene understanding is the first step towards predicting the future behavior of the surrounding traffic participants. Yet, how to represent a given scene and extract its features are still open research…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Ali Keysan , Andreas Look , Eitan Kosman , Gonca Gürsun , Jörg Wagner , Yu Yao , Barbara Rakitsch

Predicting traffic agents' trajectories is an important task for auto-piloting. Most previous work on trajectory prediction only considers a single class of road agents. We use a sequence-to-sequence model to predict future paths from…

Machine Learning · Computer Science 2021-10-25 Shilun Li , Tracy Cai , Jiayi Li

Trajectory prediction module in an autonomous driving system is crucial for the decision-making and safety of the autonomous agent car and its surroundings. This work presents a novel scheme called AiGem (Agent-Interaction Graph Embedding)…

Robotics · Computer Science 2025-03-27 Jilan Samiuddin , Benoit Boulet , Di Wu

Effectively capturing the joint distribution of all agents in a scene is relevant for predicting the true evolution of the scene and in turn providing more accurate information to the decision processes of autonomous vehicles. While new…

Robotics · Computer Science 2026-01-28 Anna Mészáros , Javier Alonso-Mora , Jens Kober

Predicting the possible future trajectories of the surrounding dynamic agents is an essential requirement in autonomous driving. These trajectories mainly depend on the surrounding static environment, as well as the past movements of those…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Bimsara Pathiraja , Shehan Munasinghe , Malshan Ranawella , Maleesha De Silva , Ranga Rodrigo , Peshala Jayasekara

Predicting the future paths of an agent's neighbors accurately and in a timely manner is central to the autonomous applications for collision avoidance. Conventional approaches, e.g., LSTM-based models, take considerable computational costs…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Chengxin Wang , Shaofeng Cai , Gary Tan

Adaptive cognition requires structured internal models of objects and their relations. Predictive neural networks are often proposed to learn such world models, but how these are instantiated and how they support prediction remain unclear.…

Machine Learning · Computer Science 2026-05-11 Linda Ariel Ventura , Victoria Bosch , Tim C Kietzmann , Sushrut Thorat

For motion planning and control of autonomous vehicles to be proactive and safe, pedestrians' and other road users' motions must be considered. In this paper, we present a vehicle motion planning and control framework, based on Model…

Systems and Control · Computer Science 2019-03-20 Ivo Batkovic , Mario Zanon , Mohammad Ali , Paolo Falcone

Precise modeling of microscopic vehicle trajectories is critical for traffic behavior analysis and autonomous driving systems. We propose Ctx2TrajGen, a context-aware trajectory generation framework that synthesizes realistic urban driving…

Artificial Intelligence · Computer Science 2025-07-24 Joobin Jin , Seokjun Hong , Gyeongseon Baek , Yeeun Kim , Byeongjoon Noh

Planner evaluation in closed-loop simulation often uses rule-based traffic agents, whose simplistic and passive behavior can hide planner deficiencies and bias rankings. Widely used IDM agents simply follow a lead vehicle and cannot react…

Robotics · Computer Science 2025-10-17 Steffen Hagedorn , Luka Donkov , Aron Distelzweig , Alexandru P. Condurache

Predicting the motion of multiple agents is necessary for planning in dynamic environments. This task is challenging for autonomous driving since agents (e.g. vehicles and pedestrians) and their associated behaviors may be diverse and…

As autonomous driving systems being deployed to millions of vehicles, there is a pressing need of improving the system's scalability, safety and reducing the engineering cost. A realistic, scalable, and practical simulator of the driving…

Robotics · Computer Science 2024-07-04 Yihan Hu , Siqi Chai , Zhening Yang , Jingyu Qian , Kun Li , Wenxin Shao , Haichao Zhang , Wei Xu , Qiang Liu

Training self-driving cars is often challenging since they require a vast amount of labeled data in multiple real-world contexts, which is computationally and memory intensive. Researchers often resort to driving simulators to train the…

Artificial Intelligence · Computer Science 2022-12-01 Avinash Amballa , Advaith P. , Pradip Sasmal , Sumohana Channappayya

Verifying highly automated driving functions can be challenging, requiring identifying relevant test scenarios. Scenario-based testing will likely play a significant role in verifying these systems, predominantly occurring within…

Robotics · Computer Science 2024-04-29 Maximilian Zipfl , Barbara Schütt , J. Marius Zöllner