English
Related papers

Related papers: SceneFactory: GPU-Accelerated Multi-Agent Driving …

200 papers

The development of software components for autonomous driving functions should always include an extensive and rigorous evaluation. Since real-world testing is expensive and safety-critical -- especially when facing dynamic racing scenarios…

Robotics · Computer Science 2020-06-18 Tim Stahl , Johannes Betz

Simulators offer the possibility of safe, low-cost development of self-driving systems. However, current driving simulators exhibit na\"ive behavior models for background traffic. Hand-tuned scenarios are typically added during simulation…

Robotics · Computer Science 2022-04-29 Niklas Hanselmann , Katrin Renz , Kashyap Chitta , Apratim Bhattacharyya , Andreas Geiger

The generation of realistic and diverse traffic scenarios in simulation is essential for developing and evaluating autonomous driving systems. However, most simulation frameworks rely on rule-based or simplified models for scene generation,…

Multiagent Systems · Computer Science 2025-12-02 Jiaguo Tian , Zhengbang Zhu , Shenyu Zhang , Li Xu , Bo Zheng , Xu Liu , Weiji Peng , Shizeng Yao , Weinan Zhang

Human motion is inherently diverse and semantically rich, while also shaped by the surrounding scene. However, existing motion generation approaches fail to generate semantically diverse motion while simultaneously respecting geometric…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jungbin Cho , Minsu Kim , Jisoo Kim , Ce Zheng , Laszlo A. Jeni , Ming-Hsuan Yang , Youngjae Yu , Seonjoo Kim

LangDriveCTRL is a natural-language-controllable framework for editing real-world driving videos to synthesize diverse traffic scenarios. It represents each video as an explicit 3D scene graph, decomposing the scene into a static background…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Yun He , Francesco Pittaluga , Ziyu Jiang , Matthias Zwicker , Manmohan Chandraker , Zaid Tasneem

We identify the need for a gamified self-driving simulator where game mechanics encourage high-quality data capture, and design and apply such a simulator to collecting lane-following training data. The resulting synthetic data enables a…

Robotics · Computer Science 2019-11-19 Joshua E. Siegel , Georgios Pappas , Konstantinos Politopoulos , Yongbin Sun

While autonomous driving technologies continue to advance, current Advanced Driver Assistance Systems (ADAS) remain limited in their ability to interpret scene context or engage with drivers through natural language. These systems typically…

Robotics · Computer Science 2025-07-15 Kyungtae Han , Yitao Chen , Rohit Gupta , Onur Altintas

Autonomous driving faces challenges in navigating complex real-world traffic, requiring safe handling of both common and critical scenarios. Reinforcement learning (RL), a prominent method in end-to-end driving, enables agents to learn…

Robotics · Computer Science 2026-03-09 Ahmed Abouelazm , Johannes Ratz , Philip Schörner , J. Marius Zöllner

Reinforcement learning has been demonstrated to outperform even the best humans in complex domains like video games. However, running reinforcement learning experiments on the required scale for autonomous driving is extremely difficult.…

Machine Learning · Computer Science 2024-11-06 Moritz Harmel , Anubhav Paras , Andreas Pasternak , Nicholas Roy , Gary Linscott

Ensuring the functional correctness and safety of autonomous vehicles is a major challenge for the automotive industry. However, exhaustive physical test drives are not feasible, as billions of driven kilometers would be required to obtain…

Software Engineering · Computer Science 2021-02-09 Barbara Schuett , Thilo Braun , Stefan Otten , Eric Sax

Conducting real road testing for autonomous driving algorithms can be expensive and sometimes impractical, particularly for small startups and research institutes. Thus, simulation becomes an important method for evaluating these…

This paper presents a scenario generation framework that creates diverse, parametrized, and safety-critical driving situations to validate the safety features of autonomous vehicles in simulation [15]. By modeling factors such as road…

Systems and Control · Electrical Eng. & Systems 2026-04-09 Kiruthiga Chandra Shekar , Aliasghar Moj Arab

Simulation has the potential to massively scale evaluation of self-driving systems enabling rapid development as well as safe deployment. To close the gap between simulation and the real world, we need to simulate realistic multi-agent…

Robotics · Computer Science 2021-01-19 Simon Suo , Sebastian Regalado , Sergio Casas , Raquel Urtasun

We present a GPU-friendly framework for real-time implicit simulation of elastic material in the presence of frictional contacts. The integration of hyperelasticity, non-interpenetration contact, and friction in real-time simulations…

Graphics · Computer Science 2025-03-20 Ziqiu Zeng , Siyuan Luo , Fan Shi , Zhongkai Zhang

Simulation has become a key tool for training and evaluating home robots at scale, yet existing environments fail to capture the diversity and physical complexity of real indoor spaces. Current scene synthesis methods produce sparsely…

Robotics · Computer Science 2026-02-12 Nicholas Pfaff , Thomas Cohn , Sergey Zakharov , Rick Cory , Russ Tedrake

Autonomous racing presents unique challenges due to its non-linear dynamics, the high speed involved, and the critical need for real-time decision-making under dynamic and unpredictable conditions. Most traditional Reinforcement Learning…

Robotics · Computer Science 2025-05-13 Benedict Hildisch , Edoardo Ghignone , Nicolas Baumann , Cheng Hu , Andrea Carron , Michele Magno

Scenario-based testing using simulations is a cornerstone of Autonomous Vehicles (AVs) software validation. So far, developers needed to choose between low-fidelity 2D simulators to explore the scenario space efficiently, and high-fidelity…

Robotics · Computer Science 2025-05-21 Marc Kaufeld , Korbinian Moller , Alessio Gambi , Paolo Arcaini , Johannes Betz

This paper presents a digital-twin platform for active safety analysis in mixed traffic environments. The platform is built using a multi-modal data-enabled traffic environment constructed from drone-based aerial LiDAR, OpenStreetMap, and…

Robotics · Computer Science 2025-04-28 Hao Zhang , Ximin Yue , Kexin Tian , Sixu Li , Keshu Wu , Zihao Li , Dominique Lord , Yang Zhou

Testing Automated Driving Systems (ADS) in simulation with realistic driving scenarios is important for verifying their performance. However, converting real-world driving videos into simulation scenarios is a significant challenge due to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Yan Miao , Georgios Fainekos , Bardh Hoxha , Hideki Okamoto , Danil Prokhorov , Sayan Mitra

Behavior prediction remains one of the most challenging tasks in the autonomous vehicle (AV) software stack. Forecasting the future trajectories of nearby agents plays a critical role in ensuring road safety, as it equips AVs with the…

Artificial Intelligence · Computer Science 2021-11-16 Francis Indaheng , Edward Kim , Kesav Viswanadha , Jay Shenoy , Jinkyu Kim , Daniel J. Fremont , Sanjit A. Seshia