English
Related papers

Related papers: Controllable Latent Diffusion for Traffic Simulati…

200 papers

The integration of Diffusion Models into Intelligent Transportation Systems (ITS) is a substantial improvement in the detection of accidents. We present a novel hybrid model integrating guidance classification with diffusion techniques. By…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Siva Sai , Saksham Gupta , Vinay Chamola , Rajkumar Buyya

We explore a novel video creation experience, namely Video Creation by Demonstration. Given a demonstration video and a context image from a different scene, we generate a physically plausible video that continues naturally from the context…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Yihong Sun , Hao Zhou , Liangzhe Yuan , Jennifer J. Sun , Yandong Li , Xuhui Jia , Hartwig Adam , Bharath Hariharan , Long Zhao , Ting Liu

Evaluating and improving planning for autonomous vehicles requires scalable generation of long-tail traffic scenarios. To be useful, these scenarios must be realistic and challenging, but not impossible to drive through safely. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Davis Rempe , Jonah Philion , Leonidas J. Guibas , Sanja Fidler , Or Litany

Implementing an autonomous vehicle that is able to output feasible, smooth and efficient trajectories is a long-standing challenge. Several approaches have been considered, roughly falling under two categories: rule-based and learning-based…

Robotics · Computer Science 2022-03-22 Branka Mirchevska , Moritz Werling , Joschka Boedecker

Diffusion models are promising for joint trajectory prediction and controllable generation in autonomous driving, but they face challenges of inefficient inference steps and high computational demands. To tackle these challenges, we…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Yixiao Wang , Chen Tang , Lingfeng Sun , Simone Rossi , Yichen Xie , Chensheng Peng , Thomas Hannagan , Stefano Sabatini , Nicola Poerio , Masayoshi Tomizuka , Wei Zhan

Traffic simulation, complementing real-world data with a long-tail distribution, allows for effective evaluation and enhancement of the ability of autonomous vehicles to handle accident-prone scenarios. Simulating such safety-critical…

Robotics · Computer Science 2025-03-10 Zherui Huang , Xing Gao , Guanjie Zheng , Licheng Wen , Xuemeng Yang , Xiao Sun

Navigating dense, lane-less traffic remains one of the most challenging scenarios for autonomous vehicles, especially in emerging regions where road structure and driver behavior are highly unpredictable. This paper presents a hybrid…

Systems and Control · Electrical Eng. & Systems 2026-05-19 Parthib Khound

World models, especially in autonomous driving, are trending and drawing extensive attention due to their capacity for comprehending driving environments. The established world model holds immense potential for the generation of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Xiaofeng Wang , Zheng Zhu , Guan Huang , Xinze Chen , Jiagang Zhu , Jiwen Lu

This paper presents a learning from demonstration approach to programming safe, autonomous behaviors for uncommon driving scenarios. Simulation is used to re-create a targeted driving situation, one containing a road-side hazard creating a…

Robotics · Computer Science 2018-06-04 Priyam Parashar , Akansel Cosgun , Alireza Nakhaei , Kikuo Fujimura

Given the promising future of autonomous vehicles, it is foreseeable that self-driving cars will soon emerge as the predominant mode of transportation. While autonomous vehicles offer enhanced efficiency, they remain vulnerable to external…

Cryptography and Security · Computer Science 2026-02-17 Saurav Silwal , Lu Gao , Ph. D. Yunpeng Zhang , Ph. D. Ahmed Senouci , Ph. D. Yi-Lung Mo , Ph. D. , P. E

Realistic and controllable simulation is critical for advancing end-to-end autonomous driving, yet existing approaches often struggle to support novel view synthesis under large viewpoint changes or to ensure geometric consistency. We…

Recent advancements in computer graphics technology allow more realistic ren-dering of car driving environments. They have enabled self-driving car simulators such as DeepGTA-V and CARLA (Car Learning to Act) to generate large amounts of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Minh Cao , Ramin Ramezani

Autonomous driving requires reasoning about interactions with surrounding traffic. A prevailing approach is large-scale imitation learning on expert driving datasets, aimed at generalizing across diverse real-world scenarios. For online…

We introduce ScenarioControl, the first vision-language control mechanism for learned driving scenario generation. Given a text prompt or an input image, Scenario-Control synthesizes diverse, realistic 3D scenario rollouts - including map,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Lili Gao , Yanbo Xu , William Koch , Samuele Ruffino , Luke Rowe , Behdad Chalaki , Dmitriy Rivkin , Julian Ost , Roger Girgis , Mario Bijelic , Felix Heide

The proliferation of connected automated vehicles represents an unprecedented opportunity for improving driving efficiency and alleviating traffic congestion. However, existing research fails to address realistic multi-lane highway…

Multiagent Systems · Computer Science 2025-02-05 Yaron Veksler , Sharon Hornstein , Han Wang , Maria Laura Delle Monache , Daniel Urieli

Real-world autonomous driving, particularly in urban environments with numerous corner cases, requires rigorous testing to ensure product safety and robustness. However, few studies have explored integrating adversarial scenario generation…

Robotics · Computer Science 2026-05-18 Chuancheng Zhang , Zhenhao Wang , Kaizheng Li , Yaran Lin , Qiang Guo , Bin Jiang

Modern diffusion models generate realistic traffic simulations but systematically violate physical constraints. In a large-scale evaluation of SceneDiffuser++, a state-of-the-art traffic simulator, we find that 50% of generated trajectories…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Kargi Chauhan , Leilani H. Gilpin

Evaluating the safety of autonomous vehicles (AVs) requires diverse, safety-critical scenarios, with collisions being especially important yet rare and unsafe to collect in the real world. Therefore, the community has been focusing on…

Robotics · Computer Science 2026-02-24 Pin-Lun Chen , Chi-Hsi Kung , Che-Han Chang , Wei-Chen Chiu , Yi-Ting Chen

Formation and collision avoidance abilities are essential for multi-agent systems. Conventional methods usually require a central controller and global information to achieve collaboration, which is impractical in an unknown environment. In…

Robotics · Computer Science 2021-10-26 Xinyou Qiu , Xiaoxiang Li , Jian Wang , Yu Wang , Yuan Shen

Datasets are essential for training and testing vehicle perception algorithms. However, the collection and annotation of real-world images is time-consuming and expensive. Driving simulators offer a solution by automatically generating…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Haonan Zhao , Yiting Wang , Thomas Bashford-Rogers , Valentina Donzella , Kurt Debattista