English
Related papers

Related papers: Composing Driving Worlds through Disentangled Cont…

200 papers

Microscopic traffic simulation has become an important tool for autonomous driving training and testing. Although recent data-driven approaches advance realistic behavior generation, their learning still relies primarily on a single…

Artificial Intelligence · Computer Science 2025-03-11 Shenyu Zhang , Jiaguo Tian , Zhengbang Zhu , Shan Huang , Jucheng Yang , Weinan Zhang

Safety validation of autonomous driving systems is extremely challenging due to the high risks and costs of real-world testing as well as the rarity and diversity of potential failures. To address these challenges, we train a denoising…

Robotics · Computer Science 2025-06-11 Juanran Wang , Marc R. Schlichting , Harrison Delecki , Mykel J. Kochenderfer

Collaborative perception allows connected and autonomous vehicles (CAVs) to improve perception by sharing sensory data, but it also introduces security risks from manipulated inputs. Prior work shows that attackers can spoof or remove…

Cryptography and Security · Computer Science 2026-05-05 Qingzhao Zhang , Runting Zhang , Z. Morley Mao

Deep reinforcement learning (DRL) has achieved remarkable progress in online path planning tasks for multi-UAV systems. However, existing DRL-based methods often suffer from performance degradation when tackling unseen scenarios, since the…

Robotics · Computer Science 2024-07-16 Jiafan Zhuang , Zihao Xia , Gaofei Han , Boxi Wang , Wenji Li , Dongliang Wang , Zhifeng Hao , Ruichu Cai , Zhun Fan

Extracting interesting scenarios from real-world data as well as generating failure cases is important for the development and testing of autonomous systems. We propose efficient mechanisms to both characterize and generate testing…

Existing generative approaches for guided image synthesis of multi-object scenes typically rely on 2D controls in the image or text space. As a result, these methods struggle to maintain and respect consistent three-dimensional geometric…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Léopold Maillard , Tom Durand , Adrien Ramanana Rahary , Maks Ovsjanikov

Generating photorealistic driving videos has seen significant progress recently, but current methods largely focus on ordinary, non-adversarial scenarios. Meanwhile, efforts to generate adversarial driving scenarios often operate on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Zhiyuan Xu , Bohan Li , Huan-ang Gao , Mingju Gao , Yong Chen , Ming Liu , Chenxu Yan , Hang Zhao , Shuo Feng , Hao Zhao

Understanding the context of crash occurrence in complex driving environments is essential for improving traffic safety and advancing automated driving. Previous studies have used statistical models and deep learning to predict crashes…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Meng Wang , Zach Noonan , Pnina Gershon , Bruce Mehler , Bryan Reimer , Shannon C. Roberts

Disentangled representations support a range of downstream tasks including causal reasoning, generative modeling, and fair machine learning. Unfortunately, disentanglement has been shown to be impossible without the incorporation of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Matthew J. Vowels , Necati Cihan Camgoz , Richard Bowden

Generating high-fidelity and controllable synthetic data is critical for advancing end-to-end autonomous driving, particularly for addressing the long tail of rare safety-critical scenarios. Existing occupancy-guided methods typically rely…

Robotics · Computer Science 2026-05-26 Haiming Zhang , Junfei Zhou , Feng Jiang , Jingzhong Li , Zhenglong Guo , Penglin Dai , Jifeng Dai , Yan Xie , Benjin Zhu

Text-to-image diffusion generative models can generate high quality images at the cost of tedious prompt engineering. Controllability can be improved by introducing layout conditioning, however existing methods lack layout editing ability…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Alessandro Fontanella , Petru-Daniel Tudosiu , Yongxin Yang , Shifeng Zhang , Sarah Parisot

Constrained generative modeling is fundamental to applications such as robotic control and autonomous driving, where models must respect physical laws and safety-critical constraints. In real-world settings, these constraints rarely take…

Machine Learning · Computer Science 2026-03-10 Xiaoxuan Liang , Saeid Naderiparizi , Yunpeng Liu , Berend Zwartsenberg , Frank Wood

This paper presents a novel two-level control architecture for a fully autonomous vehicle in a deterministic environment, which can handle traffic rules as specifications and low-level vehicle control with real-time performance. At the top…

Robotics · Computer Science 2021-05-07 Erfan Aasi , Cristian Ioan Vasile , Calin Belta

Building on the success of diffusion models, significant advancements have been made in multimodal image generation tasks. Among these, human image generation has emerged as a promising technique, offering the potential to revolutionize the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Shiyue Zhang , Zheng Chong , Xi Lu , Wenqing Zhang , Haoxiang Li , Xujie Zhang , Jiehui Huang , Xiao Dong , Xiaodan Liang

Generating safety-critical scenarios, which are essential yet difficult to collect at scale, offers an effective method to evaluate the robustness of autonomous vehicles (AVs). Existing methods focus on optimizing adversariality while…

Robotics · Computer Science 2024-10-14 Keyu Chen , Yuheng Lei , Hao Cheng , Haoran Wu , Wenchao Sun , Sifa Zheng

The generation of realistic and diverse traffic scenarios in simulation is essential for developing and evaluating autonomous driving systems. However, most simulation frameworks rely on rule-based or simplified models for scene generation,…

Multiagent Systems · Computer Science 2025-12-02 Jiaguo Tian , Zhengbang Zhu , Shenyu Zhang , Li Xu , Bo Zheng , Xu Liu , Weiji Peng , Shizeng Yao , Weinan Zhang

An open question in autonomous driving is how best to use simulation to validate the safety of autonomous vehicles. Existing techniques rely on simulated rollouts, which can be inefficient for finding rare failure events, while other…

Robotics · Computer Science 2020-06-29 Anthony Corso , Ritchie Lee , Mykel J. Kochenderfer

Generating controllable indoor scenes is fundamental to applications in game development, architectural visualization, and embodied AI. However, existing approaches either support a limited input modalities or rely on implicit generation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Wentang Chen , Shougao Zhang , Yiman Zhang , Tianhao Zhou , Ruihui Li

Ensuring the safety and reliability of Automated Driving Systems (ADS) remains a critical challenge, as traditional verification methods such as large-scale on-road testing are prohibitively costly and time-consuming.To address…

Software Engineering · Computer Science 2025-12-18 Ji Zhou , Yongqi Zhao , Yixian Hu , Hexuan Li , Zhengguo Gu , Nan Xu , Arno Eichberger

Generating realistic 3D indoor scenes from user inputs remains a challenging problem in computer vision and graphics, requiring careful balance of geometric consistency, spatial relationships, and visual realism. While neural generation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Mengqi Zhou , Xipeng Wang , Yuxi Wang , Zhaoxiang Zhang