English
Related papers

Related papers: Optimization-Guided Diffusion for Interactive Scen…

200 papers

Driving scene generation is a critical domain for autonomous driving, enabling downstream applications, including perception and planning evaluation. Occupancy-centric methods have recently achieved state-of-the-art results by offering…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Bohan Li , Xin Jin , Hu Zhu , Hongsi Liu , Ruikai Li , Jiazhe Guo , Kaiwen Cai , Chao Ma , Yueming Jin , Hao Zhao , Xiaokang Yang , Wenjun Zeng

Accurate prediction of driving scenes is essential for road safety and autonomous driving. Occupancy Grid Maps (OGMs) are commonly employed for scene prediction due to their structured spatial representation, flexibility across sensor…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Rabbia Asghar , Wenqian Liu , Lukas Rummelhard , Anne Spalanzani , Christian Laugier

Reliable traversable area segmentation in unstructured environments is critical for planning and decision-making in autonomous driving. However, existing data-driven approaches often suffer from degraded segmentation performance in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Zhihua Zhao , Guoqiang Li , Chen Min , Kangping Lu

Generating high-fidelity, controllable, and annotated training data is critical for autonomous driving. Existing methods typically generate a single data form directly from a coarse scene layout, which not only fails to output rich data…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Bohan Li , Jiazhe Guo , Hongsi Liu , Yingshuang Zou , Yikang Ding , Xiwu Chen , Hu Zhu , Feiyang Tan , Chi Zhang , Tiancai Wang , Shuchang Zhou , Li Zhang , Xiaojuan Qi , Hao Zhao , Mu Yang , Wenjun Zeng , Xin Jin

Learning-based planners generate natural human-like driving behaviors by learning to reason about nuanced interactions from data, overcoming the rigid behaviors that arise from rule-based planners. Nonetheless, data-driven approaches often…

Robotics · Computer Science 2025-06-02 Wenhao Ding , Sushant Veer , Yuxiao Chen , Yulong Cao , Chaowei Xiao , Marco Pavone

Ensuring the safety and robustness of autonomous driving systems necessitates a comprehensive evaluation in safety-critical scenarios. However, these safety-critical scenarios are rare and difficult to collect from real-world driving data,…

Artificial Intelligence · Computer Science 2025-08-19 Mingxing Peng , Yuting Xie , Xusen Guo , Ruoyu Yao , Hai Yang , Jun Ma

Forecasting human-environment interactions in daily activities is challenging due to the high variability of human behavior. While predicting directly from videos is possible, it is limited by confounding factors like irrelevant objects or…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Antonio Alliegro , Francesca Pistilli , Tatiana Tommasi , Giuseppe Averta

Training robots in simulation requires diverse 3D scenes that reflect the specific challenges of downstream tasks. However, scenes that satisfy strict task requirements, such as high-clutter environments with plausible spatial arrangement,…

Robotics · Computer Science 2025-08-27 Nicholas Pfaff , Hongkai Dai , Sergey Zakharov , Shun Iwase , Russ Tedrake

With the rapid advancement of autonomous driving technology, a lack of data has become a major obstacle to enhancing perception model accuracy. Researchers are now exploring controllable data generation using world models to diversify…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Xinqing Li , Ruiqi Song , Qingyu Xie , Ye Wu , Nanxin Zeng , Yunfeng Ai

Scene flow estimation is a crucial component in the development of autonomous driving and 3D robotics, providing valuable information for environment perception and navigation. Despite the advantages of learning-based scene flow estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Rahul Ahuja , Chris Baker , Wilko Schwarting

Understanding and predicting object motion from egocentric video is fundamental to embodied perception and interaction. However, generating physically consistent 6DoF trajectories remains challenging due to occlusions, fast motion, and the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Abhishek Saroha , Huajian Zeng , Xingxing Zuo , Daniel Cremers , Xi Wang

Simulation-based testing has emerged as an essential tool for verifying and validating autonomous vehicles (AVs). However, contemporary methodologies, such as deterministic and imitation learning-based driver models, struggle to capture the…

Robotics · Computer Science 2025-11-04 Cheng Wang , Lingxin Kong , Massimiliano Tamborski , Stefano V. Albrecht

This paper introduces UniGen, a novel approach to generating new traffic scenarios for evaluating and improving autonomous driving software through simulation. Our approach models all driving scenario elements in a unified model: the…

This paper presents GAMMA, a general motion prediction model that enables large-scale real-time simulation and planning for autonomous driving. GAMMA models heterogeneous, interactive traffic agents. They operate under diverse road…

Robotics · Computer Science 2022-04-27 Yuanfu Luo , Panpan Cai , Yiyuan Lee , David Hsu

Reliable autonomous driving relies on large-scale, well-labeled data and robust models. However, manual data collection is resource-intensive, and traditional simulation suffers from a persistent reality gap. While recent generative…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Kaicong Huang , Talha Azfar , Weisong Shi , Ruimin Ke

Automated driving system deployment requires rigorous validation across safety-critical vehicle-pedestrian interactions, yet real-world datasets rarely capture high-risk scenarios while simulation platforms lack realistic behavior. In…

Robotics · Computer Science 2026-05-19 Qingwen Pu , Kun Xie , Yuan Zhu , Guocong Zhai

This study investigates human-computer interface generation based on diffusion models to overcome the limitations of traditional template-based design and fixed rule-driven methods. It first analyzes the key challenges of interface…

Human-Computer Interaction · Computer Science 2026-01-13 Rui Liu , Liuqingqing Yang , Runsheng Zhang , Shixiao Wang

Evaluating autonomous driving systems in complex and diverse traffic scenarios through controllable simulation is essential to ensure their safety and reliability. However, existing traffic simulation methods face challenges in their…

Robotics · Computer Science 2025-08-01 Zhiyuan Liu , Leheng Li , Yuning Wang , Haotian Lin , Hao Cheng , Zhizhe Liu , Lei He , Jianqiang Wang

Evaluating the performance of autonomous vehicle planning algorithms necessitates simulating long-tail safety-critical traffic scenarios. However, traditional methods for generating such scenarios often fall short in terms of…

Robotics · Computer Science 2024-08-08 Wei-Jer Chang , Francesco Pittaluga , Masayoshi Tomizuka , Wei Zhan , Manmohan Chandraker

In a given scenario, simultaneously and accurately predicting every possible interaction of traffic participants is an important capability for autonomous vehicles. The majority of current researches focused on the prediction of an single…

Machine Learning · Computer Science 2018-10-31 Yeping Hu , Wei Zhan , Masayoshi Tomizuka