English
Related papers

Related papers: RealGen: Retrieval Augmented Generation for Contro…

200 papers

An ideal traffic simulator replicates the realistic long-term point-to-point trip that a self-driving system experiences during deployment. Prior models and benchmarks focus on closed-loop motion simulation for initial agents in a scene.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Xiuyu Yang , Shuhan Tan , Philipp Krähenbühl

Large Language Models have been increasingly employed in the creation of Virtual Assistants due to their ability to generate human-like text and handle complex inquiries. While these models hold great promise, challenges such as…

Computation and Language · Computer Science 2026-04-30 Dumitru Verşebeniuc , Martijn Elands , Sara Falahatkar , Chiara Magrone , Mohammad Falah , Martijn Boussé , Aki Härmä

Photorealism is an important aspect of modern video games since it can shape player experience and impact immersion, narrative engagement, and visual fidelity. To achieve photorealism, beyond traditional rendering pipelines, generative…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Stefanos Pasios , Nikos Nikolaidis

Simulation systems have become an essential component in the development and validation of autonomous driving technologies. The prevailing state-of-the-art approach for simulation is to use game engines or high-fidelity computer graphics…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Wei Li , Chengwei Pan , Rong Zhang , Jiaping Ren , Yuexin Ma , Jin Fang , Feilong Yan , Qichuan Geng , Xinyu Huang , Huajun Gong , Weiwei Xu , Guoping Wang , Dinesh Manocha , Ruigang Yang

Recent research on Vision-and-Language Navigation (VLN) indicates that agents suffer from poor generalization in unseen environments due to the lack of realistic training environments and high-quality path-instruction pairs. Most existing…

Robotics · Computer Science 2024-11-19 Yu Yan , Rongtao Xu , Jiazhao Zhang , Peiyang Li , Xiaodan Liang , Jianqin Yin

Traffic simulators are important tools in autonomous driving development. While continuous progress has been made to provide developers more options for modeling various traffic participants, tuning these models to increase their behavioral…

Safely interacting with humans is a significant challenge for autonomous driving. The performance of this interaction depends on machine learning-based modules of an autopilot, such as perception, behavior prediction, and planning. These…

Artificial Intelligence · Computer Science 2020-12-01 Jay Shenoy , Edward Kim , Xiangyu Yue , Taesung Park , Daniel Fremont , Alberto Sangiovanni-Vincentelli , Sanjit Seshia

With the increasing integration of intelligent driving functions into serial-produced vehicles, ensuring their functionality and robustness poses greater challenges. Compared to traditional road testing, scenario-based virtual testing…

Robotics · Computer Science 2025-10-29 Li Li , Tobias Brinkmann , Till Temmen , Markus Eisenbarth , Jakob Andert

Generating safety-critical scenarios in high-fidelity simulations offers a promising and cost-effective approach for efficient testing of autonomous vehicles. Existing methods typically rely on manipulating a single vehicle's trajectory…

Machine Learning · Computer Science 2025-05-07 Jiawei Wang , Xintao Yan , Yao Mu , Haowei Sun , Zhong Cao , Henry X. Liu

Generating realistic and diverse road scenarios is essential for autonomous vehicle testing and validation. Nevertheless, owing to the complexity and variability of real-world road environments, creating authentic and varied scenarios for…

Robotics · Computer Science 2024-11-15 Junjie Zhou , Lin Wang , Qiang Meng , Xiaofan Wang

Developing reliable autonomous driving algorithms poses challenges in testing, particularly when it comes to safety-critical traffic scenarios involving pedestrians. An open question is how to simulate rare events, not necessarily found in…

Robotics · Computer Science 2023-09-04 Yuhang Yang , Kalle Kujanpaa , Amin Babadi , Joni Pajarinen , Alexander Ilin

Current research on decision-making in safety-critical scenarios often relies on inefficient data-driven scenario generation or specific modeling approaches, which fail to capture corner cases in real-world contexts. To address this issue,…

Machine Learning · Computer Science 2025-07-22 Yinsong Chen , Kaifeng Wang , Xiaoqiang Meng , Xueyuan Li , Zirui Li , Xin Gao

Collaborative driving systems leverage vehicle-to-everything (V2X) communication for multi-agent collaborative perception to enhance driving safety, yet they remain constrained by scarce annotated real-world V2X driving datasets and limited…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yihang Tao , Yu Guo , Senkang Hu , Yanan Ma , Zihan Fang , Sam Kwong , Yuguang Fang

This paper introduces CRITICAL, a novel closed-loop framework for autonomous vehicle (AV) training and testing. CRITICAL stands out for its ability to generate diverse scenarios, focusing on critical driving situations that target specific…

Realistic simulators are critical for training and verifying robotics systems. While most of the contemporary simulators are hand-crafted, a scaleable way to build simulators is to use machine learning to learn how the environment behaves…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Seung Wook Kim , Jonah Philion , Antonio Torralba , Sanja Fidler

The advancement of autonomous driving technologies necessitates increasingly sophisticated methods for understanding and predicting real-world scenarios. Vision language models (VLMs) are emerging as revolutionary tools with significant…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Yongjie Fu , Anmol Jain , Xuan Di , Xu Chen , Zhaobin Mo

Driving simulators play a large role in developing and testing new intelligent vehicle systems. The visual fidelity of the simulation is critical for building vision-based algorithms and conducting human driver experiments. Low visual…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Ekim Yurtsever , Dongfang Yang , Ibrahim Mert Koc , Keith A. Redmill

Foundational world models must be both interactive and preserve spatiotemporal coherence for effective future planning with action choices. However, present models for long video generation have limited inherent world modeling capabilities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Taiye Chen , Xun Hu , Zihan Ding , Chi Jin

Digital testing has emerged as a key paradigm for the development and verification of autonomous maritime navigation systems, yet the availability of realistic and diverse safety-critical encounter scenarios remains limited. Existing…

Machine Learning · Computer Science 2026-03-31 Sijin Sun , Liangbin Zhao , Ming Deng , Xiuju Fu

Realistic network traffic simulation is critical for evaluating intrusion detection systems, stress-testing network protocols, and constructing high-fidelity environments for cybersecurity training. While attack traffic can often be layered…

Cryptography and Security · Computer Science 2026-01-23 Kristen Moore , Diksha Goel , Cody James Christopher , Zhen Wang , Minjune Kim , Ahmed Ibrahim , Ahmad Mohsin , Seyit Camtepe