English
Related papers

Related papers: SceneFactory: GPU-Accelerated Multi-Agent Driving …

200 papers

While reinforcement learning (RL) can empower autonomous agents by enabling self-improvement through interaction, its practical adoption remains challenging due to costly rollouts, limited task diversity, unreliable reward signals, and…

Fine-tuning Large Language Models (LLMs) has become essential for domain adaptation, but its memory-intensive property exceeds the capabilities of most GPUs. To address this challenge and democratize LLM fine-tuning, we present SlideFormer,…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-18 Ruijia Yang , Zeyi Wen

Effectively capturing intricate interactions among road users is of critical importance to achieving safe navigation for autonomous vehicles. While graph learning (GL) has emerged as a promising approach to tackle this challenge, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Junyao Wang , Arnav Vaibhav Malawade , Junhong Zhou , Shih-Yuan Yu , Mohammad Abdullah Al Faruque

Learning contextual and spatial environmental representations enhances autonomous vehicle's hazard anticipation and decision-making in complex scenarios. Recent perception systems enhance spatial understanding with sensor fusion but often…

Robotics · Computer Science 2024-01-18 Shoaib Azam , Farzeen Munir , Ville Kyrki , Moongu Jeon , Witold Pedrycz

Recent advancements in driving world models enable controllable generation of high-quality RGB videos or multimodal videos. Existing methods primarily focus on metrics related to generation quality and controllability. However, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Kai Zeng , Zhanqian Wu , Kaixin Xiong , Xiaobao Wei , Xiangyu Guo , Zhenxin Zhu , Kalok Ho , Lijun Zhou , Bohan Zeng , Ming Lu , Haiyang Sun , Bing Wang , Guang Chen , Hangjun Ye , Wentao Zhang

Data-driven simulation has become a favorable way to train and test autonomous driving algorithms. The idea of replacing the actual environment with a learned simulator has also been explored in model-based reinforcement learning in the…

Robotics · Computer Science 2023-09-29 Zhejun Zhang , Alexander Liniger , Dengxin Dai , Fisher Yu , Luc Van Gool

Autonomous driving system development is critically dependent on the ability to replay complex and diverse traffic scenarios in simulation. In such scenarios, the ability to accurately simulate the vehicle sensors such as cameras, lidar or…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Zhenpei Yang , Yuning Chai , Dragomir Anguelov , Yin Zhou , Pei Sun , Dumitru Erhan , Sean Rafferty , Henrik Kretzschmar

High-fidelity reconstruction of driving scenes is crucial for autonomous driving. While recent feedforward 3D Gaussian Splatting (3DGS) methods enable fast reconstruction, their per-pixel Gaussian prediction paradigm often suffers from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Cheng Chi , Xianqi Wang , Hongcheng Luo , Mingfei Tu , Gangwei Xu , Zehan Zhang , Bing Wang , Guang Chen , Hangjun Ye , Sida Peng , Xin Yang , Haiyang Sun

Virtual reality (VR) is a promising data engine for autonomous driving (AD). However, data fidelity in this paradigm is often degraded by VR inconsistency, for which the existing VR approaches become ineffective, as they ignore the…

Robotics · Computer Science 2024-03-07 He Li , Ruihua Han , Zirui Zhao , Wei Xu , Qi Hao , Shuai Wang , Chengzhong Xu

Traffic simulation is an essential tool for transportation infrastructure planning, intelligent traffic control policy learning, and traffic flow analysis. Its effectiveness relies heavily on the realism of the simulators used. Traditional…

Multiagent Systems · Computer Science 2024-02-12 Longchao Da , Chen Chu , Weinan Zhang , Hua Wei

Autonomous driving relies on robust models trained on high-quality, large-scale multi-view driving videos. While world models offer a cost-effective solution for generating realistic driving videos, they struggle to maintain instance-level…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Zhuoran Yang , Xi Guo , Chenjing Ding , Chiyu Wang , Wei Wu , Yanyong Zhang

This paper presented DriveArena, the first high-fidelity closed-loop simulation system designed for driving agents navigating in real scenarios. DriveArena features a flexible, modular architecture, allowing for the seamless interchange of…

Increasing the scale of reinforcement learning experiments has allowed researchers to achieve unprecedented results in both training sophisticated agents for video games, and in sim-to-real transfer for robotics. Typically such experiments…

Machine Learning · Computer Science 2020-06-24 Aleksei Petrenko , Zhehui Huang , Tushar Kumar , Gaurav Sukhatme , Vladlen Koltun

As autonomous driving systems being deployed to millions of vehicles, there is a pressing need of improving the system's scalability, safety and reducing the engineering cost. A realistic, scalable, and practical simulator of the driving…

Robotics · Computer Science 2024-07-04 Yihan Hu , Siqi Chai , Zhening Yang , Jingyu Qian , Kun Li , Wenxin Shao , Haichao Zhang , Wei Xu , Qiang Liu

Vision-language models have recently emerged as promising planners for autonomous driving, where success hinges on topology-aware reasoning over spatial structure and dynamic interactions from multimodal input. However, existing models are…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Fabian Schmidt , Markus Enzweiler , Abhinav Valada

Simulation is an indispensable tool in the development and testing of autonomous vehicles (AVs), offering an efficient and safe alternative to road testing. An outstanding challenge with simulation-based testing is the generation of…

Robotics · Computer Science 2024-12-13 Peide Huang , Wenhao Ding , Benjamin Stoler , Jonathan Francis , Bingqing Chen , Ding Zhao

Synthetic 3D scenes are essential for developing Physical AI and generative models. Existing procedural generation methods often have low output throughput, creating a significant bottleneck in scaling up dataset creation. In this work, we…

Robotics · Computer Science 2025-12-19 Jinghuan Shang , Harsh Patel , Ran Gong , Karl Schmeckpeper

How can we reliably simulate future driving scenarios under a wide range of ego driving behaviors? Recent driving world models, developed exclusively on real-world driving data composed mainly of safe expert trajectories, struggle to follow…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jiazhi Yang , Kashyap Chitta , Shenyuan Gao , Long Chen , Yuqian Shao , Xiaosong Jia , Hongyang Li , Andreas Geiger , Xiangyu Yue , Li Chen

Movement is how people interact with and affect their environment. For realistic character animation, it is necessary to synthesize such interactions between virtual characters and their surroundings. Despite recent progress in character…

Graphics · Computer Science 2023-02-03 Mohamed Hassan , Yunrong Guo , Tingwu Wang , Michael Black , Sanja Fidler , Xue Bin Peng

This paper presents ShareVerse, a video generation framework enabling multi-agent shared world modeling, addressing the gap in existing works that lack support for unified shared world construction with multi-agent interaction. ShareVerse…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Jiayi Zhu , Jianing Zhang , Yiying Yang , Wei Cheng , Xiaoyun Yuan