English
Related papers

Related papers: Language Conditioned Traffic Generation

200 papers

Realistic and controllable traffic simulation is a core capability that is necessary to accelerate autonomous vehicle (AV) development. However, current approaches for controlling learning-based traffic models require significant domain…

Robotics · Computer Science 2023-10-20 Ziyuan Zhong , Davis Rempe , Yuxiao Chen , Boris Ivanovic , Yulong Cao , Danfei Xu , Marco Pavone , Baishakhi Ray

Diverse and realistic traffic scenarios are crucial for evaluating the AI safety of autonomous driving systems in simulation. This work introduces a data-driven method called TrafficGen for traffic scenario generation. It learns from the…

Robotics · Computer Science 2023-03-07 Lan Feng , Quanyi Li , Zhenghao Peng , Shuhan Tan , Bolei Zhou

Generating realistic and controllable traffic scenes from natural language can greatly enhance the development and evaluation of autonomous driving systems. However, this task poses unique challenges: (1) grounding free-form text into…

Robotics · Computer Science 2026-03-27 Bo-Kai Ruan , Hao-Tang Tsui , Yung-Hui Li , Hong-Han Shuai

Controllable and realistic traffic simulation is critical for developing and verifying autonomous vehicles. Typical heuristic-based traffic models offer flexible control to make vehicles follow specific trajectories and traffic rules. On…

Robotics · Computer Science 2022-11-01 Ziyuan Zhong , Davis Rempe , Danfei Xu , Yuxiao Chen , Sushant Veer , Tong Che , Baishakhi Ray , Marco Pavone

Simulation plays a crucial role in the development of autonomous vehicles (AVs) due to the potential risks associated with real-world testing. Although significant progress has been made in the visual aspects of simulators, generating…

Machine Learning · Computer Science 2024-08-14 Wenhao Ding , Yulong Cao , Ding Zhao , Chaowei Xiao , Marco Pavone

Controllable synthetic data generation can substantially lower the annotation cost of training data. Prior works use diffusion models to generate driving images conditioned on the 3D object layout. However, those models are trained on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yunsong Zhou , Michael Simon , Zhenghao Peng , Sicheng Mo , Hongzi Zhu , Minyi Guo , Bolei Zhou

We consider the problem of generating realistic traffic scenes automatically. Existing methods typically insert actors into the scene according to a set of hand-crafted heuristics and are limited in their ability to model the true…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Shuhan Tan , Kelvin Wong , Shenlong Wang , Sivabalan Manivasagam , Mengye Ren , Raquel Urtasun

The manual design of scenarios for Air Traffic Control (ATC) training is a demanding and time-consuming bottleneck that limits the diversity of simulations available to controllers. To address this, we introduce a novel, end-to-end…

Artificial Intelligence · Computer Science 2025-08-18 Dewi Sid William Gould , George De Ath , Ben Carvell , Nick Pepper

Evaluating and training autonomous driving systems require diverse and scalable corner cases. However, most existing scene generation methods lack controllability, accuracy, and versatility, resulting in unsatisfactory generation results.…

Robotics · Computer Science 2024-10-11 Sheng Wang , Ge Sun , Fulong Ma , Tianshuai Hu , Qiang Qin , Yongkang Song , Lei Zhu , Junwei Liang

Vision-language models have recently emerged as promising planners for autonomous driving, where success hinges on topology-aware reasoning over spatial structure and dynamic interactions from multimodal input. However, existing models are…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Fabian Schmidt , Markus Enzweiler , Abhinav Valada

Realistic and interactive traffic simulation is essential for training and evaluating autonomous driving systems. However, most existing data-driven simulation methods rely on static initialization or log-replay data, limiting their ability…

Robotics · Computer Science 2026-03-04 Zhenghao Peng , Yuxin Liu , Bolei Zhou

Microscopic traffic simulation has become an important tool for autonomous driving training and testing. Although recent data-driven approaches advance realistic behavior generation, their learning still relies primarily on a single…

Artificial Intelligence · Computer Science 2025-03-11 Shenyu Zhang , Jiaguo Tian , Zhengbang Zhu , Shan Huang , Jucheng Yang , Weinan Zhang

The generation of realistic and diverse traffic scenarios in simulation is essential for developing and evaluating autonomous driving systems. However, most simulation frameworks rely on rule-based or simplified models for scene generation,…

Multiagent Systems · Computer Science 2025-12-02 Jiaguo Tian , Zhengbang Zhu , Shenyu Zhang , Li Xu , Bo Zheng , Xu Liu , Weiji Peng , Shizeng Yao , Weinan Zhang

A powerful simulator highly decreases the need for real-world tests when training and evaluating autonomous vehicles. Data-driven simulators flourished with the recent advancement of conditional Generative Adversarial Networks (cGANs),…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Saeed Saadatnejad , Siyuan Li , Taylor Mordan , Alexandre Alahi

Traffic prediction is one of the most significant foundations in Intelligent Transportation Systems (ITS). Traditional traffic prediction methods rely only on historical traffic data to predict traffic trends and face two main challenges.…

Artificial Intelligence · Computer Science 2024-03-15 Chengyang Zhang , Yong Zhang , Qitan Shao , Jiangtao Feng , Bo Li , Yisheng Lv , Xinglin Piao , Baocai Yin

An ideal traffic simulator replicates the realistic long-term point-to-point trip that a self-driving system experiences during deployment. Prior models and benchmarks focus on closed-loop motion simulation for initial agents in a scene.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Xiuyu Yang , Shuhan Tan , Philipp Krähenbühl

Machine learning based autonomous driving systems often face challenges with safety-critical scenarios that are rare in real-world data, hindering their large-scale deployment. While increasing real-world training data coverage could…

Machine Learning · Computer Science 2024-09-13 Yuan Yin , Pegah Khayatan , Éloi Zablocki , Alexandre Boulch , Matthieu Cord

Generating realistic and interactive dynamics of traffic participants according to specific instruction is critical for street scene simulation. However, there is currently a lack of a comprehensive method that generates realistic dynamics…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Yuxi Wei , Jingbo Wang , Yuwen Du , Dingju Wang , Liang Pan , Chenxin Xu , Yao Feng , Bo Dai , Siheng Chen

Motion planning is a crucial component in autonomous driving. State-of-the-art motion planners are trained on meticulously curated datasets, which are not only expensive to annotate but also insufficient in capturing rarely seen critical…

Robotics · Computer Science 2025-05-02 Aizierjiang Aiersilan

In recent years, with the development of deep learning, text generation technology has undergone great changes and provided many kinds of services for human beings, such as restaurant reservation and daily communication. The automatically…

Computation and Language · Computer Science 2020-12-25 Bin Guo , Hao Wang , Yasan Ding , Wei Wu , Shaoyang Hao , Yueqi Sun , Zhiwen Yu
‹ Prev 1 2 3 10 Next ›