English
Related papers

Related papers: Exploring Generative AI for Sim2Real in Driving Da…

200 papers

Generative models offer a scalable and flexible paradigm for simulating complex environments, yet current approaches fall short in addressing the domain-specific requirements of autonomous driving - such as multi-agent interactions,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Lloyd Russell , Anthony Hu , Lorenzo Bertoni , George Fedoseev , Jamie Shotton , Elahe Arani , Gianluca Corrado

Generative AI has seen remarkable growth over the past few years, with diffusion models being state-of-the-art for image generation. This study investigates the use of diffusion models in generating artificial data generation for electronic…

Machine Learning · Computer Science 2023-10-18 Prasha Srivastava , Pawan Kumar , Zia Abbas

Training deep learning methods on small time series datasets that also include corrupted samples is challenging. Diffusion models have shown to be effective to generate realistic and synthetic data, and correct corrupted samples through…

Machine Learning · Computer Science 2025-09-17 Julian Ripper , Ousama Esbel , Rafael Fietzek , Max Mühlhäuser , Thomas Kreutz

Autonomous driving relies on a huge volume of real-world data to be labeled to high precision. Alternative solutions seek to exploit driving simulators that can generate large amounts of labeled data with a plethora of content variations.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 David Acuna , Jonah Philion , Sanja Fidler

We propose a method that augments a simulated dataset using diffusion models to improve the performance of pedestrian detection in real-world data. The high cost of collecting and annotating data in the real-world has motivated the use of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Andrew Farley , Mohsen Zand , Michael Greenspan

Supervised machine learning algorithms play a crucial role in optical quality control within industrial production. These approaches require representative datasets for effective model training. However, while non-defective components are…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Dennis Sprute , Hanna Senke , Holger Flatt

Population synthesis is a critical task that involves generating synthetic yet realistic representations of populations. It is a fundamental problem in agent-based modeling (ABM), which has become the standard to analyze intelligent…

Machine Learning · Computer Science 2025-08-14 Min Tang , Peng Lu , Qing Feng

Safety-critical traffic scenarios are integral to the development and validation of autonomous driving systems. These scenarios provide crucial insights into vehicle responses under high-risk conditions rarely encountered in real-world…

Robotics · Computer Science 2024-10-08 Jinxiong Lu , Shoaib Azam , Gokhan Alcan , Ville Kyrki

Reliable autonomous driving relies on large-scale, well-labeled data and robust models. However, manual data collection is resource-intensive, and traditional simulation suffers from a persistent reality gap. While recent generative…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Kaicong Huang , Talha Azfar , Weisong Shi , Ruimin Ke

Automated lane changing is a critical feature for advanced autonomous driving systems. In recent years, reinforcement learning (RL) algorithms trained on traffic simulators yielded successful results in computing lane changing policies that…

Robotics · Computer Science 2021-03-16 Anil Ozturk , Mustafa Burak Gunel , Melih Dal , Ugur Yavas , Nazim Kemal Ure

Medical image data is less accessible than in other domains due to privacy and regulatory constraints. In addition, labeling requires costly, time-intensive manual image annotation by clinical experts. To overcome these challenges,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-11 Fangyijie Wang , Kevin Whelan , Félix Balado , Kathleen M. Curran , Guénolé Silvestre

Synthetic data is emerging as a promising solution to the scalability issue of supervised deep learning, especially when real data are difficult to acquire or hard to annotate. Synthetic data generation, however, can itself be prohibitively…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Aayush Prakash , Shoubhik Debnath , Jean-Francois Lafleche , Eric Cameracci , Gavriel State , Stan Birchfield , Marc T. Law

As perception models continue to develop, the need for large-scale datasets increases. However, data annotation remains far too expensive to effectively scale and meet the demand. Synthetic datasets provide a solution to boost model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Arpit Jadon , Haoran Wang , Phillip Thomas , Michael Stanley , S. Nathaniel Cibik , Rachel Laurat , Omar Maher , Lukas Hoyer , Ozan Unal , Dengxin Dai

Automated creation of synthetic traffic scenarios is a key part of validating the safety of autonomous vehicles (AVs). In this paper, we propose Scenario Diffusion, a novel diffusion-based architecture for generating traffic scenarios that…

Machine Learning · Computer Science 2023-11-20 Ethan Pronovost , Meghana Reddy Ganesina , Noureldin Hendy , Zeyu Wang , Andres Morales , Kai Wang , Nicholas Roy

Simulation-based design, optimization, and validation of autonomous vehicles have proven to be crucial for their improvement over the years. Nevertheless, the ultimate measure of effectiveness is their successful transition from simulation…

Robotics · Computer Science 2025-11-21 Chinmay Vilas Samak , Tanmay Vilas Samak , Bing Li , Venkat Krovi

In the field of autonomous driving, sensor simulation is essential for generating rare and diverse scenarios that are difficult to capture in real-world environments. Current solutions fall into two categories: 1) CG-based methods, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Zhengqing Chen , Ruohong Mei , Xiaoyang Guo , Qingjie Wang , Yubin Hu , Wei Yin , Weiqiang Ren , Qian Zhang

The difficulty in obtaining labeled data relevant to a given task is among the most common and well-known practical obstacles to applying deep learning techniques to new or even slightly modified domains. The data volumes required by the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Jonathan Howe , Kyle Pula , Aaron A. Reite

The widespread adoption of wearable sensors has the potential to provide massive and heterogeneous time series data, driving the use of Artificial Intelligence in human sensing applications. However, data collection remains limited due to…

Machine Learning · Computer Science 2025-12-04 Flavio Di Martino , Franca Delmastro

While developing perception based deep learning models, the benefit of synthetic data is enormous. However, performance of networks trained with synthetic data for certain computer vision tasks degrade significantly when tested on real…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Koustav Mullick , Harshil Jain , Sanchit Gupta , Amit Arvind Kale

Video generation models, as one form of world models, have emerged as one of the most exciting frontiers in AI, promising agents the ability to imagine the future by modeling the temporal evolution of complex scenes. In autonomous driving,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yang Zhou , Hao Shao , Letian Wang , Zhuofan Zong , Hongsheng Li , Steven L. Waslander