English
Related papers

Related papers: Learning to simulate complex scenes

200 papers

This work studies the semantic segmentation of 3D LiDAR data in dynamic scenes for autonomous driving applications. A system of semantic segmentation using 3D LiDAR data, including range image segmentation, sample generation, inter-frame…

Robotics · Computer Science 2018-09-05 Jilin Mei , Biao Gao , Donghao Xu , Wen Yao , Xijun Zhao , Huijing Zhao

Reinforcement learning (RL) has demonstrated great success in the past several years. However, most of the scenarios focus on simulated environments. One of the main challenges of transferring the policy learned in a simulated environment…

Robotics · Computer Science 2021-02-24 Ya-Yen Tsai , Hui Xu , Zihan Ding , Chong Zhang , Edward Johns , Bidan Huang

Limited real-world data severely impacts model performance in many computer vision domains, particularly for samples that are underrepresented in training. Synthetically generated images are a promising solution, but 1) it remains unclear…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Nitish Mital , Simon Malzard , Richard Walters , Celso M. De Melo , Raghuveer Rao , Victoria Nockles

Realistic synthetic image data rendered from 3D models can be used to augment image sets and train image classification semantic segmentation models. In this work, we explore how high quality physically-based rendering and domain…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Jason W. Anderson , Marcin Ziolkowski , Ken Kennedy , Amy W. Apon

Autonomous vehicles are the next revolution in the automobile industry and they are expected to revolutionize the future of transportation. Understanding the scenario in which the autonomous vehicle will operate is critical for its…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Naveen Mathews Renji , Kruthika K , Manasa Keshavamurthy , Pooja Kumari , S. Rajarajeswari

Semantic segmentation is a crucial image understanding task, where each pixel of image is categorized into a corresponding label. Since the pixel-wise labeling for ground-truth is tedious and labor intensive, in practical applications, many…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Duo Peng , Yinjie Lei , Lingqiao Liu , Pingping Zhang , Jun Liu

Developing deep neural networks to generate 3D scenes is a fundamental problem in neural synthesis with immediate applications in architectural CAD, computer graphics, as well as in generating virtual robot training environments. This task…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Haitao Yang , Zaiwei Zhang , Siming Yan , Haibin Huang , Chongyang Ma , Yi Zheng , Chandrajit Bajaj , Qixing Huang

Semantic segmentation often requires a large set of images with pixel-level annotations. In the view of extremely expensive expert labeling, recent research has shown that the models trained on photo-realistic synthetic data (e.g., computer…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Yiheng Zhang , Zhaofan Qiu , Ting Yao , Chong-Wah Ngo , Dong Liu , Tao Mei

Annotating large scale datasets to train modern convolutional neural networks is prohibitively expensive and time-consuming for many real tasks. One alternative is to train the model on labeled synthetic datasets and apply it in the real…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Yuhu Shan , Wen Feng Lu , Chee Meng Chew

Scene text recognition (STR) is a challenging task that requires large-scale annotated data for training. However, collecting and labeling real text images is expensive and time-consuming, which limits the availability of real data.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Mingkun Yang , Biao Yang , Minghui Liao , Yingying Zhu , Xiang Bai

Autonomous driving relies on a huge volume of real-world data to be labeled to high precision. Alternative solutions seek to exploit driving simulators that can generate large amounts of labeled data with a plethora of content variations.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 David Acuna , Jonah Philion , Sanja Fidler

Unsupervised sim-to-real domain adaptation (UDA) for semantic segmentation aims to improve the real-world test performance of a model trained on simulated data. It can save the cost of manually labeling data in real-world applications such…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Rui Gong , Qin Wang , Dengxin Dai , Luc Van Gool

In training deep neural networks for semantic segmentation, the main limiting factor is the low amount of ground truth annotation data that is available in currently existing datasets. The limited availability of such data is due to the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-18 Matt Angus , Mohamed ElBalkini , Samin Khan , Ali Harakeh , Oles Andrienko , Cody Reading , Steven Waslander , Krzysztof Czarnecki

Learning on synthetic data and transferring the resulting properties to their real counterparts is an important challenge for reducing costs and increasing safety in machine learning. In this work, we focus on autoencoder architectures and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Steve Dias Da Cruz , Bertram Taetz , Thomas Stifter , Didier Stricker

Semantic segmentation models have reached remarkable performance across various tasks. However, this performance is achieved with extremely large models, using powerful computational resources and without considering training and inference…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Antonio Tavera , Carlo Masone , Barbara Caputo

Semantic understanding of scenes in three-dimensional space (3D) is a quintessential part of robotics oriented applications such as autonomous driving as it provides geometric cues such as size, orientation and true distance of separation…

Computer Vision and Pattern Recognition · Computer Science 2019-11-01 Kartik Srivastava , Akash Kumar Singh , Guruprasad M. Hegde

Recent self-supervised clustering-based pre-training techniques like DINO and Cribo have shown impressive results for downstream detection and segmentation tasks. However, real-world applications such as autonomous driving face challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Maciej K. Wozniak , Hariprasath Govindarajan , Marvin Klingner , Camille Maurice , B Ravi Kiran , Senthil Yogamani

As synthetic imagery is used more frequently in training deep models, it is important to understand how different synthesis techniques impact the performance of such models. In this work, we perform a thorough evaluation of the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Kristofer Schlachter , Connor DeFanti , Sebastian Herscher , Ken Perlin , Jonathan Tompson

Recent progress of self-supervised visual representation learning has achieved remarkable success on many challenging computer vision benchmarks. However, whether these techniques can be used for domain adaptation has not been explored. In…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Jiaolong Xu , Liang Xiao , Antonio M. Lopez

Road environment segmentation plays a significant role in autonomous driving. Numerous works based on Fully Convolutional Networks (FCNs) and Transformer architectures have been proposed to leverage local and global contextual learning for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Jiyong Kwag , Alper Yilmaz , Charles Toth