English
Related papers

Related papers: Sim-to-Real Fruit Detection Using Synthetic Data: …

200 papers

Models trained on synthetic images often face degraded generalization to real data. As a convention, these models are often initialized with ImageNet pre-trained representation. Yet the role of ImageNet knowledge is seldom discussed despite…

Machine Learning · Computer Science 2020-07-15 Wuyang Chen , Zhiding Yu , Zhangyang Wang , Anima Anandkumar

Precise robotic grasping of several novel objects is a huge challenge in manufacturing, automation, and logistics. Most of the current methods for model-free grasping are disadvantaged by the sparse data in grasping datasets and by errors…

Robotics · Computer Science 2023-01-31 Lei Zhang , Kaixin Bai , Zhaopeng Chen , Yunlei Shi , Jianwei Zhang

In this paper, we investigate the potential of image-to-image translation (I2I) techniques for transferring realism to 3D-rendered facial images in the context of Face Recognition (FR) systems. The primary motivation for using 3D-rendered…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Parsa Rahimi , Behrooz Razeghi , Sebastien Marcel

The potential of synthetic data to replace real data creates a huge demand for synthetic data in data-hungry AI. This potential is even greater when synthetic data is used for training along with a small number of real images from domains…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Hyungtae Lee , Yan Zhang , Heesung Kwon , Shuvra S. Bhattacharrya

Synthesizing realistic medical images provides a feasible solution to the shortage of training data in deep learning based medical image recognition systems. However, the quality control of synthetic images for data augmentation purposes is…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Jiarong Ye , Yuan Xue , L. Rodney Long , Sameer Antani , Zhiyun Xue , Keith Cheng , Xiaolei Huang

The sample efficiency challenge in Deep Reinforcement Learning (DRL) compromises its industrial adoption due to the high cost and time demands of real-world training. Virtual environments offer a cost-effective alternative for training DRL…

We propose a new approach, Synthetic Optimized Layout with Instance Detection (SOLID), to pretrain object detectors with synthetic images. Our "SOLID" approach consists of two main components: (1) generating synthetic images using a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Hei Law , Jia Deng

Information about room-level occupancy is crucial to many building-related tasks, such as building automation or energy performance simulation. Current occupancy detection literature focuses on data-driven methods, but is mostly based on…

Machine Learning · Computer Science 2025-11-20 Manuel Weber , Christoph Doblander , Peter Mandl

Automatic drum transcription is a critical tool in Music Information Retrieval for extracting and analyzing the rhythm of a music track, but it is limited by the size of the datasets available for training. A popular method used to increase…

Sound · Computer Science 2024-07-30 Mickaël Zehren , Marco Alunno , Paolo Bientinesi

Synthetic data offers a compelling path to scalable pretraining when real-world data is scarce, but models pretrained on synthetic data often fail to transfer reliably to deployment settings. We study this problem in full-body human motion,…

Machine Learning · Computer Science 2026-02-12 Firas Darwish , George Nicholson , Aiden Doherty , Hang Yuan

We demonstrate that it is possible to perform face-related computer vision in the wild using synthetic data alone. The community has long enjoyed the benefits of synthesizing training data with graphics, but the domain gap between real and…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Erroll Wood , Tadas Baltrušaitis , Charlie Hewitt , Sebastian Dziadzio , Matthew Johnson , Virginia Estellers , Thomas J. Cashman , Jamie Shotton

Accurate lane detection, a crucial enabler for autonomous driving, currently relies on obtaining a large and diverse labeled training dataset. In this work, we explore learning from abundant, randomly generated synthetic data, together with…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Noa Garnett , Roy Uziel , Netalee Efrat , Dan Levi

Nowadays, there is a wide availability of datasets that enable the training of common object detectors or human detectors. These come in the form of labelled real-world images and require either a significant amount of human effort, with a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Elia Bonetto , Aamir Ahmad

In automated crop protection tasks such as weed control, disease diagnosis, and pest monitoring, deep learning has demonstrated significant potential. However, these advanced models rely heavily on high-quality, diverse datasets, often…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Sourav Modak , Anthony Stein

Generative text-to-image models enable us to synthesize unlimited amounts of images in a controllable manner, spurring many recent efforts to train vision models with synthetic data. However, every synthetic image ultimately originates from…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Scott Geng , Cheng-Yu Hsieh , Vivek Ramanujan , Matthew Wallingford , Chun-Liang Li , Pang Wei Koh , Ranjay Krishna

Building generic robotic manipulation systems often requires large amounts of real-world data, which can be dificult to collect. Synthetic data generation offers a promising alternative, but limiting the sim-to-real gap requires significant…

Robotics · Computer Science 2024-11-18 Thomas Lips , Francis wyffels

This article aims to use graphic engines to simulate a large number of training data that have free annotations and possibly strongly resemble to real-world data. Between synthetic and real, a two-level domain gap exists, involving content…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yue Yao , Liang Zheng , Xiaodong Yang , Milind Napthade , Tom Gedeon

This paper presents datasets utilised for synthetic near-infrared (NIR) image generation and bounding-box level fruit detection systems. It is undeniable that high-calibre machine learning frameworks such as Tensorflow or Pytorch, and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Inkyu Sa , JongYoon Lim , Ho Seok Ahn , Bruce MacDonald

The artificial intelligence (AI) world is running out of real data for training increasingly large generative models, resulting in accelerating pressure to train on synthetic data. Unfortunately, training new generative models with…

Machine Learning · Computer Science 2024-08-30 Sina Alemohammad , Ahmed Imtiaz Humayun , Shruti Agarwal , John Collomosse , Richard Baraniuk

This paper extensively investigates the effectiveness of synthetic training data to improve the capabilities of vision-and-language models for grounding textual descriptions to image regions. We explore various strategies to best generate…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Ruozhen He , Ziyan Yang , Paola Cascante-Bonilla , Alexander C. Berg , Vicente Ordonez