English
Related papers

Related papers: Learning from Synthetic Data for Visual Grounding

200 papers

The emergence of synthetic data for privacy protection, training data generation, or simply convenient access to quasi-realistic data in any shape or volume complicates the concept of ground truth. Synthetic data mimic real-world…

Computers and Society · Computer Science 2025-09-18 Dietmar Offenhuber

3D Vision-Language Pre-training (3D-VLP) aims to provide a pre-train model which can bridge 3D scenes with natural language, which is an important technique for embodied intelligence. However, current 3D-VLP datasets are hindered by limited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Dejie Yang , Zhu Xu , Wentao Mo , Qingchao Chen , Siyuan Huang , Yang Liu

Synthetic data can improve generalization when real data is scarce, but excessive reliance may introduce distributional mismatches that degrade performance. In this paper, we present a learning-theoretic framework to quantify the trade-off…

Machine Learning · Statistics 2026-04-02 Amitis Shidani , Tyler Farghly , Yang Sun , Habib Ganjgahi , George Deligiannidis

Multimodal Large Language Models (MLLMs) have made rapid progress in single-video understanding, yet their ability to reason across multiple independent video streams remains poorly understood. Existing multi-video benchmarks rely largely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Sara Ghazanfari , Siddharth Garg , Prashanth Krishnamurthy , Farshad Khorrami

Stereo matching is an important problem in computer vision which has drawn tremendous research attention for decades. Recent years, data-driven methods with convolutional neural networks (CNNs) are continuously pushing stereo matching to…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Ju He , Enyu Zhou , Liusheng Sun , Fei Lei , Chenyang Liu , Wenxiu Sun

Performance achievable by modern deep learning approaches are directly related to the amount of data used at training time. Unfortunately, the annotation process is notoriously tedious and expensive, especially for pixel-wise tasks like…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Pierluigi Zama Ramirez , Alessio Tonioni , Luigi Di Stefano

Recent advances in deep learning-based object detection techniques have revolutionized their applicability in several fields. However, since these methods rely on unwieldy and large amounts of data, a common practice is to download models…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 João Borrego , Atabak Dehban , Rui Figueiredo , Plinio Moreno , Alexandre Bernardino , José Santos-Victor

Since the introduction of modern deep learning methods for object pose estimation, test accuracy and efficiency has increased significantly. For training, however, large amounts of annotated training data are required for good performance.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Frederik Hagelskjaer , Anders Glent Buch

Synthetic data is a standard component in training large language models, yet systematic comparisons across design dimensions, including rephrasing strategy, generator model, and source data, remain absent. We conduct extensive controlled…

Neural networks need big annotated datasets for training. However, manual annotation can be too expensive or even unfeasible for certain tasks, like multi-person 2D pose estimation with severe occlusions. A remedy for this is synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 David T. Hoffmann , Dimitrios Tzionas , Micheal J. Black , Siyu Tang

Offline reinforcement learning (RL) offers a promising framework for training agents using pre-collected datasets without the need for further environment interaction. However, policies trained on offline data often struggle to generalise…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Ahmet H. Güzel , Ilija Bogunovic , Jack Parker-Holder

Recently, great progress has been made in 3D deep learning with the emergence of deep neural networks specifically designed for 3D point clouds. These networks are often trained from scratch or from pre-trained models learned purely from…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Bach Tran , Binh-Son Hua , Anh Tuan Tran , Minh Hoai

This paper explores the application of synthetic data in the post-OCR domain on multiple fronts by conducting experiments to assess the impact of data volume, augmentation, and synthetic data generation methods on model performance.…

Computation and Language · Computer Science 2024-08-14 Shuhao Guan , Derek Greene

Generative foundation models like Stable Diffusion comprise a diverse spectrum of knowledge in computer vision with the potential for transfer learning, e.g., via generating data to train student models for downstream tasks. This could…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Leonhard Hennicke , Christian Medeiros Adriano , Holger Giese , Jan Mathias Koehler , Lukas Schott

Recently, the use of synthetic training data has been on the rise as it offers correctly labelled datasets at a lower cost. The downside of this technique is that the so-called domain gap between the real target images and synthetic…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Bram Vanherle , Steven Moonen , Frank Van Reeth , Nick Michiels

In this paper, we study the value of using synthetically produced videos as training data for neural networks used for action categorization. Motivated by the fact that texture and background of a video play little to no significant roles…

Computer Vision and Pattern Recognition · Computer Science 2020-01-31 Mohamad Ballout , Mohammad Tuqan , Daniel Asmar , Elie Shammas , George Sakr

Assistive robots should be able to wash, fold or iron clothes. However, due to the variety, deformability and self-occlusions of clothes, creating robot systems for cloth manipulation is challenging. Synthetic data is a promising direction…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Thomas Lips , Victor-Louis De Gusseme , Francis wyffels

A number of studies have investigated the training of neural networks with synthetic data for applications in the real world. The aim of this study is to quantify how much real world data can be saved when using a mixed dataset of synthetic…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Sven Burdorf , Karoline Plum , Daniel Hasenklever

Recent work has shown that commonly available machine reading comprehension (MRC) datasets can be used to train high-performance neural information retrieval (IR) systems. However, the evaluation of neural IR has so far been limited to…

Computation and Language · Computer Science 2021-04-19 Revanth Gangi Reddy , Vikas Yadav , Md Arafat Sultan , Martin Franz , Vittorio Castelli , Heng Ji , Avirup Sil

Multimodal Large Language Models (MLLMs) have significantly advanced vision-language understanding. However, even state-of-the-art models struggle with geometric reasoning, revealing a critical bottleneck: the extreme scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Zhengbo Jiao , Shaobo Wang , Zifan Zhang , Wei Wang , Bing Zhao , Hu Wei , Linfeng Zhang