English
Related papers

Related papers: Training on Synthetic Data Beats Real Data in Mult…

200 papers

We introduce MiRAGE, an evaluation framework for retrieval-augmented generation (RAG) from multimodal sources. As audiovisual media becomes a prevalent source of information online, it is essential for RAG systems to integrate information…

Computation and Language · Computer Science 2025-10-30 Alexander Martin , William Walden , Reno Kriz , Dengjia Zhang , Kate Sanders , Eugene Yang , Chihsheng Jin , Benjamin Van Durme

Automatic License Plate Recognition is a frequent research topic due to its wide-ranging practical applications. While recent studies use synthetic images to improve License Plate Recognition (LPR) results, there remain several limitations…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Rayson Laroca , Valter Estevam , Gladston J. P. Moreira , Rodrigo Minetto , David Menotti

State-of-the-art deep learning algorithms yield remarkable results in many visual recognition tasks. However, they still fail to provide satisfactory results in scarce data regimes. To a certain extent this lack of data can be compensated…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Frederik Pahde , Oleksiy Ostapenko , Patrick Jähnichen , Tassilo Klein , Moin Nabi

As information exists in various modalities in real world, effective interaction and fusion among multimodal information plays a key role for the creation and perception of multimodal data in computer vision and deep learning research. With…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Fangneng Zhan , Yingchen Yu , Rongliang Wu , Jiahui Zhang , Shijian Lu , Lingjie Liu , Adam Kortylewski , Christian Theobalt , Eric Xing

Simulation is increasingly being used for generating large labelled datasets in many machine learning problems. Recent methods have focused on adjusting simulator parameters with the goal of maximising accuracy on a validation task, usually…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Harkirat Singh Behl , Atılım Güneş Baydin , Ran Gal , Philip H. S. Torr , Vibhav Vineet

Building generic robotic manipulation systems often requires large amounts of real-world data, which can be dificult to collect. Synthetic data generation offers a promising alternative, but limiting the sim-to-real gap requires significant…

Robotics · Computer Science 2024-11-18 Thomas Lips , Francis wyffels

Recently, it has been shown that for offline deep reinforcement learning (DRL), pre-training Decision Transformer with a large language corpus can improve downstream performance (Reid et al., 2022). A natural question to ask is whether this…

Artificial Intelligence · Computer Science 2024-05-28 Zecheng Wang , Che Wang , Zixuan Dong , Keith Ross

The in-context learning ability of large language models (LLMs) enables them to generalize to novel downstream tasks with relatively few labeled examples. However, they require enormous computational resources to be deployed. Alternatively,…

Computation and Language · Computer Science 2024-01-09 Jean Kaddour , Qi Liu

In this work, we aim to develop effective data synthesis techniques that autonomously synthesize multimodal training data for enhancing MLLMs in solving complex real-world tasks. To this end, we propose Collective Adversarial Data Synthesis…

Machine Learning · Computer Science 2026-02-04 Jingyi Zhang , Tianyi Lin , Huanjin Yao , Xiang Lan , Shunyu Liu , Jiaxing Huang

Recent progress in developing general purpose text embedders has been driven by training on ever-growing corpora of synthetic LLM-generated data. Nonetheless, no publicly available synthetic dataset exists, posing a barrier to studying its…

Computation and Language · Computer Science 2025-09-09 Jacob Mitchell Springer , Vaibhav Adlakha , Siva Reddy , Aditi Raghunathan , Marius Mosbach

Recent progress in material data mining has been driven by high-capacity models trained on large datasets. However, collecting experimental data (real data) has been extremely costly since the amount of human effort and expertise required.…

Although image captioning models have made significant advancements in recent years, the majority of them heavily depend on high-quality datasets containing paired images and texts which are costly to acquire. Previous works leverage the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Zhiyue Liu , Jinyuan Liu , Fanrong Ma

State-of-the-art techniques of artificial intelligence, in particular deep learning, are mostly data-driven. However, collecting and manually labeling a large scale dataset is both difficult and expensive. A promising alternative is to…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Qi Chen , Weichao Qiu , Yi Zhang , Lingxi Xie , Alan Yuille

Data plays a pivotal role in Text-Based Person Retrieval (TBPR) research. Mainstream research paradigm necessitates real-world person images with manual textual annotations for training models, posing privacy concerns and annotation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Min Cao , Yuxin Lu , Ziyin Zeng , Dong Yi , Jinqiao Wang , Mang Ye

Deep learning based medical image recognition systems often require a substantial amount of training data with expert annotations, which can be expensive and time-consuming to obtain. Recently, synthetic augmentation techniques have been…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Jiarong Ye , Haomiao Ni , Peng Jin , Sharon X. Huang , Yuan Xue

Data availability is a bottleneck during early stages of development of new capabilities for intelligent artificial agents. We investigate the use of text generation techniques to augment the training data of a popular commercial artificial…

Computation and Language · Computer Science 2019-10-09 Nikolaos Malandrakis , Minmin Shen , Anuj Goyal , Shuyang Gao , Abhishek Sethi , Angeliki Metallinou

Synthetic data has been proposed as a solution to address the issue of high-quality data scarcity in the training of large language models (LLMs). Studies have shown that synthetic data can effectively improve the performance of LLMs on…

Computation and Language · Computer Science 2024-06-19 Jie Chen , Yupeng Zhang , Bingning Wang , Wayne Xin Zhao , Ji-Rong Wen , Weipeng Chen

Learning from synthetic data has many important and practical applications. An example of application is photo-sketch recognition. Using synthetic data is challenging due to the differences in feature distributions between synthetic and…

Computer Vision and Pattern Recognition · Computer Science 2015-09-22 Xi Zhang , Yanwei Fu , Shanshan Jiang , Leonid Sigal , Gady Agam

Synthetic data is emerging as a promising solution to the scalability issue of supervised deep learning, especially when real data are difficult to acquire or hard to annotate. Synthetic data generation, however, can itself be prohibitively…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Aayush Prakash , Shoubhik Debnath , Jean-Francois Lafleche , Eric Cameracci , Gavriel State , Stan Birchfield , Marc T. Law

Sufficient training data normally is required to train deeply learned models. However, due to the expensive manual process for labelling large number of images, the amount of available training data is always limited. To produce more data…

Computer Vision and Pattern Recognition · Computer Science 2018-12-26 Yan Huang , Jinsong Xu , Qiang Wu , Zhedong Zheng , Zhaoxiang Zhang , Jian Zhang