English
Related papers

Related papers: Self-Improving Diffusion Models with Synthetic Dat…

200 papers

Recent smaller language models such Phi-3.5 and Phi-4 rely on synthetic data generated using larger Language models. Questions remain about leveraging synthetic data for other use cases, such as adapting LLMs to specific domains. A key…

Computation and Language · Computer Science 2025-11-06 Haris Riaz , Sourav Bhabesh , Vinayak Arannil , Miguel Ballesteros , Graham Horwood

Recent work shows membership inference attacks (MIAs) on large language models (LLMs) produce inconclusive results, partly due to difficulties in creating non-member datasets without temporal shifts. While researchers have turned to…

Computation and Language · Computer Science 2025-01-22 Ali Naseh , Niloofar Mireshghallah

Visual recognition models are prone to learning spurious correlations induced by a biased training set where certain conditions $B$ (\eg, Indoors) are over-represented in certain classes $Y$ (\eg, Big Dogs). Synthetic data from…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Maan Qraitem , Kate Saenko , Bryan A. Plummer

We introduce an approach to bias deep generative models, such as GANs and diffusion models, towards generating data with either enhanced fidelity or increased diversity. Our approach involves manipulating the distribution of training and…

Machine Learning · Computer Science 2024-10-07 Shuangqi Li , Chen Liu , Tong Zhang , Hieu Le , Sabine Süsstrunk , Mathieu Salzmann

Recent advances in generative artificial intelligence have enabled the creation of high-quality synthetic data that closely mimics real-world data. This paper explores the adaptation of the Stable Diffusion 2.0 model for generating…

Machine Learning · Computer Science 2024-05-07 Eugenio Lomurno , Matteo D'Oria , Matteo Matteucci

Scaling generative AI models is bottlenecked by the scarcity of high-quality training data. The ease of synthesizing from a generative model suggests using (unverified) synthetic data to augment a limited corpus of real data for the purpose…

Graphics · Computer Science 2025-10-15 Sina Alemohammad , Zhangyang Wang , Richard G. Baraniuk

We investigate the utility of diffusion generative models to efficiently synthesise datasets that effectively train deep learning models for image analysis. Specifically, we propose novel $\Gamma$-distribution Latent Denoising Diffusion…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 David Stojanovski , Mariana da Silva , Pablo Lamata , Arian Beqiri , Alberto Gomez

In the manufacturing industry, computer vision systems based on artificial intelligence (AI) are widely used to reduce costs and increase production. Training these AI models requires a large amount of training data that is costly to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Steven Moonen , Rob Salaets , Kenneth Batstone , Abdellatif Bey-Temsamani , Nick Michiels

The rapid advancement of generative models has enabled highly realistic audio deepfakes, yet current detectors suffer from a critical bias problem, leading to poor generalization across unseen datasets. This paper proposes Artifact-Focused…

Datasets are essential for training and testing vehicle perception algorithms. However, the collection and annotation of real-world images is time-consuming and expensive. Driving simulators offer a solution by automatically generating…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Haonan Zhao , Yiting Wang , Thomas Bashford-Rogers , Valentina Donzella , Kurt Debattista

The task of multimodal relation extraction has attracted significant research attention, but progress is constrained by the scarcity of available training data. One natural thought is to extend existing datasets with cross-modal generative…

Artificial Intelligence · Computer Science 2023-12-07 Zilin Du , Haoxin Li , Xu Guo , Boyang Li

As large language models (LLMs) are applied to more use cases, creating high quality, task-specific datasets for fine-tuning becomes a bottleneck for model improvement. Using high quality human data has been the most common approach to…

Computation and Language · Computer Science 2024-10-31 Yung-Chieh Chan , George Pu , Apaar Shanker , Parth Suresh , Penn Jenks , John Heyer , Sam Denton

Recent deep generative models (DGMs) such as generative adversarial networks (GANs) and diffusion probabilistic models (DPMs) have shown their impressive ability in generating high-fidelity photorealistic images. Although looking appealing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Ruyu Wang , Sabrina Schmedding , Marco F. Huber

The growing number of pretrained models in Machine Learning (ML) presents significant challenges for practitioners. Given a new dataset, they need to determine the most suitable deep learning (DL) pipeline, consisting of the pretrained…

Machine Learning · Computer Science 2025-06-17 Fabio Ferreira

The emergence of generative AI models has dramatically expanded the availability and use of synthetic data across scientific, industrial, and policy domains. While these developments open new possibilities for data analysis, they also raise…

Machine Learning · Statistics 2026-03-06 Ahmad Abdel-Azim , Ruoyu Wang , Xihong Lin

Image generation has shown remarkable results in generating high-fidelity realistic images, in particular with the advancement of diffusion-based models. However, the prevalence of AI-generated images may have side effects for the machine…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Maorong Wang , Nicolas Michel , Jiafeng Mao , Toshihiko Yamasaki

In today's business landscape, organizations need to find the right balance between using their customers' data ethically to power AI solutions and being compliant regarding data privacy and data usage regulations. In this paper, we discuss…

Computers and Society · Computer Science 2025-03-18 Aditi Godbole

Recent advancements in large language models (LLMs) have significantly enhanced their knowledge and generative capabilities, leading to a surge of interest in leveraging LLMs for high-quality data synthesis. However, synthetic data…

Machine Learning · Computer Science 2025-06-11 Ying Zhou , Xinyao Wang , Yulei Niu , Yaojie Shen , Lexin Tang , Fan Chen , Ben He , Le Sun , Longyin Wen

Development of artificial intelligence (AI) techniques in medical imaging requires access to large-scale and diverse datasets for training and evaluation. In dermatology, obtaining such datasets remains challenging due to significant…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Andrea Kim , Niloufar Saharkhiz , Elena Sizikova , Miguel Lago , Berkman Sahiner , Jana Delfino , Aldo Badano

Modern language model-based AI systems are remarkably powerful, yet their capabilities remain fundamentally capped by their human creators in three key ways. First, although a model's weights can be updated via fine-tuning, acquiring new…

Artificial Intelligence · Computer Science 2026-03-20 Zitong Yang