English
Related papers

Related papers: Generating Synthetic Fair Syntax-agnostic Data by …

200 papers

Human reasoning can distill principles from observed patterns and generalize them to explain and solve novel problems. The most powerful artificial intelligence systems lack explainability and symbolic reasoning ability, and have therefore…

Machine Learning · Computer Science 2021-11-17 Paul J. Blazek , Kesavan Venkatesh , Milo M. Lin

Diffusion language models intrinsically fail to capture correlations between decoded tokens, which leads to a harsh trade-off between sampling quality and throughput. To solve this issue, we propose DiLaDiff, a variant of masked diffusion…

Machine Learning · Computer Science 2026-05-25 Jean-Marie Lemercier , Tomas Geffner , Karsten Kreis , Morteza Mardani , Arash Vahdat , Ante Jukić

Recent advances in generative artificial intelligence have enabled the creation of high-quality synthetic data that closely mimics real-world data. This paper explores the adaptation of the Stable Diffusion 2.0 model for generating…

Machine Learning · Computer Science 2024-05-07 Eugenio Lomurno , Matteo D'Oria , Matteo Matteucci

Learning methods using synthetic data have attracted attention as an effective approach for increasing the diversity of training data while reducing collection costs, thereby improving the robustness of model discrimination. However, many…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Koshiro Nagano , Ryo Fujii , Ryo Hachiuma , Fumiaki Sato , Taiki Sekii , Hideo Saito

Data-free knowledge distillation (DFKD) transfers knowledge from a teacher to a student without access to the real in-distribution (ID) data. While existing methods perform well on small-scale images, they suffer from mode collapse when…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Xuewan He , Jielei Wang , Zihan Cheng , Yuchen Su , Shiyue Huang , Guoming Lu

People speak at different levels of specificity in different situations. Depending on their knowledge, interlocutors, mood, etc.} A conversational agent should have this ability and know when to be specific and when to be general. We…

Computation and Language · Computer Science 2017-02-23 Jiwei Li , Will Monroe , Dan Jurafsky

Ensuring fairness in machine learning remains a significant challenge, as models often inherit biases from their training data. Generative models have recently emerged as a promising approach to mitigate bias at the data level while…

Machine Learning · Computer Science 2025-09-25 Emmanouil Panagiotou , Benoît Ronval , Arjun Roy , Ludwig Bothmann , Bernd Bischl , Siegfried Nijssen , Eirini Ntoutsi

Explicit density learners are becoming an increasingly popular technique for generative models because of their ability to better model probability distributions. They have advantages over Generative Adversarial Networks due to their…

Machine Learning · Computer Science 2025-06-27 Steven Walton , Valeriy Klyukin , Maksim Artemev , Denis Derkach , Nikita Orlov , Humphrey Shi

Diffusion models (DMs) have achieved state-of-the-art results for image synthesis tasks as well as density estimation. Applied in the latent space of a powerful pretrained autoencoder (LDM), their immense computational requirements can be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Jeremias Traub

Dataset distillation (DD) has emerged as a widely adopted technique for crafting a synthetic dataset that captures the essential information of a training dataset, facilitating the training of accurate neural models. Its applications span…

Machine Learning · Computer Science 2025-02-04 Saeed Vahidian , Mingyu Wang , Jianyang Gu , Vyacheslav Kungurtsev , Wei Jiang , Yiran Chen

Deep learning methods have impacted almost every research field, demonstrating notable successes in medical imaging tasks such as denoising and super-resolution. However, the prerequisite for deep learning is data at scale, but data sharing…

Medical Physics · Physics 2024-02-16 Yongyi Shi , Wenjun Xia , Chuang Niu , Christopher Wiedeman , Ge Wang

The ultimate goal of Dataset Distillation is to synthesize a small synthetic dataset such that a model trained on this synthetic set will perform equally well as a model trained on the full, real dataset. Until now, no method of Dataset…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Ziyao Guo , Kai Wang , George Cazenavette , Hui Li , Kaipeng Zhang , Yang You

While diffusion models have achieved great success in the field of video generation, this progress is accompanied by a rapidly escalating computational burden. Among the existing acceleration methods, Feature Caching is popular due to its…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chang Zou , Changlin Li , Yang Li , Patrol Li , Jianbing Wu , Xiao He , Songtao Liu , Zhao Zhong , Kailin Huang , Linfeng Zhang

The increasing use of machine learning in learning analytics (LA) has raised significant concerns around algorithmic fairness and privacy. Synthetic data has emerged as a dual-purpose tool, enhancing privacy and improving fairness in LA…

Machine Learning · Computer Science 2026-05-21 Qinyi Liu , Oscar Deho , Sam Urmian , Mohammad Khalil , Srecko Joksimovic , George Siemens

As large language models increasingly mediate firm - customer interactions, firms face a tradeoff: the most capable models perform well but are costly and difficult to control at scale. Existing knowledge distillation methods address this…

Computation and Language · Computer Science 2026-02-23 Tong Wang , K. Sudhir

This paper examines the evolving nature of internal representations in generative visual models, focusing on the conceptual and technical shift from GANs and VAEs to diffusion-based architectures. Drawing on Beatrice Fazi's account of…

Machine Learning · Computer Science 2025-11-11 Ludovica Schaerf

Face recognition models are trained on large-scale datasets, which have privacy and ethical concerns. Lately, the use of synthetic data to complement or replace genuine data for the training of face recognition models has been proposed.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 David Geissbühler , Hatef Otroshi Shahreza , Sébastien Marcel

Training a deep learning model with artificially generated data can be an alternative when training data are scarce, yet it suffers from poor generalization performance due to a large domain gap. In this paper, we characterize the domain…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Gilhyun Nam , Gyeongjae Choi , Kyungmin Lee

It is now well understood that machine learning models, trained on data without due care, often exhibit unfair and discriminatory behavior against certain populations. Traditional algorithmic fairness research has mainly focused on…

Machine Learning · Computer Science 2022-09-16 Rashidul Islam , Shimei Pan , James R. Foulds

Dataset distillation aims to create a compact dataset that retains essential information while maintaining model performance. Diffusion models (DMs) have shown promise for this task but struggle in low images-per-class (IPC) settings, where…

Machine Learning · Computer Science 2025-07-08 Linfeng Ye , Shayan Mohajer Hamidi , Guang Li , Takahiro Ogawa , Miki Haseyama , Konstantinos N. Plataniotis