English
Related papers

Related papers: Seasoning Generative Models for a Generalization A…

200 papers

With the rapidly growing model complexity and data volume, training deep generative models (DGMs) for better performance has becoming an increasingly more important challenge. Previous research on this problem has mainly focused on…

Machine Learning · Computer Science 2021-12-08 Yufan Zhou , Chunyuan Li , Changyou Chen , Jinhui Xu

In aligning large language models (LLMs), reward models have played an important role, but are standardly trained as discriminative models and rely only on labeled human preference data. In this paper, we explore methods that train reward…

Computation and Language · Computer Science 2026-01-27 Chenglong Wang , Yang Gan , Yifu Huo , Yongyu Mu , Qiaozhi He , Murun Yang , Bei Li , Tong Xiao , Chunliang Zhang , Tongran Liu , Jingbo Zhu

The predominant success of diffusion models in generative modeling has spurred significant interest in understanding their theoretical foundations. In this work, we propose a feature learning framework aimed at analyzing and comparing the…

Machine Learning · Statistics 2025-03-04 Andi Han , Wei Huang , Yuan Cao , Difan Zou

Generative adversarial networks (GANs) are emerging machine learning models for generating synthesized data similar to real data by jointly training a generator and a discriminator. In many applications, data and computational resources are…

Machine Learning · Computer Science 2021-07-20 Jinke Ren , Chonghe Liu , Guanding Yu , Dongning Guo

The recently introduced Consistency models pose an efficient alternative to diffusion algorithms, enabling rapid and good quality image synthesis. These methods overcome the slowness of diffusion models by directly mapping noise to data,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Shelly Golan , Roy Ganz , Michael Elad

Advances in generative modeling based on GANs has motivated the community to find their use beyond image generation and editing tasks. In particular, several recent works have shown that GAN representations can be re-purposed for…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Oindrila Saha , Zezhou Cheng , Subhransu Maji

Generative models are known to be difficult to assess. Recent works, especially on generative adversarial networks (GANs), produce good visual samples of varied categories of images. However, the validation of their quality is still…

Machine Learning · Computer Science 2019-09-25 Timothée Lesort , Andrei Stoain , Jean-François Goudou , David Filliat

Guided or controlled data generation with diffusion models\blfootnote{Partial preliminary results of this work appeared in International Conference on Machine Learning 2025 \citep{li2025provable}.} has become a cornerstone of modern…

Machine Learning · Statistics 2025-12-05 Yuchen Jiao , Yuxin Chen , Gen Li

Adversarial Imitation Learning is traditionally framed as a two-player zero-sum game between a learner and an adversarially chosen cost function, and can therefore be thought of as the sequential generalization of a Generative Adversarial…

Machine Learning · Computer Science 2025-03-04 Runzhe Wu , Yiding Chen , Gokul Swamy , Kianté Brantley , Wen Sun

Diffusion-based planning has shown promising results in long-horizon, sparse-reward tasks by training trajectory diffusion models and conditioning the sampled trajectories using auxiliary guidance functions. However, due to their nature as…

Machine Learning · Computer Science 2023-10-31 Kyowoon Lee , Seongun Kim , Jaesik Choi

Generative adversarial networks (GANs) are powerful generative models, but usually suffer from instability and generalization problem which may lead to poor generations. Most existing works focus on stabilizing the training of the…

Machine Learning · Computer Science 2020-04-29 Shufei Zhang , Zhuang Qian , Kaizhu Huang , Jimin Xiao , Yuan He

Diffusion-based generative models have had a high impact on the computer vision and speech processing communities these past years. Besides data generation tasks, they have also been employed for data restoration tasks like speech…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-17 Jean-Marie Lemercier , Julius Richter , Simon Welker , Timo Gerkmann

In generative adversarial networks, improving discriminators is one of the key components for generation performance. As image classifiers are biased toward texture and debiasing improves accuracy, we investigate 1) if the discriminators…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Junho Kim , Yunjey Choi , Youngjung Uh

Generative adversarial networks (GANs) have shown outstanding performance on a wide range of problems in computer vision, graphics, and machine learning, but often require numerous training data and heavy computational resources. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Sangwoo Mo , Minsu Cho , Jinwoo Shin

Diffusion models are powerful generative models that produce high-quality samples from complex data. While their infinite-data behavior is well understood, their generalization with finite data remains less clear. Classical learning theory…

Machine Learning · Statistics 2026-02-02 Claudia Merger , Sebastian Goldt

Generative neural samplers are probabilistic models that implement sampling using feedforward neural networks: they take a random input vector and produce a sample from a probability distribution defined by the network weights. These models…

Machine Learning · Statistics 2016-06-03 Sebastian Nowozin , Botond Cseke , Ryota Tomioka

Learning a categorical distribution comes with its own set of challenges. A successful approach taken by state-of-the-art works is to cast the problem in a continuous domain to take advantage of the impressive performance of the generative…

Machine Learning · Computer Science 2023-03-09 Florence Regol , Mark Coates

Generative Adversarial Networks (GANs) have shown great promise in modeling high dimensional data. The learning objective of GANs usually minimizes some measure discrepancy, \textit{e.g.}, $f$-divergence~($f$-GANs) or Integral Probability…

Machine Learning · Computer Science 2020-04-07 Yuxuan Song , Qiwei Ye , Minkai Xu , Tie-Yan Liu

This paper presents a diffusion-based recommender system that incorporates classifier-free guidance. Most current recommender systems provide recommendations using conventional methods such as collaborative or content-based filtering.…

Information Retrieval · Computer Science 2024-09-17 Noah Buchanan , Susan Gauch , Quan Mai

This paper considers the general $f$-divergence formulation of bidirectional generative modeling, which includes VAE and BiGAN as special cases. We present a new optimization method for this formulation, where the gradient is computed using…

Machine Learning · Computer Science 2020-07-01 Xinwei Shen , Tong Zhang , Kani Chen