English
Related papers

Related papers: Stabilizing Self-Consuming Diffusion Models with L…

200 papers

Navigating in the latent space of StyleGAN has shown effectiveness for face editing. However, the resulting methods usually encounter challenges in complicated navigation due to the entanglement among different attributes in the latent…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Binglei Li , Zhizhong Huang , Hongming Shan , Junping Zhang

Strong semantic representations improve the convergence and generation quality of diffusion and flow models. Existing approaches largely rely on external models, which require separate training, operate on misaligned objectives, and exhibit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Hila Chefer , Patrick Esser , Dominik Lorenz , Dustin Podell , Vikash Raja , Vinh Tong , Antonio Torralba , Robin Rombach

Performing Data Assimilation (DA) at a low cost is of prime concern in Earth system modeling, particularly at the time of big data where huge quantities of observations are available. Capitalizing on the ability of Neural Networks…

Machine Learning · Computer Science 2021-11-24 Mathis Peyron , Anthony Fillion , Selime Gürol , Victor Marchais , Serge Gratton , Pierre Boudier , Gael Goret

Deep learning methods have impacted almost every research field, demonstrating notable successes in medical imaging tasks such as denoising and super-resolution. However, the prerequisite for deep learning is data at scale, but data sharing…

Medical Physics · Physics 2024-02-16 Yongyi Shi , Wenjun Xia , Chuang Niu , Christopher Wiedeman , Ge Wang

Text-to-image generation has witnessed significant progress with the advent of diffusion models. Despite the ability to generate photorealistic images, current text-to-image diffusion models still often struggle to accurately interpret and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Tsung-Han Wu , Long Lian , Joseph E. Gonzalez , Boyi Li , Trevor Darrell

Temporal abstraction and efficient planning pose significant challenges in offline reinforcement learning, mainly when dealing with domains that involve temporally extended tasks and delayed sparse rewards. Existing methods typically plan…

Machine Learning · Computer Science 2023-10-03 Wenhao Li

In this work we study how diffusion-based generative models produce high-dimensional data, such as an image, by implicitly relying on a manifestation of a low-dimensional set of latent abstractions, that guide the generative process. We…

Machine Learning · Computer Science 2024-10-07 Giulio Franzese , Mattia Martini , Giulio Corallo , Paolo Papotti , Pietro Michiardi

Latent diffusion models excel at generating high-quality images but lose the benefits of end-to-end modeling. They discard information during image encoding, require a separately trained decoder, and model an auxiliary distribution to the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Alan Baade , Eric Ryan Chan , Kyle Sargent , Changan Chen , Justin Johnson , Ehsan Adeli , Li Fei-Fei

In many real-world regression tasks, the data distribution is heavily skewed, and models learn predominantly from abundant majority samples while failing to predict minority labels accurately. While imbalanced classification has been…

Machine Learning · Computer Science 2025-09-30 Shayan Alahyari

The scarcity of accessible, compliant, and ethically sourced data presents a considerable challenge to the adoption of artificial intelligence (AI) in sensitive fields like healthcare, finance, and biomedical research. Furthermore, access…

Machine Learning · Computer Science 2025-04-02 Kumar Kshitij Patel , Weitong Zhang , Lingxiao Wang

Diffusion models that are based on iterative denoising have been recently proposed and leveraged in various generation tasks like image generation. Whereas, as a way inherently built for continuous data, existing diffusion models still have…

Computation and Language · Computer Science 2023-04-11 Jiaao Chen , Aston Zhang , Mu Li , Alex Smola , Diyi Yang

The recovery of training data from generative models ("model inversion") has been extensively studied for diffusion models in the data domain as a memorization/overfitting phenomenon. Latent diffusion models (LDMs), which operate on the…

Machine Learning · Computer Science 2026-03-26 Mingxing Rao , Bowen Qu , Daniel Moyer

Diffusion models have emerged as powerful generative frameworks by progressively adding noise to data through a forward process and then reversing this process to generate realistic samples. While these models have achieved strong…

Machine Learning · Computer Science 2025-03-04 Xingzhuo Guo , Yu Zhang , Baixu Chen , Haoran Xu , Jianmin Wang , Mingsheng Long

Deep generative models are becoming widely used across science and industry for a variety of purposes. A common challenge is achieving a precise implicit or explicit representation of the data probability density. Recent proposals have…

Machine Learning · Statistics 2021-11-05 Ramon Winterhalder , Marco Bellagente , Benjamin Nachman

Diffusion models generate high-dimensional data such as images by learning a process that gradually removes noise from corrupted data. Recent studies have shown that the backward dynamics of diffusion models exhibit two characteristic…

Statistical Mechanics · Physics 2026-04-14 Tomoei Takahashi , Takashi Takahashi , Yoshiyuki Kabashima

Latent diffusion models (LDMs) power state-of-the-art high-resolution generative image models. LDMs learn the data distribution in the latent space of an autoencoder (AE) and produce images by mapping the generated latents into RGB image…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Tariq Berrada , Pietro Astolfi , Melissa Hall , Marton Havasi , Yohann Benchetrit , Adriana Romero-Soriano , Karteek Alahari , Michal Drozdzal , Jakob Verbeek

Recently, the application of diffusion models has facilitated the significant development of speech and audio generation. Nevertheless, the quality of samples generated by diffusion models still needs improvement. And the effectiveness of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Wenhao Guan , Kaidi Wang , Wangjin Zhou , Yang Wang , Feng Deng , Hui Wang , Lin Li , Qingyang Hong , Yong Qin

Recent studies on StyleGAN variants show promising performances for various generation tasks. In these models, latent codes have traditionally been manipulated and searched for the desired images. However, this approach sometimes suffers…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Takumi Harada , Kazuyuki Aihara , Hiroyuki Sakai

Lifelong few-shot customization for text-to-image diffusion aims to continually generalize existing models for new tasks with minimal data while preserving old knowledge. Current customization diffusion models excel in few-shot tasks but…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Nan Song , Xiaofeng Yang , Ze Yang , Guosheng Lin

Although synthetic data is widely promoted as a remedy, its prevailing production paradigm -- one optimizing for statistical smoothness -- systematically removes the long-tail, cognitively grounded irregularities that characterize human…

Artificial Intelligence · Computer Science 2025-12-10 Zhongjie Jiang