English
Related papers

Related papers: Latent Abstractions in Generative Diffusion Models

200 papers

Generative modeling of 3D human bodies have been studied extensively in computer vision. The core is to design a compact latent representation that is both expressive and semantically interpretable, yet existing approaches struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Haorui Ji , Rong Wang , Taojun Lin , Hongdong Li

Diffusion models have become the de facto framework for generating new datasets. The core of these models lies in the ability to reverse a diffusion process in time. The goal of this manuscript is to explain, from a PDE perspective, how…

Probability · Mathematics 2025-01-29 Fei Cao , Kimball Johnston , Thomas Laurent , Justin Le , Sébastien Motsch

Diffusion-based generative models are extremely effective in generating high-quality images, with generated samples often surpassing the quality of those produced by other models under several metrics. One distinguishing feature of these…

Machine Learning · Computer Science 2022-10-25 Ashwini Pokle , Zhengyang Geng , Zico Kolter

Deep generative models produce data according to a learned representation, e.g. diffusion models, through a process of approximation computing possible samples. Approximation can be understood as reconstruction and the large datasets used…

Human-Computer Interaction · Computer Science 2023-09-25 Luís Arandas , Mick Grierson , Miguel Carvalhais

We present a supervised learning framework of training generative models for density estimation. Generative models, including generative adversarial networks, normalizing flows, variational auto-encoders, are usually considered as…

Machine Learning · Computer Science 2023-10-24 Yanfang Liu , Minglei Yang , Zezhong Zhang , Feng Bao , Yanzhao Cao , Guannan Zhang

We introduce a new generative model that combines latent diffusion with persistent homology to create 3D shapes with high diversity, with a special emphasis on their topological characteristics. Our method involves representing 3D shapes as…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jiangbei Hu , Ben Fei , Baixin Xu , Fei Hou , Weidong Yang , Shengfa Wang , Na Lei , Chen Qian , Ying He

Current perceptive models heavily depend on resource-intensive datasets, prompting the need for innovative solutions. Leveraging recent advances in diffusion models, synthetic data, by constructing image inputs from various annotations,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yibo Wang , Ruiyuan Gao , Kai Chen , Kaiqiang Zhou , Yingjie Cai , Lanqing Hong , Zhenguo Li , Lihui Jiang , Dit-Yan Yeung , Qiang Xu , Kai Zhang

Diffusion models are a new class of generative models that have shown outstanding performance in image generation literature. As a consequence, studies have attempted to apply diffusion models to other tasks, such as speech enhancement. A…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-10 Philippe Gonzalez , Zheng-Hua Tan , Jan Østergaard , Jesper Jensen , Tommy Sonne Alstrøm , Tobias May

In the era of generative AI, deep generative models (DGMs) with latent representations have gained tremendous popularity. Despite their impressive empirical performance, the statistical properties of these models remain underexplored. DGMs…

Machine Learning · Statistics 2025-08-07 Seunghyun Lee , Yuqi Gu

While generative models have seen significant adoption across a wide range of data modalities, including 3D data, a consensus on which model is best suited for which task has yet to be reached. Further, conditional information such as text…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Matthias Humt , Ulrich Hillenbrand , Rudolph Triebel

We propose a new class of generative models that naturally handle data of varying dimensionality by jointly modeling the state and dimension of each datapoint. The generative process is formulated as a jump diffusion process that makes…

Deep generative models such as diffusion and flow matching are powerful machine learning tools capable of learning and sampling from high-dimensional distributions. They are particularly useful when the training data appears to be…

High Energy Physics - Phenomenology · Physics 2026-04-30 Zachary Bogorad , Ibrahim Elsharkawy , Yonatan Kahn , Andrew J. Larkoski , Noam Levi

We present a cascaded diffusion model based on a part-level implicit 3D representation. Our model achieves state-of-the-art generation quality and also enables part-level shape editing and manipulation without any additional training in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Juil Koo , Seungwoo Yoo , Minh Hieu Nguyen , Minhyuk Sung

This paper aims to conduct a comprehensive theoretical analysis of current diffusion models. We introduce a novel generative learning methodology utilizing the Schr{\"o}dinger bridge diffusion model in latent space as the framework for…

Machine Learning · Statistics 2024-12-24 Yuling Jiao , Lican Kang , Huazhen Lin , Jin Liu , Heng Zuo

Diffusion models (DMs) have achieved state-of-the-art results for image synthesis tasks as well as density estimation. Applied in the latent space of a powerful pretrained autoencoder (LDM), their immense computational requirements can be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Jeremias Traub

By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Robin Rombach , Andreas Blattmann , Dominik Lorenz , Patrick Esser , Björn Ommer

Diffusion models have shown great promise for image generation, beating GANs in terms of generation diversity, with comparable image quality. However, their application to 3D shapes has been limited to point or voxel representations that…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Gimin Nam , Mariem Khlifi , Andrew Rodriguez , Alberto Tono , Linqi Zhou , Paul Guerrero

Diffusion models have become the go-to method for text-to-image generation, producing high-quality images from pure noise. However, the inner workings of diffusion models is still largely a mystery due to their black-box nature and complex,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Berk Tinaz , Zalan Fabian , Mahdi Soltanolkotabi

Latent dynamical models are commonly used to learn the distribution of a latent dynamical process that represents a sequence of noisy data samples. However, producing samples from such models with high fidelity is challenging due to the…

Machine Learning · Computer Science 2023-08-17 Mohammad R. Rezaei

The rapid evolution of the fashion industry increasingly intersects with technological advancements, particularly through the integration of generative AI. This study introduces a novel generative pipeline designed to transform the fashion…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Abhishek Kumar Singh , Ioannis Patras