English
Related papers

Related papers: Bellman Diffusion: Generative Modeling as Learning…

200 papers

Text-conditioned image generation models have recently shown immense qualitative success using denoising diffusion processes. However, unlike discriminative vision-and-language models, it is a non-trivial task to subject these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Benno Krojer , Elinor Poole-Dayan , Vikram Voleti , Christopher Pal , Siva Reddy

Molecular conformation generation poses a significant challenge in the field of computational chemistry. Recently, Diffusion Probabilistic Models (DPMs) and Score-Based Generative Models (SGMs) are effectively used due to their capacity for…

Machine Learning · Computer Science 2024-09-24 Sijia Wang , Chen Wang , Zhenhao Zhao , Jiqiang Zhang , Weiran Cai

Uncovering the mechanisms behind long-term memory is one of the most fascinating open problems in neuroscience and artificial intelligence. Artificial associative memory networks have been used to formalize important aspects of biological…

Machine Learning · Statistics 2023-11-20 Luca Ambrogioni

Latent diffusion models (LDMs) power state-of-the-art high-resolution generative image models. LDMs learn the data distribution in the latent space of an autoencoder (AE) and produce images by mapping the generated latents into RGB image…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Tariq Berrada , Pietro Astolfi , Melissa Hall , Marton Havasi , Yohann Benchetrit , Adriana Romero-Soriano , Karteek Alahari , Michal Drozdzal , Jakob Verbeek

Inspired by the success of Convolutional Neural Networks (CNNs) for supervised prediction in images, we design the Deconvolutional Generative Model (DGM), a new probabilistic generative model whose inference calculations correspond to those…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Tan Nguyen , Nhat Ho , Ankit Patel , Anima Anandkumar , Michael I. Jordan , Richard G. Baraniuk

Denoising Diffusion Probabilistic Models (DDPMs) have garnered popularity for data generation across various domains. However, a significant bottleneck is the necessity for whole-network computation during every step of the generative…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Shuai Yang , Yukang Chen , Luozhou Wang , Shu Liu , Yingcong Chen

Applying pre-trained generative denoising diffusion models (DDMs) for downstream tasks such as image semantic editing usually requires either fine-tuning DDMs or learning auxiliary editing networks in the existing literature. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Ye Zhu , Yu Wu , Zhiwei Deng , Olga Russakovsky , Yan Yan

Diffusion probabilistic models (DPMs) are a class of powerful deep generative models (DGMs). Despite their success, the iterative generation process over the full timesteps is much less efficient than other DGMs such as GANs. Thus, the…

Machine Learning · Computer Science 2022-06-16 Fan Bao , Chongxuan Li , Jiacheng Sun , Jun Zhu , Bo Zhang

The linear Markov Decision Process (MDP) framework offers a principled foundation for reinforcement learning (RL) with strong theoretical guarantees and sample efficiency. However, its restrictive assumption-that both transition dynamics…

Machine Learning · Statistics 2025-06-03 Sinian Zhang , Kaicheng Zhang , Ziping Xu , Tianxi Cai , Doudou Zhou

Generative Diffusion Models (GDMs) have emerged as key components of Generative Artificial Intelligence (GenAI), offering unparalleled expressiveness and controllability for complex data generation tasks. However, their deployment in…

Networking and Internet Architecture · Computer Science 2025-08-13 Hamidreza Mazandarani , Mohammad Farhoudi , Masoud Shokrnezhad , Tarik Taleb

This study delves into the connection between machine learning and lattice field theory by linking generative diffusion models (DMs) with stochastic quantization, from a stochastic differential equation perspective. We show that DMs can be…

High Energy Physics - Lattice · Physics 2023-11-08 Lingxiao Wang , Gert Aarts , Kai Zhou

Diffusion Probabilistic Models stand as a critical tool in generative modelling, enabling the generation of complex data distributions. This family of generative models yields record-breaking performance in tasks such as image synthesis,…

Transfer learning has gained significant attention in recent deep learning research due to its ability to accelerate convergence and enhance performance on new tasks. However, its success is often contingent on the similarity between source…

Machine Learning · Computer Science 2024-10-28 Bedionita Soro , Bruno Andreis , Hayeon Lee , Wonyong Jeong , Song Chong , Frank Hutter , Sung Ju Hwang

Diffusion models have demonstrated significant potential in achieving state-of-the-art performance across various text generation tasks. In this systematic study, we investigate their application to the table-to-text problem by adapting the…

Computation and Language · Computer Science 2024-09-24 Aleksei S. Krylov , Oleg D. Somov

Graphs are a natural representation of brain activity derived from functional magnetic imaging (fMRI) data. It is well known that clusters of anatomical brain regions, known as functional connectivity networks (FCNs), encode temporal…

Machine Learning · Computer Science 2023-01-30 Alexander Campbell , Simeon Spasov , Nicola Toschi , Pietro Lio

Diffusion-based Deep Generative Models (DDGMs) offer state-of-the-art performance in generative modeling. Their main strength comes from their unique setup in which a model (the backward diffusion process) is trained to reverse the forward…

Machine Learning · Computer Science 2022-06-02 Kamil Deja , Anna Kuzina , Tomasz Trzciński , Jakub M. Tomczak

Generative models, particularly diffusion models, have achieved remarkable success in density estimation for multimodal data, drawing significant interest from the reinforcement learning (RL) community, especially in policy modeling in…

Machine Learning · Computer Science 2024-12-03 Jinouwen Zhang , Rongkun Xue , Yazhe Niu , Yun Chen , Jing Yang , Hongsheng Li , Yu Liu

We devise a distributional variant of gradient temporal-difference (TD) learning. Distributional reinforcement learning has been demonstrated to outperform the regular one in the recent study \citep{bellemare2017distributional}. In the…

Machine Learning · Computer Science 2019-04-04 Chao Qu , Shie Mannor , Huan Xu

Distributional reinforcement learning improves performance by capturing environmental stochasticity, but a comprehensive theoretical understanding of its effectiveness remains elusive. In addition, the intractable element of the infinite…

Machine Learning · Computer Science 2025-05-14 Taehyun Cho , Seungyub Han , Seokhun Ju , Dohyeong Kim , Kyungjae Lee , Jungwoo Lee

A prominent family of methods for learning data distributions relies on density ratio estimation (DRE), where a model is trained to $\textit{classify}$ between data samples and samples from some reference distribution. DRE-based models can…

Machine Learning · Computer Science 2024-11-01 Shahar Yadin , Noam Elata , Tomer Michaeli