English
Related papers

Related papers: Capturing Conditional Dependence via Auto-regressi…

200 papers

This paper explores the utility of diffusion-based models for anomaly detection, focusing on their efficacy in identifying deviations in both compact and high-resolution datasets. Diffusion-based architectures, including Denoising Diffusion…

Machine Learning · Computer Science 2024-12-11 Aryan Bhosale , Samrat Mukherjee , Biplab Banerjee , Fabio Cuzzolin

Autoregressive transformers have recently shown impressive image generation quality and efficiency on par with state-of-the-art diffusion models. Unlike diffusion architectures, autoregressive models can naturally incorporate arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Yixiao Chen , Zhiyuan Ma , Guoli Jia , Che Jiang , Jianjun Li , Bowen Zhou

We consider a class of conditional forward-backward diffusion models for conditional generative modeling, that is, generating new data given a covariate (or control variable). To formally study the theoretical properties of these…

Statistics Theory · Mathematics 2024-10-01 Rong Tang , Lizhen Lin , Yun Yang

Diffusion models are a class of probabilistic generative models that have been widely used as a prior for image processing tasks like text conditional generation and inpainting. We demonstrate that these models can be adapted to make…

Machine Learning · Computer Science 2023-06-14 Marc Finzi , Anudhyan Boral , Andrew Gordon Wilson , Fei Sha , Leonardo Zepeda-Núñez

Diffusion models have exhibited remarkable capabilities in text-to-image generation. However, their performance in image-to-text generation, specifically image captioning, has lagged behind Auto-Regressive (AR) models, casting doubt on…

Artificial Intelligence · Computer Science 2024-04-17 Yuchi Wang , Shuhuai Ren , Rundong Gao , Linli Yao , Qingyan Guo , Kaikai An , Jianhong Bai , Xu Sun

Diffusion models have emerged as powerful generative approaches for missing-data imputation, yet most existing methods operate directly in data space and degrade when training data are heavily incomplete. We investigate whether shifting…

Machine Learning · Computer Science 2026-05-28 Alberte Heering Estad , Ignacio Peis , Jes Frellsen

Recent progress in multimodal generation has increasingly combined autoregressive (AR) and diffusion-based approaches, leveraging their complementary strengths: AR models capture long-range dependencies and produce fluent, context-aware…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Junhao Chen , Yulia Tsvetkov , Xiaochuang Han

Understanding the structure of real data is paramount in advancing modern deep-learning methodologies. Natural data such as images are believed to be composed of features organized in a hierarchical and combinatorial manner, which neural…

Machine Learning · Statistics 2024-12-25 Antonio Sclocchi , Alessandro Favero , Matthieu Wyart

Autoregressive (AR) language models build representations incrementally via left-to-right prediction, while diffusion language models (dLLMs) are trained through full-sequence denoising. Although recent dLLMs match AR performance, whether…

Computation and Language · Computer Science 2026-05-11 Raghavv Goel , Risheek Garrepalli , Sudhanshu Agrawal , Chris Lott , Mingu Lee , Fatih Porikli

Conditional diffusion probabilistic models can model the distribution of natural images and can generate diverse and realistic samples based on given conditions. However, oftentimes their results can be unrealistic with observable color…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Kangfu Mei , Nithin Gopalakrishnan Nair , Vishal M. Patel

Spatiotemporal data imputation plays a crucial role in various fields such as traffic flow monitoring, air quality assessment, and climate prediction. However, spatiotemporal data collected by sensors often suffer from temporal…

Machine Learning · Computer Science 2024-12-18 Zijin Liu , Xiang Zhao , You Song

The diffusion model has shown remarkable performance in modeling data distributions and synthesizing data. However, the vanilla diffusion model requires complete or fully observed data for training. Incomplete data is a common issue in…

Machine Learning · Computer Science 2023-07-04 Yidong Ouyang , Liyan Xie , Chongxuan Li , Guang Cheng

We introduce Diffusion Active Learning, a novel approach that combines generative diffusion modeling with data-driven sequential experimental design to adaptively acquire data for inverse problems. Although broadly applicable, we focus on…

Machine Learning · Computer Science 2025-04-07 Luis Barba , Johannes Kirschner , Tomas Aidukas , Manuel Guizar-Sicairos , Benjamín Béjar

Diffusion Transformer, the backbone of Sora for video generation, successfully scales the capacity of diffusion models, pioneering new avenues for high-fidelity sequential data generation. Unlike static data such as images, sequential data…

Machine Learning · Computer Science 2025-02-05 Hengyu Fu , Zehao Dou , Jiawei Guo , Mengdi Wang , Minshuo Chen

Perceptual studies demonstrate that conditional diffusion models excel at reconstructing video content aligned with human visual perception. Building on this insight, we propose a video compression framework that leverages conditional…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Fangqiu Yi , Jingyu Xu , Jiawei Shao , Chi Zhang , Xuelong Li

With the emergence of diffusion models as a frontline generative model, many researchers have proposed molecule generation techniques with conditional diffusion models. However, the unavoidable discreteness of a molecule makes it difficult…

Machine Learning · Computer Science 2025-06-05 Jinho Chang , Jong Chul Ye

Conditional image synthesis based on user-specified requirements is a key component in creating complex visual content. In recent years, diffusion-based generative modeling has become a highly effective way for conditional image synthesis,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Zheyuan Zhan , Defang Chen , Jian-Ping Mei , Zhenghe Zhao , Jiawei Chen , Chun Chen , Siwei Lyu , Can Wang

The primary axes of interest in image-generating diffusion models are image quality, the amount of variation in the results, and how well the results align with a given condition, e.g., a class label or a text prompt. The popular…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Tero Karras , Miika Aittala , Tuomas Kynkäänniemi , Jaakko Lehtinen , Timo Aila , Samuli Laine

Recent advancements in diffusion models have demonstrated significant success in unsupervised anomaly segmentation. For anomaly segmentation, these models are first trained on normal data; then, an anomalous image is noised to an…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Mehrdad Moradi , Kamran Paynabar

Recent advances in denoising diffusion probabilistic models have shown great success in image synthesis tasks. While there are already works exploring the potential of this powerful tool in image semantic segmentation, its application in…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xinrong Hu , Yu-Jen Chen , Tsung-Yi Ho , Yiyu Shi