English
Related papers

Related papers: Renormalization Group flow, Optimal Transport and …

200 papers

Diffusion models are powerful generative models that achieve state-of-the-art performance in image synthesis. However, training them demands substantial amounts of data and computational resources. Continual learning would allow for…

Machine Learning · Computer Science 2025-03-05 Sergi Masip , Pau Rodriguez , Tinne Tuytelaars , Gido M. van de Ven

Diffusion models have become the dominant approach for visual generation. They are trained by denoising a Markovian process which gradually adds noise to the input. We argue that the Markovian property limits the model's ability to fully…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Jiatao Gu , Yuyang Wang , Yizhe Zhang , Qihang Zhang , Dinghuai Zhang , Navdeep Jaitly , Josh Susskind , Shuangfei Zhai

Denoising diffusion models (DDM) have gained recent traction in medical image translation given improved training stability over adversarial models. DDMs learn a multi-step denoising transformation to progressively map random Gaussian-noise…

Image and Video Processing · Electrical Eng. & Systems 2024-05-14 Fuat Arslan , Bilal Kabas , Onat Dalmaz , Muzaffer Ozbey , Tolga Çukur

Multiscale spatial structure complicates temporal prediction because small-scale spatial fluctuations influence large-scale evolution, yet resolving all scales is often intractable. Standard diffusion models do not address this problem…

Fluid Dynamics · Physics 2026-04-02 Yuki Yasuda , Tobias Bischoff

Diffusion model-based approaches recently achieved re-markable success in MRI reconstruction, but integration into clinical routine remains challenging due to its time-consuming convergence. This phenomenon is partic-ularly notable when…

Image and Video Processing · Electrical Eng. & Systems 2024-11-07 Yu Guan , Qinrong Cai , Wei Li , Qiuyun Fan , Dong Liang , Qiegen Liu

While diffusion models have shown great success in image generation, their noise-inverting generative process does not explicitly consider the structure of images, such as their inherent multi-scale nature. Inspired by diffusion models and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Severi Rissanen , Markus Heinonen , Arno Solin

This work aims to improve the applicability of diffusion models in realistic image restoration. Specifically, we enhance the diffusion model in several aspects such as network architecture, noise level, denoising steps, training image size,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Generative models based on diffusion have become the state of the art in the last few years, notably for image generation. Here, we analyse them in the high-dimensional limit, where data are formed by a very large number of variables. We…

Disordered Systems and Neural Networks · Physics 2023-10-31 Giulio Biroli , Marc Mézard

Diffusion models have gained significant attention in the realm of image generation due to their exceptional performance. Their success has been recently expanded to text generation via generating all tokens within a sequence concurrently.…

Computation and Language · Computer Science 2023-12-14 Tong Wu , Zhihao Fan , Xiao Liu , Yeyun Gong , Yelong Shen , Jian Jiao , Hai-Tao Zheng , Juntao Li , Zhongyu Wei , Jian Guo , Nan Duan , Weizhu Chen

Reliable image transmission over wireless channels is particularly challenging at extremely low transmission rates, where conventional compression and channel coding schemes fail to preserve adequate visual quality. To address this issue,…

Information Theory · Computer Science 2025-10-27 Shengkang Chen , Tong Wu , Zhiyong Chen , Feng Yang , Meixia Tao , Wenjun Zhang

Diffusion models have demonstrated remarkable success in image generation, but they are computationally intensive and time-consuming to train. In this paper, we introduce a novel diffusion model that benefits from quantum computing…

We introduce beta diffusion, a novel generative modeling method that integrates demasking and denoising to generate data within bounded ranges. Using scaled and shifted beta distributions, beta diffusion utilizes multiplicative transitions…

Machine Learning · Computer Science 2023-12-27 Mingyuan Zhou , Tianqi Chen , Zhendong Wang , Huangjie Zheng

Beyond high-fidelity image synthesis, diffusion models have recently exhibited promising results in dense visual perception tasks. However, most existing work treats diffusion models as a standalone component for perception tasks, employing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Shuhong Zheng , Zhipeng Bao , Ruoyu Zhao , Martial Hebert , Yu-Xiong Wang

Generative models now produce images with such stunning realism that they can easily deceive the human eye. While this progress unlocks vast creative potential, it also presents significant risks, such as the spread of misinformation.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Yichi Zhang , Xiaogang Xu

We present DiffusionBERT, a new generative masked language model based on discrete diffusion models. Diffusion models and many pre-trained language models have a shared training objective, i.e., denoising, making it possible to combine the…

Computation and Language · Computer Science 2022-12-02 Zhengfu He , Tianxiang Sun , Kuanning Wang , Xuanjing Huang , Xipeng Qiu

Generative retrieval (GR) reframes document retrieval as an end-to-end task of generating sequential document identifiers (DocIDs). Existing GR methods predominantly rely on left-to-right auto-regressive decoding, which suffers from two…

Information Retrieval · Computer Science 2026-02-04 Xinpeng Zhao , Zhaochun Ren , Yukun Zhao , Zhenyang Li , Mengqi Zhang , Jun Feng , Ran Chen , Ying Zhou , Zhumin Chen , Shuaiqiang Wang , Dawei Yin , Xin Xin

We present the first acquisition-agnostic diffusion generative model for Magnetic Resonance Imaging (MRI) in the neonatal intensive care unit (NICU) to solve a range of inverse problems for shortening scan time and improving motion…

Medical Physics · Physics 2025-05-22 Yamin Arefeen , Brett Levac , Jonathan I. Tamir

Medical image understanding requires meticulous examination of fine visual details, with particular regions requiring additional attention. While radiologists build such expertise over years of experience, it is challenging for AI models to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Ying Jin , Zhuoran Zhou , Haoquan Fang , Jenq-Neng Hwang

Denoising-based generative models, particularly diffusion and flow matching algorithms, have achieved remarkable success. However, aligning their output distributions with complex downstream objectives, such as human preferences,…

Machine Learning · Computer Science 2025-08-29 Luozhijie Jin , Zijie Qiu , Jie Liu , Zijie Diao , Lifeng Qiao , Ning Ding , Alex Lamb , Xipeng Qiu

We propose self-diffusion, a novel framework for solving inverse problems without relying on pretrained generative models. Traditional diffusion-based approaches require training a model on a clean dataset to learn to reverse the forward…

Machine Learning · Computer Science 2025-12-09 Guanxiong Luo , Shoujin Huang , Yanlong Yang