中文
相关论文

相关论文: Diffusion Models Without Attention

200 篇论文

Diffusion models are a new class of generative models that have shown outstanding performance in image generation literature. As a consequence, studies have attempted to apply diffusion models to other tasks, such as speech enhancement. A…

音频与语音处理 · 电气工程与系统科学 2024-10-10 Philippe Gonzalez , Zheng-Hua Tan , Jan Østergaard , Jesper Jensen , Tommy Sonne Alstrøm , Tobias May

Diffusion probabilistic model (DPM) recently becomes one of the hottest topic in computer vision. Its image generation application such as Imagen, Latent Diffusion Models and Stable Diffusion have shown impressive generation capabilities,…

计算机视觉与模式识别 · 计算机科学 2023-01-18 Junde Wu , Rao Fu , Huihui Fang , Yu Zhang , Yehui Yang , Haoyi Xiong , Huiying Liu , Yanwu Xu

Image restoration aims to enhance low quality images, producing high quality images that exhibit natural visual characteristics and fine semantic attributes. Recently, the diffusion model has emerged as a powerful technique for image…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Jiangtong Tan , Feng Zhao

Diffusion models demonstrate remarkable capabilities in capturing complex data distributions and have achieved compelling results in many generative tasks. While they have recently been extended to dense prediction tasks such as depth…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Haorui Ji , Taojun Lin , Hongdong Li

Recent advances in imaging and high-performance computing have made it possible to image the entire human brain at the cellular level. This is the basis to study the multi-scale architecture of the brain regarding its subdivision into brain…

图像与视频处理 · 电气工程与系统科学 2023-11-29 Jan-Oliver Kropp , Christian Schiffer , Katrin Amunts , Timo Dickscheid

Light microscopy is a widespread and inexpensive imaging technique facilitating biomedical discovery and diagnostics. However, light diffraction barrier and imperfections in optics limit the level of detail of the acquired images. The…

Denoising diffusion probabilistic models have transformed image generation with their impressive fidelity and diversity. We show that they also excel in estimating optical flow and monocular depth, surprisingly, without task-specific…

计算机视觉与模式识别 · 计算机科学 2023-12-07 Saurabh Saxena , Charles Herrmann , Junhwa Hur , Abhishek Kar , Mohammad Norouzi , Deqing Sun , David J. Fleet

Denoising Diffusion Probabilistic Models (DDPMs) are a very popular class of deep generative model that have been successfully applied to a diverse range of problems including image and video generation, protein and material synthesis,…

Diffusion models (DMs) are a class of generative machine learning methods that sample a target distribution by transforming samples of a trivial (often Gaussian) distribution using a learned stochastic differential equation. In standard…

统计力学 · 物理学 2024-08-15 Luke Causer , Grant M. Rotskoff , Juan P. Garrahan

We propose the Binary Diffusion Probabilistic Model (BDPM), a generative framework specifically designed for data representations in binary form. Conventional denoising diffusion probabilistic models (DDPMs) assume continuous inputs, use…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Vitaliy Kinakh , Slava Voloshynovskiy

Medical image segmentation is critical for diagnosing and treating spinal disorders. However, the presence of high noise, ambiguity, and uncertainty makes this task highly challenging. Factors such as unclear anatomical boundaries,…

图像与视频处理 · 电气工程与系统科学 2023-09-13 Zhiqing Zhang , Guojia Fan , Tianyong Liu , Nan Li , Yuyang Liu , Ziyu Liu , Canwei Dong , Shoujun Zhou

Diffusion models have gained attention for their ability to represent complex distributions and incorporate uncertainty, making them ideal for robust predictions in the presence of noisy or incomplete data. In this study, we develop and…

机器学习 · 计算机科学 2024-11-05 Yilin Zhuang , Sibo Cheng , Karthik Duraisamy

Diffusion models have shown remarkable performance in image generation in recent years. However, due to a quadratic increase in memory during generating ultra-high-resolution images (e.g. 4096*4096), the resolution of generated images is…

计算机视觉与模式识别 · 计算机科学 2024-05-09 Zhuoyi Yang , Heyang Jiang , Wenyi Hong , Jiayan Teng , Wendi Zheng , Yuxiao Dong , Ming Ding , Jie Tang

Diffusion models (DMs) have exhibited remarkable efficacy in various image restoration tasks. However, existing approaches typically operate within the high-dimensional pixel space, resulting in high computational overhead. While methods…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Yang Zheng , Wen Li , Zhaoqiang Liu

Diffusion generative models have achieved remarkable success in generating images with a fixed resolution. However, existing models have limited ability to generalize to different resolutions when training data at those resolutions are not…

计算机视觉与模式识别 · 计算机科学 2024-01-23 Alex Havrilla , Kevin Rojas , Wenjing Liao , Molei Tao

Recent Transformer-based diffusion models have shown remarkable performance, largely attributed to the ability of the self-attention mechanism to accurately capture both global and local contexts by computing all-pair interactions among…

计算机视觉与模式识别 · 计算机科学 2024-09-20 Yunxiang Fu , Chaoqi Chen , Yizhou Yu

We introduce FedDM, a novel training framework designed for the federated training of diffusion models. Our theoretical analysis establishes the convergence of diffusion models when trained in a federated setting, presenting the specific…

机器学习 · 计算机科学 2024-07-23 Jayneel Vora , Nader Bouacida , Aditya Krishnan , Prasant Mohapatra

Interpreting EEG signals linked to spoken language presents a complex challenge, given the data's intricate temporal and spatial attributes, as well as the various noise factors. Denoising diffusion probabilistic models (DDPMs), which have…

计算与语言 · 计算机科学 2023-11-15 Soowon Kim , Seo-Hyun Lee , Young-Eun Lee , Ji-Won Lee , Ji-Ha Park , Seong-Whan Lee

This paper investigates score-based diffusion models when the underlying target distribution is concentrated on or near low-dimensional manifolds within the higher-dimensional space in which they formally reside, a common characteristic of…

机器学习 · 计算机科学 2025-01-03 Gen Li , Yuling Yan

The Diffusion Probabilistic Model (DPM) has emerged as a highly effective generative model in the field of computer vision. Its intermediate latent vectors offer rich semantic information, making it an attractive option for various…

计算机视觉与模式识别 · 计算机科学 2023-03-29 Haipeng Zhou , Lei Zhu , Yuyin Zhou