中文
相关论文

相关论文: Scalable Diffusion Models with State Space Backbon…

200 篇论文

Diffusion models learn strong image priors that can be leveraged to solve inverse problems like medical image reconstruction. However, for real-world applications such as 3D Computed Tomography (CT) imaging, directly training diffusion…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Taewon Yang , Jason Hu , Jeffrey A. Fessler , Liyue Shen

We propose Diff-Shadow, a global-guided diffusion model for shadow removal. Previous transformer-based approaches can utilize global information to relate shadow and non-shadow regions but are limited in their synthesis ability and recover…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Jinting Luo , Ru Li , Chengzhi Jiang , Xiaoming Zhang , Mingyan Han , Ting Jiang , Haoqiang Fan , Shuaicheng Liu

Diffusion models like Stable Diffusion (SD) drive a vibrant open-source ecosystem including fully fine-tuned checkpoints and parameter-efficient adapters such as LoRA, LyCORIS, and ControlNet. However, these adaptation components are…

机器学习 · 计算机科学 2025-12-04 Zhidong Gao , Zimeng Pan , Yuhang Yao , Chenyue Xie , Wei Wei

Diffusion models (DMs) are powerful generative models capable of producing high-fidelity images but are constrained by high computational costs due to iterative multi-step inference. While Neural Architecture Search (NAS) can optimize DMs,…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Hongtao Huang , Xiaojun Chang , Lina Yao

Capturing images is a key part of automation for high-level tasks such as scene text recognition. Low-light conditions pose a challenge for high-level perception stacks, which are often optimized on well-lit, artifact-free images.…

图像与视频处理 · 电气工程与系统科学 2023-11-01 Cindy M. Nguyen , Eric R. Chan , Alexander W. Bergman , Gordon Wetzstein

Diffusion models have recently exhibited remarkable performance on synthetic data. After a diffusion path is selected, a base model, such as UNet, operates as a denoising autoencoder, primarily predicting noises that need to be eliminated…

人工智能 · 计算机科学 2023-10-11 Wenhao Li , Xiu Su , Shan You , Fei Wang , Chen Qian , Chang Xu

Diffusion models are a class of generative models that have been recently used for speech enhancement with remarkable success but are computationally expensive at inference time. Therefore, these models are impractical for processing…

音频与语音处理 · 电气工程与系统科学 2025-09-15 Bunlong Lay , Rostislav Makarov , Timo Gerkmann

Latent generative modeling, where a pretrained autoencoder maps pixels into a latent space for the diffusion process, has become the standard strategy for Diffusion Transformers (DiT); however, the autoencoder component has barely evolved.…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Boyang Zheng , Nanye Ma , Shengbang Tong , Saining Xie

This work presents a diffusion transformer framework for data-driven structural topology optimization that combines the accuracy of physics-based methods with the efficiency of generative deep learning. Conventional approaches such as the…

计算工程、金融与科学 · 计算机科学 2026-05-05 Aaron Lutheran , Srijan Das , Alireza Tabarraei

In generative models, two paradigms have gained attraction in various applications: next-set prediction-based Masked Generative Models and next-noise prediction-based Non-Autoregressive Models, e.g., Diffusion Models. In this work, we…

计算机视觉与模式识别 · 计算机科学 2024-12-11 Vincent Tao Hu , Björn Ommer

We show that diffusion models can achieve image sample quality superior to the current state-of-the-art generative models. We achieve this on unconditional image synthesis by finding a better architecture through a series of ablations. For…

机器学习 · 计算机科学 2021-06-02 Prafulla Dhariwal , Alex Nichol

Diffusion Transformers rely on static patchify tokenization, assigning the same token budget to smooth backgrounds, detailed object regions, noisy early timesteps, and late-stage refinements. We introduce the Dynamic Chunking Diffusion…

计算机视觉与模式识别 · 计算机科学 2026-05-08 Akash Haridas , Utkarsh Saxena , Parsa Ashrafi Fashi , Mehdi Rezagholizadeh , Vikram Appia , Emad Barsoum

Recent years have witnessed the rapid development of acceleration techniques for diffusion models, especially caching-based acceleration methods. These studies seek to answer two fundamental questions: "When to cache" and "How to use…

计算机视觉与模式识别 · 计算机科学 2025-10-03 Jiazi Bu , Pengyang Ling , Yujie Zhou , Yibin Wang , Yuhang Zang , Dahua Lin , Jiaqi Wang

Internal features from large-scale pre-trained diffusion models have recently been established as powerful semantic descriptors for a wide range of downstream tasks. Works that use these features generally need to add noise to images before…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Nick Stracke , Stefan Andreas Baumann , Kolja Bauer , Frank Fundel , Björn Ommer

Fluid antenna systems (FAS) offer enhanced spatial diversity for next-generation wireless systems. However, acquiring accurate channel state information (CSI) remains challenging due to the large number of reconfigurable ports and the…

信息论 · 计算机科学 2025-05-09 Erqiang Tang , Wei Guo , Hengtao He , Shenghui Song , Jun Zhang , Khaled B. Letaief

Diffusion models, a powerful and universal generative AI technology, have achieved tremendous success in computer vision, audio, reinforcement learning, and computational biology. In these applications, diffusion models provide flexible…

机器学习 · 计算机科学 2024-04-12 Minshuo Chen , Song Mei , Jianqing Fan , Mengdi Wang

Vision Transformers and U-Net architectures have been widely adopted in the implementation of Diffusion Models. However, each architecture presents specific challenges while realizing them on-device. Vision Transformers require positional…

计算机视觉与模式识别 · 计算机科学 2025-09-05 Sanchar Palit , Sathya Veera Reddy Dendi , Mallikarjuna Talluri , Raj Narayana Gadde

Designing model architectures requires decisions such as selecting operators (e.g., attention, convolution) and configurations (e.g., depth, width). However, evaluating the impact of these decisions on model quality requires costly…

Recent advances indicate that diffusion models hold great promise in image super-resolution. While the latest methods are primarily based on latent diffusion models with convolutional neural networks, there are few attempts to explore…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Kun Cheng , Lei Yu , Zhijun Tu , Xiao He , Liyu Chen , Yong Guo , Mingrui Zhu , Nannan Wang , Xinbo Gao , Jie Hu

The growing adoption of generative AI in real-world applications has exposed a critical bottleneck in the computational demands of diffusion-based text-to-image models. In this work, we propose KDC-Diff, a novel and scalable generative…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Md. Naimur Asif Borno , Md Sakib Hossain Shovon , Asmaa Soliman Al-Moisheer , Mohammad Ali Moni