中文
相关论文

相关论文: Not All Parameters Matter: Masking Diffusion Model…

200 篇论文

In recent years, Denoising Diffusion Models have demonstrated remarkable success in generating semantically valuable pixel-wise representations for image generative modeling. In this study, we propose a novel end-to-end framework, called…

图像与视频处理 · 电气工程与系统科学 2023-03-21 Zhaohu Xing , Liang Wan , Huazhu Fu , Guang Yang , Lei Zhu

In MRI, deep neural networks have been proposed to reconstruct diffusion model parameters. However, the inputs of the networks were designed for a specific diffusion gradient scheme (i.e., diffusion gradient directions and numbers) and a…

图像与视频处理 · 电气工程与系统科学 2021-02-05 Juhung Park , Woojin Jung , Eun-Jung Choi , Se-Hong Oh , Dongmyung Shin , Hongjun An , Jongho Lee

Diffusion Models represent a significant advancement in generative modeling, employing a dual-phase process that first degrades domain-specific information via Gaussian noise and restores it through a trainable model. This framework enables…

神经与进化计算 · 计算机科学 2024-11-21 Benedikt Hartl , Yanbo Zhang , Hananel Hazan , Michael Levin

The class-conditional image generation based on diffusion models is renowned for generating high-quality and diverse images. However, most prior efforts focus on generating images for general categories, e.g., 1000 classes in ImageNet-1k. A…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Ziying Pan , Kun Wang , Gang Li , Feihong He , Yongxuan Lai

In this work, we dive deep into the impact of additive noise in pre-training deep networks. While various methods have attempted to use additive noise inspired by the success of latent denoising diffusion models, when used in combination…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Hyesong Choi , Daeun Kim , Sungmin Cha , Kwang Moo Yi , Dongbo Min

U-Nets are among the most widely used architectures in computer vision, renowned for their exceptional performance in applications such as image segmentation, denoising, and diffusion modeling. However, a theoretical explanation of the…

机器学习 · 计算机科学 2024-05-02 Song Mei

Generating realistic time series data is critical for applications in healthcare, finance, and science. However, irregular sampling and missing values present significant challenges. While prior methods address these irregularities, they…

机器学习 · 计算机科学 2025-10-09 Gal Fadlon , Idan Arbiv , Nimrod Berman , Omri Azencot

Talking head generation is a significant research topic that still faces numerous challenges. Previous works often adopt generative adversarial networks or regression models, which are plagued by generation quality and average facial shape…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Ziyu Yao , Xuxin Cheng , Zhiqi Huang

Diffusion models generate new samples by progressively decreasing the noise from the initially provided random distribution. This inference procedure generally utilizes a trained neural network numerous times to obtain the final output,…

Diffusion models have shown remarkable success across a wide range of generative tasks. However, they often suffer from spatially inconsistent generation, arguably due to the inherent locality of their denoising mechanisms. This can yield…

机器学习 · 计算机科学 2026-02-04 Wenshuai Zhao , Zhiyuan Li , Yi Zhao , Mohammad Hassan Vali , Martin Trapp , Joni Pajarinen , Juho Kannala , Arno Solin

Adapting neural networks to new tasks typically requires task-specific fine-tuning, which is time-consuming and reliant on labeled data. We explore a generative alternative that produces task-specific parameters directly from task identity,…

机器学习 · 计算机科学 2025-06-24 Lijun Zhang , Xiao Liu , Hui Guan

Free-form inpainting is the task of adding new content to an image in the regions specified by an arbitrary binary mask. Most existing approaches train for a certain distribution of masks, which limits their generalization capabilities to…

计算机视觉与模式识别 · 计算机科学 2022-09-01 Andreas Lugmayr , Martin Danelljan , Andres Romero , Fisher Yu , Radu Timofte , Luc Van Gool

Denoising diffusion models have emerged as a powerful tool for various image generation and editing tasks, facilitating the synthesis of visual content in an unconditional or input-conditional manner. The core idea behind them is learning…

计算机视觉与模式识别 · 计算机科学 2025-03-12 Yi Huang , Jiancheng Huang , Yifan Liu , Mingfu Yan , Jiaxi Lv , Jianzhuang Liu , Wei Xiong , He Zhang , Liangliang Cao , Shifeng Chen

With the success of image generation, generative diffusion models are increasingly adopted for discriminative tasks, as pixel generation provides a unified perception interface. However, directly repurposing the generative denoising process…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Ziqi Pang , Xin Xu , Yu-Xiong Wang

Discrete diffusion models generate sequences by iteratively denoising samples corrupted by categorical noise, offering an appealing alternative to autoregressive decoding for structured and symbolic generation. However, standard training…

机器学习 · 计算机科学 2026-02-04 Huu Binh Ta , Michael Cardei , Alvaro Velasquez , Ferdinando Fioretto

There has been a longstanding belief that generation can facilitate a true understanding of visual data. In line with this, we revisit generatively pre-training visual representations in light of recent interest in denoising diffusion…

计算机视觉与模式识别 · 计算机科学 2023-04-07 Chen Wei , Karttikeya Mangalam , Po-Yao Huang , Yanghao Li , Haoqi Fan , Hu Xu , Huiyu Wang , Cihang Xie , Alan Yuille , Christoph Feichtenhofer

Generating 3D scenes is a challenging open problem, which requires synthesizing plausible content that is fully consistent in 3D space. While recent methods such as neural radiance fields excel at view synthesis and 3D reconstruction, they…

计算机视觉与模式识别 · 计算机科学 2024-02-22 Titas Anciukevičius , Fabian Manhardt , Federico Tombari , Paul Henderson

By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a…

计算机视觉与模式识别 · 计算机科学 2022-04-14 Robin Rombach , Andreas Blattmann , Dominik Lorenz , Patrick Esser , Björn Ommer

A diffusion probabilistic model (DPM), which constructs a forward diffusion process by gradually adding noise to data points and learns the reverse denoising process to generate new samples, has been shown to handle complex data…

计算机视觉与模式识别 · 计算机科学 2023-10-16 Zhengxiong Luo , Dayou Chen , Yingya Zhang , Yan Huang , Liang Wang , Yujun Shen , Deli Zhao , Jingren Zhou , Tieniu Tan

Denoising diffusion models, a class of generative models, have garnered immense interest lately in various deep-learning problems. A diffusion probabilistic model defines a forward diffusion stage where the input data is gradually perturbed…

图像与视频处理 · 电气工程与系统科学 2023-06-06 Amirhossein Kazerouni , Ehsan Khodapanah Aghdam , Moein Heidari , Reza Azad , Mohsen Fayyaz , Ilker Hacihaliloglu , Dorit Merhof