中文
相关论文

相关论文: Analyzing and Improving the Training Dynamics of D…

200 篇论文

Maximum likelihood (ML) learning for energy-based models (EBMs) is challenging, partly due to non-convergence of Markov chain Monte Carlo.Several variations of ML learning have been proposed, but existing methods all fail to achieve both…

机器学习 · 统计学 2023-04-24 Xinwei Zhang , Zhiqiang Tan , Zhijian Ou

With the incorporation of the UNet architecture, diffusion probabilistic models have become a dominant force in image generation tasks. One key design in UNet is the skip connections between the encoder and decoder blocks. Although skip…

机器学习 · 计算机科学 2024-02-26 Jiajun Ma , Shuchen Xue , Tianyang Hu , Wenjia Wang , Zhaoqiang Liu , Zhenguo Li , Zhi-Ming Ma , Kenji Kawaguchi

Diffusion models have recently achieved remarkable success in generative modeling, yet their training dynamics across different noise levels remain highly imbalanced, which can lead to inefficient optimization and unstable learning…

机器学习 · 计算机科学 2026-03-12 Nanlong Sun , Lei Shi

It has been recognized that the data generated by the denoising diffusion probabilistic model (DDPM) improves adversarial training. After two years of rapid development in diffusion models, a question naturally arises: can better diffusion…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Zekai Wang , Tianyu Pang , Chao Du , Min Lin , Weiwei Liu , Shuicheng Yan

Detectors often suffer from performance drop due to domain gap between training and testing data. Recent methods explore diffusion models applied to domain generalization (DG) and adaptation (DA) tasks, but still struggle with large…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Boyong He , Yuxiang Ji , Zhuoyue Tan , Liaoni Wu

Synthetic samples from diffusion models are promising for leveraging in training discriminative models as replications of real training datasets. However, we found that the synthetic datasets degrade classification performance over real…

人工智能 · 计算机科学 2023-11-23 Shin'ya Yamaguchi , Takuma Fukuda

Neuron segmentation in electron microscopy (EM) aims to reconstruct the complete neuronal connectome; however, current deep learning-based methods are limited by their reliance on large-scale training data and extensive, time-consuming…

计算机视觉与模式识别 · 计算机科学 2026-01-23 Liuyun Jiang , Yanchao Zhang , Jinyue Guo , Yizhuo Lu , Ruining Zhou , Hua Han

Modern deep learning models in computer vision require large datasets of real images, which are difficult to curate and pose privacy and legal concerns, limiting their commercial use. Recent works suggest synthetic data as an alternative,…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Farnood Salehi , Vandit Sharma , Amirhossein Askari Farsangi , Tunç Ozan Aydın

Many approaches have been proposed to use diffusion models to augment training datasets for downstream tasks, such as classification. However, diffusion models are themselves trained on large datasets, often with noisy annotations, and it…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Max F. Burg , Florian Wenzel , Dominik Zietlow , Max Horn , Osama Makansi , Francesco Locatello , Chris Russell

Deep learning is widely applied in computer-aided pathological diagnosis, which alleviates the pathologist workload and provide timely clinical analysis. However, most models generally require large-scale annotated data for training, which…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Zeyu Liu , Tianyi Zhang , Yufang He , Yunlu Feng , Yu Zhao , Guanglei Zhang

Denoising diffusion models have been a mainstream approach for image generation, however, training these models often suffers from slow convergence. In this paper, we discovered that the slow convergence is partly due to conflicting…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Tiankai Hang , Shuyang Gu , Chen Li , Jianmin Bao , Dong Chen , Han Hu , Xin Geng , Baining Guo

Diffusion models demonstrate impressive image generation performance with text guidance. Inspired by the learning process of diffusion, existing images can be edited according to text by DDIM inversion. However, the vanilla DDIM inversion…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Qi Qian , Haiyang Xu , Ming Yan , Juhua Hu

Diffusion models have revolutionized generative tasks through high-fidelity outputs, yet flow matching (FM) offers faster inference and empirical performance gains. However, current foundation FM models are computationally prohibitive for…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Johannes Schusterbauer , Ming Gui , Frank Fundel , Björn Ommer

Diffusion models have attained remarkable success in the domains of image generation and editing. It is widely recognized that employing larger inversion and denoising steps in diffusion model leads to improved image reconstruction quality.…

计算机视觉与模式识别 · 计算机科学 2024-01-05 Chen Hou , Guoqiang Wei , Zhibo Chen

Diffusion models are a new class of generative models that have shown outstanding performance in image generation literature. As a consequence, studies have attempted to apply diffusion models to other tasks, such as speech enhancement. A…

音频与语音处理 · 电气工程与系统科学 2024-10-10 Philippe Gonzalez , Zheng-Hua Tan , Jan Østergaard , Jesper Jensen , Tommy Sonne Alstrøm , Tobias May

Due to network operation and maintenance relying heavily on network traffic monitoring, traffic matrix analysis has been one of the most crucial issues for network management related tasks. However, it is challenging to reliably obtain the…

网络与互联网体系结构 · 计算机科学 2024-12-02 Xinyu Yuan , Yan Qiao , Zhenchun Wei , Zeyu Zhang , Minyue Li , Pei Zhao , Rongyao Hu , Wenjing Li

Diffusion Models (DMs) have demonstrated state-of-the-art performance in content generation without requiring adversarial training. These models are trained using a two-step process. First, a forward - diffusion - process gradually adds…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Anwaar Ulhaq , Naveed Akhtar

Diffusion models generate samples by reversing a fixed forward diffusion process. Despite already providing impressive empirical results, these diffusion models algorithms can be further improved by reducing the variance of the training…

机器学习 · 计算机科学 2023-02-20 Yilun Xu , Shangyuan Tong , Tommi Jaakkola

Diffusion models have shown promising capabilities in trajectory generation for planning in offline reinforcement learning (RL). However, conventional diffusion-based planning methods often fail to account for the fact that generating…

人工智能 · 计算机科学 2026-02-25 Hanping Zhang , Yuhong Guo

In this work, we address the limitations of denoising diffusion models (DDMs) in image restoration tasks, particularly the shape and color distortions that can compromise image quality. While DDMs have demonstrated a promising performance…

计算机视觉与模式识别 · 计算机科学 2024-12-18 Xinlong Cheng , Tiantian Cao , Guoan Cheng , Bangxuan Huang , Xinghan Tian , Ye Wang , Xiaoyu He , Weixin Li , Tianfan Xue , Xuan Dong