中文
相关论文

相关论文: OFA-Diffusion Compression: Compressing Diffusion M…

200 篇论文

Diffusion models are increasingly used as powerful conditional generators, yet real deployments often involve multiple target distributions arising from different tasks, e.g., diverse prompt domains in text-to-image generation, or multiple…

机器学习 · 计算机科学 2026-05-26 Ziheng Cheng , Yixiao Huang , Hanlin Zhu , Haoran Geng , Somayeh Sojoudi , Jitendra Malik , Pieter Abbeel , Xin Guo

The ever-increasing parameter counts of deep learning models necessitate effective compression techniques for deployment on resource-constrained devices. This paper explores the application of information geometry, the study of…

机器学习 · 计算机科学 2025-07-15 Zakhar Shumaylov , Vasileios Tsiaras , Yannis Stylianou

Large Language Models (LLMs) have demonstrated remarkable performance in real-world applications. However, adapting LLMs to novel tasks via fine-tuning often requires substantial training data and computational resources that are…

机器学习 · 计算机科学 2025-05-27 Boyan Gao , Xin Wang , Yibo Yang , David Clifton

Diffusion models excel in generating images that closely resemble their training data but are also susceptible to data memorization, raising privacy, ethical, and legal concerns, particularly in sensitive domains such as medical imaging. We…

计算机视觉与模式识别 · 计算机科学 2025-02-12 Raman Dutt , Ondrej Bohdal , Pedro Sanchez , Sotirios A. Tsaftaris , Timothy Hospedales

Diffusion models, which learn to reverse a signal destruction process to generate new data, typically require the signal at each step to have the same dimension. We argue that, considering the spatial redundancy in image signals, there is…

机器学习 · 计算机科学 2022-11-30 Han Zhang , Ruili Feng , Zhantao Yang , Lianghua Huang , Yu Liu , Yifei Zhang , Yujun Shen , Deli Zhao , Jingren Zhou , Fan Cheng

Diffusion models have been widely employed in the field of 3D manipulation due to their efficient capability to learn distributions, allowing for precise prediction of action trajectories. However, diffusion models typically rely on large…

Diffusion models have shown remarkable performance on many generative tasks. Despite recent success, most diffusion models are restricted in that they only allow linear transformation of the data distribution. In contrast, broader family of…

机器学习 · 计算机科学 2024-06-04 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

It has been recognized that the data generated by the denoising diffusion probabilistic model (DDPM) improves adversarial training. After two years of rapid development in diffusion models, a question naturally arises: can better diffusion…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Zekai Wang , Tianyu Pang , Chao Du , Min Lin , Weiwei Liu , Shuicheng Yan

Score-based diffusion models, which generate new data by learning to reverse a diffusion process that perturbs data from the target distribution into noise, have achieved remarkable success across various generative tasks. Despite their…

机器学习 · 计算机科学 2025-01-23 Gen Li , Yuling Yan

The potential of applying diffusion models (DMs) for multiple antenna communications is discussed. A unified framework of applying DM for multiple antenna tasks is first proposed. Then, the tasks are innovatively divided into two…

信号处理 · 电气工程与系统科学 2025-02-05 Jia Guo , Xiaoxia Xu , Yuanwei Liu , Arumugam Nallanathan

Diffusion probabilistic models have achieved mainstream success in many generative modeling tasks, from image generation to inverse problem solving. A distinct feature of these models is that they correspond to deep hierarchical latent…

机器学习 · 计算机科学 2024-12-30 Yibo Yang , Justus C. Will , Stephan Mandt

Diffusion Probabilistic Models (DPMs) have emerged as the de facto approach for high-fidelity image synthesis, operating diffusion processes on continuous VAE latent, which significantly differ from the text generation methods employed by…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Xiaoping Wu , Jie Hu , Xiaoming Wei

Diffusion models have recently demonstrated notable success in solving inverse problems. However, current diffusion model-based solutions typically require a large number of function evaluations (NFEs) to generate high-quality images…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Tianyu Chen , Zhendong Wang , Mingyuan Zhou

Large language models (LLMs) are fine-tuned using human comparison data with Reinforcement Learning from Human Feedback (RLHF) methods to make them better aligned with users' preferences. In contrast to LLMs, human preference learning has…

计算机视觉与模式识别 · 计算机科学 2023-11-23 Bram Wallace , Meihua Dang , Rafael Rafailov , Linqi Zhou , Aaron Lou , Senthil Purushwalkam , Stefano Ermon , Caiming Xiong , Shafiq Joty , Nikhil Naik

In recent years, the development of diffusion models has led to significant progress in image and video generation tasks, with pre-trained models like the Stable Diffusion series playing a crucial role. Inspired by model pruning which…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Teng Hu , Jiangning Zhang , Ran Yi , Hongrui Huang , Yabiao Wang , Lizhuang Ma

Denoising Diffusion Probabilistic Models (DDPM) have recently gained significant attention. DDPMs compose a Markovian process that begins in the data domain and gradually adds noise until reaching pure white noise. DDPMs generate…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Shady Abu-Hussein , Raja Giryes

Pre-trained diffusion models have demonstrated remarkable proficiency in synthesizing images across a wide range of scenarios with customizable prompts, indicating their effective capacity to capture universal features. Motivated by this,…

计算机视觉与模式识别 · 计算机科学 2024-11-22 Yuxiang Ji , Boyong He , Chenyuan Qu , Zhuoyue Tan , Chuan Qin , Liaoni Wu

Existing customization methods require access to multiple reference examples to align pre-trained diffusion probabilistic models (DPMs) with user-provided concepts. This paper aims to address the challenge of DPM customization when the only…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Jiachun Pan , Jun Hao Liew , Vincent Y. F. Tan , Jiashi Feng , Hanshu Yan

In recent years, the field of image generation has witnessed significant advancements, particularly in fine-tuning methods that align models with universal human preferences. This paper explores the critical role of preference data in the…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Lingfan Zhang , Chen Liu , Chengming Xu , Kai Hu , Donghao Luo , Chengjie Wang , Yanwei Fu , Yuan Yao

Predicting stress fields in hyperelastic materials with complex microstructures remains challenging for traditional deep learning surrogates, which struggle to capture both sharp stress concentrations and the wide dynamic range of stress…

机器学习 · 统计学 2026-03-20 Purna Vindhya Kota , Meer Mehran Rashid , Somdatta Goswami , Lori Graham-Brady