中文
相关论文

相关论文: Adapting Diffusion Models for Improved Prompt Comp…

200 篇论文

Large generative diffusion models have revolutionized text-to-image generation and offer immense potential for conditional generation tasks such as image enhancement, restoration, editing, and compositing. However, their widespread adoption…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Kangfu Mei , Mauricio Delbracio , Hossein Talebi , Zhengzhong Tu , Vishal M. Patel , Peyman Milanfar

Diffusion models has underpinned much recent advances of dataset augmentation in various computer vision tasks. However, when involving generating multi-object images as real scenarios, most existing methods either rely entirely on text…

计算机视觉与模式识别 · 计算机科学 2025-07-09 Haoyu Wang , Lei Zhang , Wei Wei , Chen Ding , Yanning Zhang

Text-to-image generation via Stable Diffusion models (SDM) have demonstrated remarkable capabilities. However, their computational intensity, particularly in the iterative denoising process, hinders real-time deployment in latency-sensitive…

计算机视觉与模式识别 · 计算机科学 2025-05-08 Shuaiting Li , Juncan Deng , Zeyu Wang , Kedong Xu , Rongtao Deng , Hong Gu , Haibin Shen , Kejie Huang

Flow matching casts sample generation as learning a continuous-time velocity field that transports noise to data. Existing flow matching networks typically predict each point's velocity independently, considering only its location and time…

机器学习 · 计算机科学 2025-11-11 Md Shahriar Rahim Siddiqui , Moshe Eliasof , Eldad Haber

Diffusion models when conditioned on text prompts, generate realistic-looking images with intricate details. But most of these pre-trained models fail to generate accurate images when it comes to human features like hands, teeth, etc. We…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Gurusha Juneja , Sukrit Kumar

Diffusion Models (DMs) have achieved great success in image generation and other fields. By fine sampling through the trajectory defined by the SDE/ODE solver based on a well-trained score model, DMs can generate remarkable high-quality…

计算机视觉与模式识别 · 计算机科学 2024-06-10 Bowen Zheng , Tianming Yang

Domain Generalization techniques aim to enhance model robustness by simulating novel data distributions during training, typically through various augmentation or stylization strategies. However, these methods frequently suffer from limited…

Diffusion models are widely used for generative tasks across domains. Given a pre-trained diffusion model, it is often desirable to fine-tune it further either to correct for errors in learning or to align with downstream applications.…

Recently, diffusion models have demonstrated impressive capabilities in text-guided and image-conditioned image generation. However, existing diffusion models cannot simultaneously generate an image and a panoptic segmentation of objects…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Yinghan Long , Kaushik Roy

Diffusion models (DMs) represent state-of-the-art generative models for continuous inputs. DMs work by constructing a Stochastic Differential Equation (SDE) in the input space (ie, position space), and using a neural network to reverse it.…

机器学习 · 计算机科学 2024-05-14 Tianrong Chen , Jiatao Gu , Laurent Dinh , Evangelos A. Theodorou , Joshua Susskind , Shuangfei Zhai

Diffusion models have achieved impressive results in generating high-quality images. Yet, they often struggle to faithfully align the generated images with the input prompts. This limitation is associated with synchronous denoising, where…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Zijing Hu , Yunze Tong , Fengda Zhang , Junkun Yuan , Jun Xiao , Kun Kuang

Diffusion models has emerged as a powerful framework for tasks like image controllable generation and dense prediction. However, existing models often struggle to capture underlying semantics (e.g., edges, textures, shapes) and effectively…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Zhong Ji , Weilong Cao , Yan Zhang , Yanwei Pang , Jungong Han , Xuelong Li

Diffusion and flow matching models have achieved remarkable success in text-to-image generation. However, these models typically rely on the predetermined denoising schedules for all prompts. The multi-step reverse diffusion process can be…

计算机视觉与模式识别 · 计算机科学 2025-03-06 Zilyu Ye , Zhiyang Chen , Tiancheng Li , Zemin Huang , Weijian Luo , Guo-Jun Qi

Diffusion models have enabled the generation of high-quality images with a strong focus on realism and textual fidelity. Yet, large-scale text-to-image models, such as Stable Diffusion, struggle to generate images where foreground objects…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Ryugo Morita , Stanislav Frolov , Brian Bernhard Moser , Takahiro Shirakawa , Ko Watanabe , Andreas Dengel , Jinjia Zhou

Diffusion models have recently exhibited remarkable abilities to synthesize striking image samples since the introduction of denoising diffusion probabilistic models (DDPMs). Their key idea is to disrupt images into noise through a fixed…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Zijian Zhang , Zhou Zhao , Jun Yu , Qi Tian

Recent advances in generative modeling -- particularly diffusion models and flow matching -- have achieved remarkable success in synthesizing discrete data such as images and videos. However, adapting these models to physical applications…

机器学习 · 计算机科学 2025-11-26 Sifan Wang , Zehao Dou , Siming Shan , Tong-Rui Liu , Lu Lu

Recent work showed that large diffusion models can be reused as highly precise monocular depth estimators by casting depth estimation as an image-conditional image generation task. While the proposed model achieved state-of-the-art results,…

计算机视觉与模式识别 · 计算机科学 2026-01-23 Gonzalo Martin Garcia , Karim Knaebel , Christian Schmidt , Daan de Geus , Alexander Hermans , Bastian Leibe

Diffusion models (DMs) are capable of generating remarkably high-quality samples by iteratively denoising a random vector, a process that corresponds to moving along the probability flow ordinary differential equation (PF ODE).…

机器学习 · 计算机科学 2025-03-04 Liangchen Li , Jiajun He

Diffusion models are a new class of generative models, and have dramatically promoted image generation with unprecedented quality and diversity. Existing diffusion models mainly try to reconstruct input image from a corrupted one with a…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Ling Yang , Jingwei Liu , Shenda Hong , Zhilong Zhang , Zhilin Huang , Zheming Cai , Wentao Zhang , Bin Cui

While generative modeling has achieved remarkable success on tasks like natural language-conditioned image generation, enabling model adaptation from example data points remains a relatively underexplored and challenging problem. To this…

机器学习 · 计算机科学 2026-05-08 Tyler Ingebrand , Ruihan Zhao , Kushagra Gupta , David Fridovich-Keil , Sandeep P. Chinchali , Ufuk Topcu