中文
相关论文

相关论文: Dynamic Classifier-Free Diffusion Guidance via Onl…

200 篇论文

Conditional diffusion models have exhibited superior performance in high-fidelity text-guided visual generation and editing. Nevertheless, prevailing text-guided visual diffusion models primarily focus on incorporating text-visual…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Ling Yang , Zhilong Zhang , Zhaochen Yu , Jingwei Liu , Minkai Xu , Stefano Ermon , Bin Cui

Diffusion models typically employ static or heuristic classifier-free guidance (CFG) schedules, which often fail to adapt across timesteps and noise conditions. In this work, we introduce a quantum reinforcement learning (QRL) controller…

量子物理 · 物理学 2025-09-18 Chi-Sheng Chen , En-Jui Kuo

The diffusion model is widely leveraged for either video generation or video editing. As each field has its task-specific problems, it is difficult to merely develop a single diffusion for completing both tasks simultaneously. Video…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Haoyu Zhao , Tianyi Lu , Jiaxi Gu , Xing Zhang , Qingping Zheng , Zuxuan Wu , Hang Xu , Yu-Gang Jiang

Recent advances in diffusion-based generative models have shown incredible promise for zero shot image-to-image translation and editing. Most of these approaches work by combining or replacing network-specific features used in the…

计算机视觉与模式识别 · 计算机科学 2025-10-06 Zeqi Gu , Ethan Yang , Abe Davis

Fine-tuning text-to-image diffusion models with human feedback is an effective method for aligning model behavior with human intentions. However, this alignment process often suffers from slow convergence due to the large size and noise…

机器学习 · 计算机科学 2025-04-03 Yongjin Yang , Sihyeon Kim , Hojung Jung , Sangmin Bae , SangMook Kim , Se-Young Yun , Kimin Lee

Although autoregressive models have dominated language modeling in recent years, there has been a growing interest in exploring alternative paradigms to the conventional next-token prediction framework. Diffusion-based language models have…

计算与语言 · 计算机科学 2025-10-23 Chihan Huang , Hao Tang

Human preference alignment presents a critical yet underexplored challenge for diffusion models in text-to-3D generation. Existing solutions typically require task-specific fine-tuning, posing significant hurdles in data-scarce 3D domains.…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Jiaqi Leng , Shuyuan Tu , Haidong Cao , Sicheng Xie , Daoguo Dong , Zuxuan Wu , Yu-Gang Jiang

In an era where visual content generation is increasingly driven by machine learning, the integration of human feedback into generative models presents significant opportunities for enhancing user experience and output quality. This study…

计算机视觉与模式识别 · 计算机科学 2023-07-20 Dimitri von Rütte , Elisabetta Fedele , Jonathan Thomm , Lukas Wolf

Diffusion-based text-to-image generation models trained on extensive text-image pairs have demonstrated the ability to produce photorealistic images aligned with textual descriptions. However, a significant limitation of these models is…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Mingyuan Zhou , Zhendong Wang , Huangjie Zheng , Hai Huang

Training-free guidance enables controlled generation in diffusion and flow models, but most methods rely on gradients and assume differentiable objectives. This work focuses on training-free guidance addressing challenges from…

机器学习 · 计算机科学 2025-06-12 Yingqing Guo , Yukang Yang , Hui Yuan , Mengdi Wang

Customizing diffusion models to generate identity-preserving images from user-provided reference images is an intriguing new problem. The prevalent approaches typically require training on extensive domain-specific images to achieve…

计算机视觉与模式识别 · 计算机科学 2024-12-11 Zhicheng Sun , Zhenhao Yang , Yang Jin , Haozhe Chi , Kun Xu , Kun Xu , Liwei Chen , Hao Jiang , Yang Song , Kun Gai , Yadong Mu

Online reinforcement learning (RL) has been central to post-training language models, but its extension to diffusion models remains challenging due to intractable likelihoods. Recent works discretize the reverse sampling process to enable…

机器学习 · 计算机科学 2026-02-17 Kaiwen Zheng , Huayu Chen , Haotian Ye , Haoxiang Wang , Qinsheng Zhang , Kai Jiang , Hang Su , Stefano Ermon , Jun Zhu , Ming-Yu Liu

This paper reports on the development of \textbf{a novel style guided diffusion model (SGDiff)} which overcomes certain weaknesses inherent in existing models for image synthesis. The proposed SGDiff combines image modality with a…

计算机视觉与模式识别 · 计算机科学 2023-08-16 Zhengwentai Sun , Yanghong Zhou , Honghong He , P. Y. Mok

Users often possess a clear visual intent but struggle to articulate it precisely in language. This intention-expression gap makes aligning generated images with latent visual preferences a fundamental challenge in text-to-image diffusion…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Wenxi Wang , Hongbin Liu , Mingqian Li , Junyan Yuan , Junqi Zhang

Diffusion models have demonstrated strong generative performance when using guidance methods such as classifier-free guidance (CFG), which enhance output quality by modifying the sampling trajectory. These methods typically improve a target…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Kwanyoung Kim

Diffusion-based image editing is a composite process of preserving the source image content and generating new content or applying modifications. While current editing approaches have made improvements under text guidance, most of them have…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Tianrui Huang , Pu Cao , Lu Yang , Chun Liu , Mengjie Hu , Zhiwei Liu , Qing Song

Diffusion models, emerging as powerful deep generative tools, excel in various applications. They operate through a two-steps process: introducing noise into training samples and then employing a model to convert random noise into new…

计算机视觉与模式识别 · 计算机科学 2026-02-13 Huijie Zhang , Yifu Lu , Ismail Alkhouri , Saiprasad Ravishankar , Dogyoon Song , Qing Qu

The Stable Diffusion model is a prominent text-to-image generation model that relies on a text prompt as its input, which is encoded using the Contrastive Language-Image Pre-Training (CLIP). However, text prompts have limitations when it…

计算机视觉与模式识别 · 计算机科学 2024-02-16 Yuxuan Ding , Chunna Tian , Haoxuan Ding , Lingqiao Liu

Recent studies have demonstrated that diffusion models are capable of generating high-quality samples, but their quality heavily depends on sampling guidance techniques, such as classifier guidance (CG) and classifier-free guidance (CFG).…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Donghoon Ahn , Hyoungwon Cho , Jaewon Min , Wooseok Jang , Jungwoo Kim , SeonHwa Kim , Hyun Hee Park , Kyong Hwan Jin , Seungryong Kim

Diffusion models are powerful, but they require a lot of time and data to train. We propose Patch Diffusion, a generic patch-wise training framework, to significantly reduce the training time costs while improving data efficiency, which…

计算机视觉与模式识别 · 计算机科学 2023-10-20 Zhendong Wang , Yifan Jiang , Huangjie Zheng , Peihao Wang , Pengcheng He , Zhangyang Wang , Weizhu Chen , Mingyuan Zhou