English
Related papers

Related papers: Not all tokens contribute equally to diffusion lea…

200 papers

Diffusion models have shown remarkable abilities in generating realistic and high-quality images from text prompts. However, a trained model remains largely black-box; little do we know about the roles of its components in exhibiting a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Quang H. Nguyen , Hoang Phan , Khoa D. Doan

Diffusion models have emerged as a promising approach for generating high-quality, high-dimensional images. Nevertheless, these models are hindered by their high computational cost and slow inference, partly due to the quadratic…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Omid Saghatchian , Atiyeh Gh. Moghadam , Ahmad Nickabadi

Dynamic Facial Expression Recognition (DFER) plays a critical role in affective computing and human-computer interaction. Although existing methods achieve comparable performance, they inevitably suffer from performance degradation under…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Feng-Qi Cui , Anyang Tong , Jinyang Huang , Jie Zhang , Dan Guo , Zhi Liu , Meng Wang

Diffusion models have shown promise in text generation, but often struggle with generating long, coherent, and contextually accurate text. Token-level diffusion doesn't model word-order dependencies explicitly and operates on short, fixed…

Computation and Language · Computer Science 2025-05-27 Xiaochen Zhu , Georgi Karadzhov , Chenxi Whitehouse , Andreas Vlachos

This paper presents Diffusion Forcing, a new training paradigm where a diffusion model is trained to denoise a set of tokens with independent per-token noise levels. We apply Diffusion Forcing to sequence generative modeling by training a…

Machine Learning · Computer Science 2024-12-11 Boyuan Chen , Diego Marti Monso , Yilun Du , Max Simchowitz , Russ Tedrake , Vincent Sitzmann

Unmanned Aerial Vehicles (UAVs) are increasingly adopted in modern communication networks. However, challenges in decision-making and digital modeling continue to impede their rapid advancement. Reinforcement Learning (RL) algorithms face…

Machine Learning · Computer Science 2025-01-13 Yousef Emami , Hao Zhou , Luis Almeida , Kai Li

Graph Domain Adaptation (GDA) aims to bridge distribution shifts between domains by transferring knowledge from well-labeled source graphs to given unlabeled target graphs. One promising recent approach addresses graph transfer by…

Machine Learning · Computer Science 2026-02-12 Wei Chen , Xingyu Guo , Shuang Li , Yan Zhong , Zhao Zhang , Fuzhen Zhuang , Hongrui Liu , Libang Zhang , Guo Ye , Huimei He

Current open-source diffusion models struggle to generate stable and synchronized audio-visual content, particularly in scenarios demanding complex semantic reasoning. The root cause is that existing methods rely on coarse text embeddings…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Shuyuan Tu , Qi Tian , Zihan Yang , Yue Wu , Xintong Han , Weijie Kong , Jiangfeng Xiong , Jian-Wei Zhang , Zhao Zhong , Liefeng Bo , Zuxuan Wu , Yu-Gang Jiang

Diffusion transformers (DiTs) have emerged as a dominant architecture for text-to-image generation, yet their performance drops when generating at resolutions beyond their training range. Existing training-free approaches mitigate this by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Javad Rajabi , Kimia Shaban , Koorosh Roohi , David B. Lindell , Babak Taati

This research focuses on the development and enhancement of text-to-image denoising diffusion models, addressing key challenges such as limited sample diversity and training instability. By incorporating Classifier-Free Guidance (CFG) and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Rajdeep Roshan Sahu

Predicting drug-target affinity is fundamental to virtual screening and lead optimization. However, existing deep models often suffer from representation collapse in stringent cold-start regimes, where the scarcity of labels and domain…

Machine Learning · Statistics 2026-03-13 Yining Qian , Pengjie Wang , Yixiao Li , An-Yang Lu , Cheng Tan , Shuang Li , Lijun Liu

Negation is a fundamental linguistic operator, yet it remains inadequately modeled in diffusion-based generative systems. In this work, we present a formal treatment of linguistic negation in diffusion-based generative models by modeling it…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Taewon Kang , Ming C. Lin

Knowledge distillation is often used to transfer knowledge from a strong teacher model to a relatively weak student model. Traditional methods include response-based methods and feature-based methods. Response-based methods are widely used…

Information Retrieval · Computer Science 2023-12-12 Hao Sun , Xiao Liu , Yeyun Gong , Anlei Dong , Jingwen Lu , Yan Zhang , Linjun Yang , Rangan Majumder , Nan Duan

Real-world image super-resolution is particularly challenging for diffusion models because real degradations are complex, heterogeneous, and rarely modeled explicitly. We propose a degradation-aware and structure-preserving diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yang Ji , Zonghao Chen , Zhihao Xue , Junqin Hu

Text-to-image diffusion models generate highly detailed textures, yet they often rely on surface appearance and fail to follow strict geometric constraints, particularly when those constraints conflict with the style implied by the text…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Antara Titikhsha , Om Kulkarni , Dharun Muthaiah

Tokenizers are a crucial component of latent diffusion models, as they define the latent space in which diffusion models operate. However, existing tokenizers are primarily designed to improve reconstruction fidelity or inherit pretrained…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Zhengrong Yue , Taihang Hu , Mengting Chen , Haiyu Zhang , Zihao Pan , Tao Liu , Zikang Wang , Jinsong Lan , Xiaoyong Zhu , Bo Zheng , Yali Wang

Single-source domain generalization (SDG) for object detection is a challenging yet essential task as the distribution bias of the unseen domain degrades the algorithm performance significantly. However, existing methods attempt to extract…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Yajing Liu , Shijun Zhou , Xiyao Liu , Chunhui Hao , Baojie Fan , Jiandong Tian

Generative models such as Generative Adversarial Networks (GANs) and Variational Auto-Encoders (VAEs) are widely utilized to model the generative process of user interactions. However, these generative models suffer from intrinsic…

Information Retrieval · Computer Science 2025-06-26 Wenjie Wang , Yiyan Xu , Fuli Feng , Xinyu Lin , Xiangnan He , Tat-Seng Chua

Classifier-Free Guidance (CFG) is widely used to improve conditional fidelity in diffusion models, but its impact on sampling dynamics remains poorly understood. Prior studies, often restricted to unimodal conditional distributions or…

Machine Learning · Computer Science 2026-02-19 Cheng Jin , Qitan Shi , Yuantao Gu

Diffusion models have achieved remarkable progress in image and audio generation, largely due to Classifier-Free Guidance. However, the choice of guidance scale remains underexplored: a fixed scale often fails to generalize across prompts…

Sound · Computer Science 2025-10-07 Xuanhao Zhang , Chang Li