English
Related papers

Related papers: Not all tokens contribute equally to diffusion lea…

200 papers

Training-free diffusion models have achieved remarkable progress in generating multi-subject consistent images within open-domain scenarios. The key idea of these methods is to incorporate reference subject information within the attention…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Huiguo He , Qiuyue Wang , Yuan Zhou , Yuxuan Cai , Hongyang Chao , Jian Yin , Huan Yang

Generative pre-training via discrete diffusion provides dense reconstruction supervision across all feature fields simultaneously, mitigating representation collapse from data sparsity in CTR prediction. However, all existing generative CTR…

Information Retrieval · Computer Science 2026-05-26 Moyu Zhang , Yun Chen , Yujun Jin , Jinxin Hu , Yu Zhang , Xiaoyi Zeng

Along with the successful deployment of deep neural networks in several application domains, the need to unravel the black-box nature of these networks has seen a significant increase recently. Several methods have been introduced to…

Machine Learning · Computer Science 2023-07-06 Adam Ivankay , Mattia Rigotti , Pascal Frossard

Recent endeavors in Multimodal Large Language Models (MLLMs) aim to unify visual comprehension and generation by combining LLM and diffusion models, the state-of-the-art in each task, respectively. Existing approaches rely on spatial visual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Kaihang Pan , Wang Lin , Zhongqi Yue , Tenglong Ao , Liyu Jia , Wei Zhao , Juncheng Li , Siliang Tang , Hanwang Zhang

While diffusion language models (DLMs) enable fine-grained refinement, their practical controllability remains fragile. We identify and formally characterize a central failure mode called update forgetting, in which uniform and context…

Computation and Language · Computer Science 2025-10-31 Woojin Kim , Jaeyoung Do

Text-to-image diffusion models achieve impressive generation quality but inherit and amplify training-data biases, skewing coverage of semantic attributes. Prior work addresses this in two ways. Closed-set approaches mitigate biases in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Silpa Vadakkeeveetil Sreelatha , Dan Wang , Serge Belongie , Muhammad Awais , Anjan Dutta

We present a supervised learning framework of training generative models for density estimation. Generative models, including generative adversarial networks, normalizing flows, variational auto-encoders, are usually considered as…

Machine Learning · Computer Science 2023-10-24 Yanfang Liu , Minglei Yang , Zezhong Zhang , Feng Bao , Yanzhao Cao , Guannan Zhang

The present work proposes a Deep Learning architecture for the prediction of various consumer choice behaviors from time series of raw gaze or eye fixations on images of the decision environment, for which currently no foundational models…

Neural and Evolutionary Computing · Computer Science 2025-08-07 Moshe Unger , Alexander Tuzhilin , Michel Wedel

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access broader knowledge sources, yet factual inconsistencies persist due to noise in retrieved documents-even with advanced retrieval methods. We demonstrate that…

Computation and Language · Computer Science 2025-06-04 Yongjian Li , HaoCheng Chu , Yukun Yan , Zhenghao Liu , Shi Yu , Zheni Zeng , Ruobing Wang , Sen Song , Zhiyuan Liu , Maosong Sun

Centred on content modification and style preservation, Scene Text Editing (STE) remains a challenging task despite considerable progress in text-to-image synthesis and text-driven image manipulation recently. GAN-based STE methods…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Weichao Zeng , Yan Shu , Zhenhang Li , Dongbao Yang , Yu Zhou

Detection transformers like DETR have recently shown promising performance on many object detection tasks, but the generalization ability of those methods is still quite challenging for cross-domain adaptation scenarios. To address the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Jinhong Deng , Xiaoyue Zhang , Wen Li , Lixin Duan

The conditional text-to-image diffusion models have garnered significant attention in recent years. However, the precision of these models is often compromised mainly for two reasons, ambiguous condition input and inadequate condition…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Sicheng Li , Keqiang Sun , Zhixin Lai , Xiaoshi Wu , Feng Qiu , Haoran Xie , Kazunori Miyata , Hongsheng Li

Disentangled representation learning strives to extract the intrinsic factors within observed data. Factorizing these representations in an unsupervised manner is notably challenging and usually requires tailored loss functions or specific…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Tao Yang , Cuiling Lan , Yan Lu , Nanning zheng

Although existing cross-domain continual learning approaches successfully address many streaming tasks having domain shifts, they call for a fully labeled source domain hindering their feasibility in the privacy constrained environments.…

Classifier-free guidance (CFG) has emerged as a pivotal advancement in text-to-image latent diffusion models, establishing itself as a cornerstone technique for achieving high-quality image synthesis. However, under high guidance weights,…

Machine Learning · Computer Science 2025-06-26 Cheng Jin , Zhenyu Xiao , Chutao Liu , Yuantao Gu

Discrete diffusion models have recently become competitive with autoregressive models for language modeling, even outperforming them on reasoning tasks requiring planning and global coherence, but they require more computation at inference…

Machine Learning · Computer Science 2026-02-04 Andre He , Sean Welleck , Daniel Fried

Generative recommendation is emerging as a powerful paradigm that directly generates item predictions, moving beyond traditional matching-based approaches. However, current methods face two key challenges: token-item misalignment, where…

Information Retrieval · Computer Science 2025-06-24 Chang Liu , Yimeng Bai , Xiaoyan Zhao , Yang Zhang , Fuli Feng , Wenge Rong

Can we modify the training data distribution to encourage the underlying optimization method toward finding solutions with superior generalization performance on in-distribution data? In this work, we approach this question for the first…

Machine Learning · Computer Science 2026-03-03 Dang Nguyen , Paymon Haddad , Eric Gan , Baharan Mirzasoleiman

This paper proposes a Disentangled gEnerative cAusal Representation (DEAR) learning method under appropriate supervised information. Unlike existing disentanglement methods that enforce independence of the latent variables, we consider the…

Machine Learning · Computer Science 2022-10-04 Xinwei Shen , Furui Liu , Hanze Dong , Qing Lian , Zhitang Chen , Tong Zhang

Diffusion Transformers (DiT) have become a leading architecture in image generation. However, the quadratic complexity of attention mechanisms, which are responsible for modeling token-wise relationships, results in significant latency when…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Songhua Liu , Zhenxiong Tan , Xinchao Wang