English
Related papers

Related papers: Attention, May I Have Your Decision? Localizing Ge…

200 papers

Diffusion models have emerged as powerful tools for high-quality image generation and editing, but guiding these models to produce specific outputs remains a challenge. Conventional approaches rely on conditioning mechanisms, such as text…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Nithesh Chandher Karthikeyan , Jonas Unger , Gabriel Eilertsen

Generating multiple distinct subjects remains a challenge for existing text-to-image diffusion models. Complex prompts often lead to subject leakage, causing inaccuracies in quantities, attributes, and visual features. Preventing leakage…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Omer Dahary , Yehonathan Cohen , Or Patashnik , Kfir Aberman , Daniel Cohen-Or

Large Language Models (LLMs) achieve remarkable performance through pretraining on extensive data. This enables efficient adaptation to diverse downstream tasks. However, the lack of interpretability in their underlying mechanisms limits…

Computation and Language · Computer Science 2025-06-03 Xintong Wang , Jingheng Pan , Liang Ding , Longyue Wang , Longqin Jiang , Xingshan Li , Chris Biemann

Whereas diverse variations of diffusion models exist, extending the linear diffusion into a nonlinear diffusion process is investigated by very few works. The nonlinearity effect has been hardly understood, but intuitively, there would be…

Machine Learning · Computer Science 2022-10-14 Dongjun Kim , Byeonghu Na , Se Jung Kwon , Dongsoo Lee , Wanmo Kang , Il-Chul Moon

As the field of image generation rapidly advances, traditional diffusion models and those integrated with multimodal large language models (LLMs) still encounter limitations in interpreting complex prompts and preserving image consistency…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xinyu Zhang , Mengxue Kang , Fei Wei , Shuang Xu , Yuhe Liu , Lin Ma

Masked diffusion models (MDMs), which leverage bidirectional attention and a denoising process, are narrowing the performance gap with autoregressive models (ARMs). However, their internal attention mechanisms remain under-explored. This…

Machine Learning · Computer Science 2026-01-14 Xin Dai , Pengcheng Huang , Zhenghao Liu , Shuo Wang , Yukun Yan , Chaojun Xiao , Yu Gu , Ge Yu , Maosong Sun

Recently, text-to-image models based on diffusion have achieved remarkable success in generating high-quality images. However, the challenge of personalized, controllable generation of instances within these images remains an area in need…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Fan Deng , Yaguang Wu , Xinyang Yu , Xiangjun Huang , Jian Yang , Guangyu Yan , Qiang Xu

Accurate color alignment in text-to-image (T2I) generation is critical for applications such as fashion, product visualization, and interior design, yet current diffusion models struggle with nuanced and compound color terms (e.g., Tiffany…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Sung-Lin Tsai , Bo-Lun Huang , Yu Ting Shen , Cheng Yu Yeo , Chiang Tseng , Bo-Kai Ruan , Wen-Sheng Lien , Hong-Han Shuai

Computational imaging is crucial in many disciplines from autonomous driving to life sciences. However, traditional model-driven and iterative methods consume large computational power and lack scalability for imaging. Deep learning (DL) is…

Image and Video Processing · Electrical Eng. & Systems 2024-08-26 Weiru Fan , Xiaobin Tang , Yiyi Liao , Da-Wei Wang

Diffusion models (DMs) memorize training images and can reproduce near-duplicates during generation. Current detection methods identify verbatim memorization but fail to capture two critical aspects: quantifying partial memorization…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Jimmy Z. Di , Yiwei Lu , Yaoliang Yu , Gautam Kamath , Adam Dziedzic , Franziska Boenisch

Large Language Models (LLMs) exhibit strong implicit personalization ability, yet most existing approaches treat this behavior as a black box, relying on prompt engineering or fine tuning on user data. In this work, we adopt a mechanistic…

Computation and Language · Computer Science 2026-04-27 Weixu Zhang , Ye Yuan , Changjiang Han , Yuxing Tian , Zipeng Sun , Linfeng Du , Jikun Kang , Hong Kang , Xue Liu , Haolun Wu

Ensuring precise multimodal alignment between diffusion-generated images and input prompts has been a long-standing challenge. Earlier works finetune diffusion weight using high-quality preference data, which tends to be limited and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Jiayi Guo , Chuanhao Yan , Xingqian Xu , Yulin Wang , Kai Wang , Gao Huang , Humphrey Shi

Text-to-image (TTI) diffusion models have achieved remarkable visual quality, yet they have been repeatedly shown to exhibit social biases across sensitive attributes such as gender, race and age. To mitigate these biases, existing…

Machine Learning · Computer Science 2026-03-18 Manos Plitsis , Giorgos Bouritsas , Vassilis Katsouros , Yannis Panagakis

Selective inference aims at providing valid inference after a data-driven selection of models or hypotheses. It is essential to avoid overconfident results and replicability issues. While significant advances have been made in this area for…

Methodology · Statistics 2025-03-14 Matteo D'Alessandro , Magne Thoresen

A single text prompt passed to a diffusion model often yields a wide range of visual outputs determined solely by stochastic process, leaving users with no direct control over which specific semantic variations appear in the image. While…

Machine Learning · Computer Science 2026-02-12 Paweł Skierś , Tomasz Trzciński , Kamil Deja

The text-to-image synthesis by diffusion models has recently shown remarkable performance in generating high-quality images. Although performs well for simple texts, the models may get confused when faced with complex texts that contain…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Chang Yu , Junran Peng , Xiangyu Zhu , Zhaoxiang Zhang , Qi Tian , Zhen Lei

Text-to-image (T2I) generation has greatly enhanced creative expression, yet achieving preference-aligned generation in a real-time and training-free manner remains challenging. Previous methods often rely on static, pre-collected…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Yang Li , Songlin Yang , Xiaoxuan Han , Wei Wang , Jing Dong , Yueming Lyu , Ziyu Xue

Diffusion models (DMs) can generate realistic images with text guidance using large-scale datasets. However, they demonstrate limited controllability in the output space of the generated images. We propose a novel learning method for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Rumeysa Bodur , Erhan Gundogdu , Binod Bhattarai , Tae-Kyun Kim , Michael Donoser , Loris Bazzani

Autonomous driving technology has seen significant advancements, but existing models often fail to fully capture the complexity of multi-agent environments, where interactions between dynamic agents are critical. To address this, we propose…

Artificial Intelligence · Computer Science 2024-11-05 Liu Yunhao , Ding Hong , Zhang Ziming , Wang Huixin , Liu Jinzhao , Xi Suyang

Diffusion models have significantly improved text-to-image generation, producing high-quality, realistic images from textual descriptions. Beyond generation, object-level image editing remains a challenging problem, requiring precise…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Marco Schouten , Mehmet Onurcan Kaya , Serge Belongie , Dim P. Papadopoulos