English
Related papers

Related papers: Object-Conditioned Energy-Based Attention Map Alig…

200 papers

Despite recent significant strides achieved by diffusion-based Text-to-Image (T2I) models, current systems are still less capable of ensuring decent compositional generation aligned with text prompts, particularly for the multi-object…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Zhipeng Bao , Yijun Li , Krishna Kumar Singh , Yu-Xiong Wang , Martial Hebert

Diffusion models have achieved remarkable results in generating high-quality, diverse, and creative images. However, when it comes to text-based image generation, they often fail to capture the intended meaning presented in the text. For…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Kota Sueyoshi , Takashi Matsubara

State-of-the-art text-to-image diffusion models can produce impressive visuals but may memorize and reproduce training images, creating copyright and privacy risks. Existing prompt perturbations applied at inference time, such as random…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yunzhuo Chen , Jordan Vice , Naveed Akhtar , Nur Al Hasan Haldar , Ajmal Mian

The modern text-to-image diffusion models boom has opened a new era in digital content production as it has proven the previously unseen ability to produce photorealistic and stylistically diverse imagery based on the semantics of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Syeda Anshrah Gillani , Mirza Samad Ahmed Baig , Osama Ahmed Khan , Shahid Munir Shah , Umema Mujeeb , Maheen Ali

Recent advancements in text-to-image diffusion models have demonstrated their remarkable capability to generate high-quality images from textual prompts. However, increasing research indicates that these models memorize and replicate images…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jie Ren , Yaxin Li , Shenglai Zeng , Han Xu , Lingjuan Lyu , Yue Xing , Jiliang Tang

Text-to-image diffusion models, such as Stable Diffusion and DALL-E, are capable of generating high-quality, diverse, and realistic images from textual prompts. However, they sometimes struggle to accurately depict specific entities…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Arash Marioriyad , Mohammadali Banayeeanzade , Reza Abbasi , Mohammad Hossein Rohban , Mahdieh Soleymani Baghshah

Images produced by text-to-image diffusion models might not always faithfully represent the semantic intent of the provided text prompt, where the model might overlook or entirely fail to produce certain objects. Existing solutions often…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Tuna Han Salih Meral , Enis Simsar , Federico Tombari , Pinar Yanardag

Existing EEG-driven image reconstruction methods often overlook spatial attention mechanisms, limiting fidelity and semantic coherence. To address this, we propose a dual-conditioning framework that combines EEG embeddings with spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Igor Abramov , Ilya Makarov

Recent advances in image editing have shifted from manual pixel manipulation to employing deep learning methods like stable diffusion models, which now leverage cross-attention mechanisms for text-driven control. This transition has…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Linn Bieske , Carla Lorente

Diffusion-based text-to-image models have rapidly gained popularity for their ability to generate detailed and realistic images from textual descriptions. However, these models often reflect the biases present in their training data,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Hidir Yesiltepe , Kiymet Akdemir , Pinar Yanardag

Personalized text-to-image generation methods can generate customized images based on the reference images, which have garnered wide research interest. Recent methods propose a finetuning-free approach with a decoupled cross-attention…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Qihan Huang , Siming Fu , Jinlong Liu , Hao Jiang , Yipeng Yu , Jie Song

Recent advancements in image generation have enabled the creation of high-quality images from text conditions. However, when facing multi-modal conditions, such as text combined with reference appearances, existing methods struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Yucheng Han , Rui Wang , Chi Zhang , Juntao Hu , Pei Cheng , Bin Fu , Hanwang Zhang

A significant research effort is focused on exploiting the amazing capacities of pretrained diffusion models for the editing of images.They either finetune the model, or invert the image in the latent space of the pretrained model. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Senmao Li , Joost van de Weijer , Taihang Hu , Fahad Shahbaz Khan , Qibin Hou , Yaxing Wang , Jian Yang , Ming-Ming Cheng

A plethora of text-guided image editing methods has recently been developed by leveraging the impressive capabilities of large-scale diffusion-based generative models especially Stable Diffusion. Despite the success of diffusion models in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Qihe Pan , Zhen Zhao , Zicheng Wang , Sifan Long , Yiming Wu , Wei Ji , Haoran Liang , Ronghua Liang

Text-guided diffusion models such as DALLE-2, Imagen, eDiff-I, and Stable Diffusion are able to generate an effectively endless variety of images given only a short text prompt describing the desired image content. In many cases the images…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Wan-Duo Kurt Ma , J. P. Lewis , Avisek Lahiri , Thomas Leung , W. Bastiaan Kleijn

Large-scale diffusion models have made significant advances in image generation, particularly through cross-attention mechanisms. While cross-attention has been well-studied in text-to-image tasks, their interpretability in image-to-image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Junseo Park , Hyeryung Jang

Multimodal Diffusion Transformers (MM-DiTs) have achieved remarkable progress in text-driven visual generation. However, even state-of-the-art MM-DiT models like FLUX struggle with achieving precise alignment between text prompts and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Zhengyao Lv , Tianlin Pan , Chenyang Si , Zhaoxi Chen , Wangmeng Zuo , Ziwei Liu , Kwan-Yee K. Wong

Recent advances in text-to-image diffusion models have substantially improved the quality of image customization, enabling the synthesis of highly realistic images. Despite this progress, achieving fast and efficient personalization remains…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Aniket Roy , Maitreya Suin , Rama Chellappa

Current diffusion-based video editing primarily focuses on local editing (\textit{e.g.,} object/background editing) or global style editing by utilizing various dense correspondences. However, these methods often fail to accurately edit the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Xiangpeng Yang , Linchao Zhu , Hehe Fan , Yi Yang

Recent advances in text-to-image (T2I) diffusion models have enabled remarkable control over various attributes, yet precise color specification remains a fundamental challenge. Existing approaches, such as ColorPeel, rely on model…