中文
相关论文

相关论文: FlexEControl: Flexible and Efficient Multimodal Co…

200 篇论文

Text-to-Image (T2I) diffusion models have shown impressive results in generating visually compelling images following user prompts. Building on this, various methods further fine-tune the pre-trained T2I model for specific tasks. However,…

计算机视觉与模式识别 · 计算机科学 2025-04-24 Tsu-Jui Fu , Yusu Qian , Chen Chen , Wenze Hu , Zhe Gan , Yinfei Yang

In Text-to-Image (T2I) generation, the complexity of entities and their intricate interactions pose a significant challenge for T2I method based on diffusion model: how to effectively control entity and their interactions to produce…

计算机视觉与模式识别 · 计算机科学 2025-08-26 Mingyue Yang , Dianxi Shi , Jialu Zhou , Xinyu Wei , Leqian Li , Shaowu Yang , Chunping Qiu

Diffusion models have advanced from text-to-image (T2I) to image-to-image (I2I) generation by incorporating structured inputs such as depth maps, enabling fine-grained spatial control. However, existing methods either train separate models…

计算机视觉与模式识别 · 计算机科学 2025-08-01 Yucheng Xie , Fu Feng , Ruixiao Shi , Jing Wang , Yong Rui , Xin Geng

Text-to-Image (T2I) generation methods based on diffusion model have garnered significant attention in the last few years. Although these image synthesis methods produce visually appealing results, they frequently exhibit spelling errors…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Yiming Zhao , Zhouhui Lian

Diffusion models have emerged as a dominant paradigm for generative modeling across a wide range of domains, including prompt-conditional generation. The vast majority of samplers, however, rely on forward discretization of the reverse…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Zhenghan Fang , Jian Zheng , Qiaozi Gao , Xiaofeng Gao , Jeremias Sulam

Recent advancements in video generation, particularly in diffusion models, have driven notable progress in text-to-video (T2V) and image-to-video (I2V) synthesis. However, challenges remain in effectively integrating dynamic motion signals…

计算机视觉与模式识别 · 计算机科学 2025-07-04 Ziye Li , Hao Luo , Xincheng Shuai , Henghui Ding

Text-to-image (T2I) models have significantly advanced the development of artificial intelligence, enabling the generation of high-quality images in diverse contexts based on specific text prompts. However, existing T2I-based methods often…

计算机视觉与模式识别 · 计算机科学 2024-10-03 Salaheldin Mohamed , Dong Han , Yong Li

Diffusion Transformer (DiT) has demonstrated remarkable performance in text-to-image generation; however, its large parameter size results in substantial inference overhead. Existing parameter compression methods primarily focus on pruning,…

计算机视觉与模式识别 · 计算机科学 2025-10-13 Youwei Zheng , Yuxi Ren , Xin Xia , Xuefeng Xiao , Xiaohua Xie

Text-conditional diffusion models are able to generate high-fidelity images with diverse contents. However, linguistic representations frequently exhibit ambiguous descriptions of the envisioned objective imagery, requiring the…

计算机视觉与模式识别 · 计算机科学 2024-03-01 Minghui Hu , Jianbin Zheng , Daqing Liu , Chuanxia Zheng , Chaoyue Wang , Dacheng Tao , Tat-Jen Cham

Efficient fine-tuning of pre-trained Text-to-Image (T2I) models involves adjusting the model to suit a particular task or dataset while minimizing computational resources and limiting the number of trainable parameters. However, it often…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Komal Kumar , Rao Muhammad Anwer , Fahad Shahbaz Khan , Salman Khan , Ivan Laptev , Hisham Cholakkal

Ethical issues around text-to-image (T2I) models demand a comprehensive control over the generative content. Existing techniques addressing these issues for responsible T2I models aim for the generated content to be fair and safe…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Basim Azam , Naveed Akhtar

Diffusion-based text-to-image generative models, e.g., Stable Diffusion, have revolutionized the field of content generation, enabling significant advancements in areas like image editing and video synthesis. Despite their formidable…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Yanyu Li , Xian Liu , Anil Kag , Ju Hu , Yerlan Idelbayev , Dhritiman Sagar , Yanzhi Wang , Sergey Tulyakov , Jian Ren

Large-scale text-to-image diffusion models have been a revolutionary milestone in the evolution of generative AI and multimodal technology, allowing wonderful image generation with natural-language text prompt. However, the issue of lacking…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Xiang Gao , Jiaying Liu

Text-to-image (T2I) diffusion models have shown significant success in personalized text-to-image generation, which aims to generate novel images with human identities indicated by the reference images. Despite promising identity fidelity…

计算机视觉与模式识别 · 计算机科学 2024-07-30 Yuxiang Wei , Zhilong Ji , Jinfeng Bai , Hongzhi Zhang , Lei Zhang , Wangmeng Zuo

Recently, the multimedia community has witnessed the rise of diffusion models trained on large-scale multi-modal data for visual content creation, particularly in the field of text-to-image generation. In this paper, we propose a new task…

计算机视觉与模式识别 · 计算机科学 2023-11-10 Jingwen Chen , Yingwei Pan , Ting Yao , Tao Mei

Diffusion models have recently achieved remarkable advancements in terms of image quality and fidelity to textual prompts. Concurrently, the safety of such generative models has become an area of growing concern. This work introduces a…

计算机视觉与模式识别 · 计算机科学 2025-06-12 Tong Liu , Zhixin Lai , Jiawen Wang , Gengyuan Zhang , Shuo Chen , Philip Torr , Vera Demberg , Volker Tresp , Jindong Gu

Large-scale text-to-image (T2I) diffusion models have showcased incredible capabilities in generating coherent images based on textual descriptions, enabling vast applications in content generation. While recent advancements have introduced…

计算机视觉与模式识别 · 计算机科学 2024-02-28 Jiun Tian Hoe , Xudong Jiang , Chee Seng Chan , Yap-Peng Tan , Weipeng Hu

Generative diffusion models offer a natural choice for data augmentation when training complex vision models. However, ensuring reliability of their generative content as augmentation samples remains an open challenge. Despite a number of…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Khawar Islam , Naveed Akhtar

Current text-to-image diffusion models excel at generating diverse, high-quality images, yet they struggle to incorporate fine-grained camera metadata such as precise aperture settings. In this work, we introduce a novel text-to-image…

计算机视觉与模式识别 · 计算机科学 2025-12-15 Ayush Shrivastava , Connelly Barnes , Xuaner Zhang , Lingzhi Zhang , Andrew Owens , Sohrab Amirghodsi , Eli Shechtman

Scaling up model and data size has been quite successful for the evolution of LLMs. However, the scaling law for the diffusion based text-to-image (T2I) models is not fully explored. It is also unclear how to efficiently scale the model for…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Hao Li , Yang Zou , Ying Wang , Orchid Majumder , Yusheng Xie , R. Manmatha , Ashwin Swaminathan , Zhuowen Tu , Stefano Ermon , Stefano Soatto