English
Related papers

Related papers: Continuous, Subject-Specific Attribute Control in …

200 papers

Recent years have witnessed success in AIGC (AI Generated Content). People can make use of a pre-trained diffusion model to generate images of high quality or freely modify existing pictures with only prompts in nature language. More…

Cryptography and Security · Computer Science 2023-08-24 Yutong Wu , Jie Zhang , Florian Kerschbaum , Tianwei Zhang

Continual post-training adapts a single text-to-image diffusion model to learn new tasks without incurring the cost of separate models, but naive post-training causes forgetting of pretrained knowledge and undermines zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Zhehao Huang , Yuhang Liu , Yixin Lou , Zhengbao He , Mingzhen He , Wenxing Zhou , Tao Li , Kehan Li , Zeyi Huang , Xiaolin Huang

Large-scale Text-to-Image (T2I) diffusion models have revolutionized image generation over the last few years. Although owning diverse and high-quality generation capabilities, translating these abilities to fine-grained image editing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

Recent text-to-image generation models like DreamBooth have made remarkable progress in generating highly customized images of a target subject, by fine-tuning an ``expert model'' for a given subject from a few examples. However, this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Wenhu Chen , Hexiang Hu , Yandong Li , Nataniel Ruiz , Xuhui Jia , Ming-Wei Chang , William W. Cohen

With the help of conditioning mechanisms, the state-of-the-art diffusion models have achieved tremendous success in guided image generation, particularly in text-to-image synthesis. To gain a better understanding of the training process and…

Cryptography and Security · Computer Science 2023-10-24 Shengfang Zhai , Yinpeng Dong , Qingni Shen , Shi Pu , Yuejian Fang , Hang Su

Recent research in subject-driven generation increasingly emphasizes the importance of selective subject features. Nevertheless, accurately selecting the content in a given reference image still poses challenges, especially when selecting…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Junjie Hu , Shuyong Gao , Lingyi Hong , Qishan Wang , Yuzhou Zhao , Yan Wang , Wenqiang Zhang

Advancements in text-to-image generative AI with large multimodal models are spreading into the field of image compression, creating high-quality representation of images at extremely low bit rates. This work introduces novel components to…

Image and Video Processing · Electrical Eng. & Systems 2025-06-02 Cheng-Lin Wu , Hyomin Choi , Ivan V. Bajić

Text-to-image (T2I) models have ushered in a new era of real-world image super-resolution (Real-ISR) due to their rich internal implicit knowledge for multimodal learning. Although bringing high-level semantic priors and dense pixel…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Xinrui Li , Jinrong Zhang , Jianlong Wu , Chong Chen , Liqiang Nie , Zhouchen Lin

Achieving precise word-level typography control within generated images remains a persistent challenge. To address it, we newly construct a word-level controlled scene text dataset and introduce the Text-Image Alignment (TIA) framework.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Wenda Shi , Yiren Song , Zihan Rao , Dengming Zhang , Jiaming Liu , Xingxing Zou

Recently, the multimedia community has witnessed the rise of diffusion models trained on large-scale multi-modal data for visual content creation, particularly in the field of text-to-image generation. In this paper, we propose a new task…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Jingwen Chen , Yingwei Pan , Ting Yao , Tao Mei

This paper presents a novel approach to improving text-guided image editing using diffusion-based models. Text-guided image editing task poses key challenge of precisly locate and edit the target semantic, and previous methods fall shorts…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Yihan Hu , Jianing Peng , Yiheng Lin , Ting Liu , Xiaochao Qu , Luoqi Liu , Yao Zhao , Yunchao Wei

As the text-to-image (T2I) domain progresses, generating text that seamlessly integrates with visual content has garnered significant attention. However, even with accurate text generation, the inability to control font and color can…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yuxiang Tuo , Yifeng Geng , Liefeng Bo

Personalized text-to-image (T2I) synthesis based on diffusion models has attracted significant attention in recent research. However, existing methods primarily concentrate on customizing subjects or styles, neglecting the exploration of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Hai Wang , Xiaoyu Xiang , Yuchen Fan , Jing-Hao Xue

Text-to-Image diffusion models have made tremendous progress over the past two years, enabling the generation of highly realistic images based on open-domain text descriptions. However, despite their success, text descriptions often…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Shihao Zhao , Dongdong Chen , Yen-Chun Chen , Jianmin Bao , Shaozhe Hao , Lu Yuan , Kwan-Yee K. Wong

Text-to-image (T2I) diffusion models have shown significant success in personalized text-to-image generation, which aims to generate novel images with human identities indicated by the reference images. Despite promising identity fidelity…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yuxiang Wei , Zhilong Ji , Jinfeng Bai , Hongzhi Zhang , Lei Zhang , Wangmeng Zuo

Existing models often struggle with complex temporal changes, particularly when generating videos with gradual attribute transitions. The most common prompt interpolation approach for motion transitions often fails to handle gradual…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Ling Lo , Kelvin C. K. Chan , Wen-Huang Cheng , Ming-Hsuan Yang

This paper introduces a generative model designed for multimodal control over text-to-image foundation generative AI models such as Stable Diffusion, specifically tailored for engineering design synthesis. Our model proposes parametric,…

Artificial Intelligence · Computer Science 2024-12-09 Rui Zhou , Yanxia Zhang , Chenyang Yuan , Frank Permenter , Nikos Arechiga , Matt Klenk , Faez Ahmed

While text-to-image models have achieved impressive capabilities in image generation and editing, their application across various modalities often necessitates training separate models. Inspired by existing method of single image editing…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Gihyun Kwon , Jangho Park , Jong Chul Ye

Erasing concepts from large-scale text-to-image (T2I) diffusion models has become increasingly crucial due to the growing concerns over copyright infringement, offensive content, and privacy violations. In scalable applications,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Ouxiang Li , Yuan Wang , Xinting Hu , Houcheng Jiang , Yanbin Hao , Fuli Feng

Facial video editing has become increasingly important for content creators, enabling the manipulation of facial expressions and attributes. However, existing models encounter challenges such as poor editing quality, high computational…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Tharun Anand , Aryan Garg , Kaushik Mitra