English
Related papers

Related papers: ConceptGuard: Continual Personalized Text-to-Image…

200 papers

As large-scale diffusion models continue to advance, they excel at producing high-quality images but often generate unwanted content, such as sexually explicit or violent content. Existing methods for concept removal generally guide the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Lingyun Zhang , Yu Xie , Yanwei Fu , Ping Chen

Text-to-image generative models can produce diverse high-quality images of concepts with a text prompt, which have demonstrated excellent ability in image generation, image translation, etc. We in this work study the problem of synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Gan Sun , Wenqi Liang , Jiahua Dong , Jun Li , Zhengming Ding , Yang Cong

Despite significant advancements in image customization with diffusion models, current methods still have several limitations: 1) unintended changes in non-target areas when regenerating the entire image; 2) guidance solely by a reference…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Pengzhi Li , Qiang Nie , Ying Chen , Xi Jiang , Kai Wu , Yuhuan Lin , Yong Liu , Jinlong Peng , Chengjie Wang , Feng Zheng

Continual learning empowers models to learn from a continuous stream of data while preserving previously acquired knowledge, effectively addressing the challenge of catastrophic forgetting. In this study, we propose a new approach that…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Mohamed Abbas Hedjazi , Oussama Hadjerci , Adel Hafiane

Customized text-to-image generation renders user-specified concepts into novel contexts based on textual prompts. Scaling the number of concepts in customized generation meets a broader demand for user creation, whereas existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jian Jin , Zhenbo Yu , Yang Shen , Zhenyong Fu , Jian Yang

Recently, text-to-image diffusion models have been widely used for style mimicry and personalized customization through methods such as DreamBooth and Textual Inversion. This has raised concerns about intellectual property protection and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Yanjie Li , Wenxuan Zhang , Xinqi Lyu , Yihao Liu , Bin Xiao

Text-to-image diffusion models have made significant advancements in generating high-quality, diverse images from text prompts. However, the inherent limitations of textual signals often prevent these models from fully capturing specific…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Ziqiang Li , Jun Li , Lizhi Xiong , Zhangjie Fu , Zechao Li

Personalized text-to-image (T2I) generation has emerged as a key application for creating user-specific concepts from a few reference images. The core challenge is concept disentanglement: separating the target concept from irrelevant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Minseo Kim , Minchan Kwon , Dongyeun Lee , Yunho Jeon , Junmo Kim

This study investigates identity-preserving image synthesis, an intriguing task in image generation that seeks to maintain a subject's identity while adding a personalized, stylistic touch. Traditional methods, such as Textual Inversion and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Yuxuan Yan , Chi Zhang , Rui Wang , Yichao Zhou , Gege Zhang , Pei Cheng , Gang Yu , Bin Fu

While advanced image captioning systems are increasingly describing images coherently and exactly, recent progress in continual learning allows deep learning models to avoid catastrophic forgetting. However, the domain where image…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Giang Nguyen , Tae Joon Jun , Trung Tran , Tolcha Yalew , Daeyoung Kim

Recent breakthroughs in diffusion models have exhibited exceptional image-generation capabilities. However, studies show that some outputs are merely replications of training data. Such replications present potential legal challenges for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Yuxin Wen , Yuchen Liu , Chen Chen , Lingjuan Lyu

Recent diffusion-based text-to-image customization methods have achieved significant success in understanding concrete concepts to control generation processes, such as styles and shapes. However, few efforts dive into the realistic yet…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Fan Wu , Cheng Chen , Zhoujie Fu , Jiacheng Wei , Yi Xu , Deheng Ye , Guosheng Lin

Personalized text-to-image generation aims to create images tailored to user-defined concepts and textual descriptions. Balancing the fidelity of the learned concept with its ability for generation in various contexts presents a significant…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Vera Soboleva , Maksim Nakhodnov , Aibek Alanov

Text-to-image diffusion models can generate diverse, high-fidelity images based on user-provided text prompts. Recent research has extended these models to support text-guided image editing. While text guidance is an intuitive editing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Jooyoung Choi , Yunjey Choi , Yunji Kim , Junho Kim , Sungroh Yoon

We present personalized residuals and localized attention-guided sampling for efficient concept-driven generation using text-to-image diffusion models. Our method first represents concepts by freezing the weights of a pretrained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Cusuh Ham , Matthew Fisher , James Hays , Nicholas Kolkin , Yuchen Liu , Richard Zhang , Tobias Hinz

Text-to-image (TTI) diffusion models have demonstrated impressive results in generating high-resolution images of complex and imaginative scenes. Recent approaches have further extended these methods with personalization techniques that…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Tanzila Rahman , Shweta Mahajan , Hsin-Ying Lee , Jian Ren , Sergey Tulyakov , Leonid Sigal

The personalized text-to-image generation has rapidly advanced with the emergence of Stable Diffusion. Existing methods, which typically fine-tune models using embedded identifiers, often struggle with insufficient stylization and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Anran Yu , Wei Feng , Yaochen Zhang , Xiang Li , Lei Meng , Lei Wu , Xiangxu Meng

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Continual learning studies how models can adapt to new tasks while retaining previously acquired knowledge. Although a broad spectrum of methods has been proposed to mitigate catastrophic forgetting, the field remains predominantly…

Machine Learning · Computer Science 2026-05-19 Katarzyna Filus , Kamil Faber , Roberto Corizzo , Christopher Kanan

The nature of personalized text-to-image models poses a unique safety challenge that generic context-blind methods are ill-equipped to handle. Such global filters create a dilemma: to prevent misuse, they are forced to damage the model's…

Cryptography and Security · Computer Science 2026-03-18 Lingyun Zhang , Yu Xie , Ping Chen