English
Related papers

Related papers: EZIGen: Enhancing zero-shot personalized image gen…

200 papers

Zero-shot learning (ZSL) aims to infer novel classes without training samples by transferring knowledge from seen classes. Existing embedding-based approaches for ZSL typically employ attention mechanisms to locate attributes on an image.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Lei Xiang , Yuan Zhou , Haoran Duan , Yang Long

Cross-modality data translation has attracted great interest in image computing. Deep generative models (\textit{e.g.}, GANs) show performance improvement in tackling those problems. Nevertheless, as a fundamental challenge in image…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Zihao Wang , Yingyu Yang , Maxime Sermesant , Hervé Delingette , Ona Wu

Nowadays, the wide application of virtual digital human promotes the comprehensive prosperity and development of digital culture supported by digital economy. The personalized portrait automatically generated by AI technology needs both the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Runchuan Zhu , Naye Ji , Youbing Zhao , Fan Zhang

Subject-driven image generation aims at generating images containing customized subjects, which has recently drawn enormous attention from the research community. However, the previous works cannot precisely control the background and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Tianle Li , Max Ku , Cong Wei , Wenhu Chen

Personalized image synthesis has emerged as a pivotal application in text-to-image generation, enabling the creation of images featuring specific subjects in diverse contexts. While diffusion models have dominated this domain,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Kaiyue Sun , Xian Liu , Yao Teng , Xihui Liu

The diffusion model has demonstrated superior performance in synthesizing diverse and high-quality images for text-guided image translation. However, there remains room for improvement in both the formulation of text prompts and the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Qi Si , Bo Wang , Zhao Zhang

Personalized image generation with text-to-image diffusion models generates unseen images based on reference image content. Zero-shot adapter methods such as IP-Adapter and OminiControl are especially interesting because they do not require…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Qiyuan He , Angela Yao

Existing literature typically treats style-driven and subject-driven generation as two disjoint tasks: the former prioritizes stylistic similarity, whereas the latter insists on subject consistency, resulting in an apparent antagonism. We…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Shaojin Wu , Mengqi Huang , Yufeng Cheng , Wenxu Wu , Jiahe Tian , Yiming Luo , Fei Ding , Qian He

There is a growing interest in dataset generation recently due to the superior generative capacity of large pre-trained language models (PLMs). In this paper, we study a flexible and efficient zero-short learning method, \textsc{ZeroGen}.…

Computation and Language · Computer Science 2022-10-25 Jiacheng Ye , Jiahui Gao , Qintong Li , Hang Xu , Jiangtao Feng , Zhiyong Wu , Tao Yu , Lingpeng Kong

Modern diffusion-based image generative models have made significant progress and become promising to enrich training data for the object detection task. However, the generation quality and the controllability for complex scenes containing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Jingyuan Zhu , Shiyu Li , Yuxuan Liu , Ping Huang , Jiulong Shan , Huimin Ma , Jian Yuan

Personalizing text-to-image models using a limited set of images for a specific object has been explored in subject-specific image generation. However, existing methods often face challenges in aligning with text prompts due to overfitting…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Daewon Chae , Nokyung Park , Jinkyu Kim , Kimin Lee

Zero-shot learning methods rely on fixed visual and semantic embeddings, extracted from independent vision and language models, both pre-trained for other large-scale tasks. This is a weakness of current zero-shot learning frameworks as…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Shah Nawaz , Jacopo Cavazza , Alessio Del Bue

Foundation models have emerged as powerful tools across various domains including language, vision, and multimodal tasks. While prior works have addressed unsupervised image segmentation, they significantly lag behind supervised models. In…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Paul Couairon , Mustafa Shukor , Jean-Emmanuel Haugeard , Matthieu Cord , Nicolas Thome

Lately, generative adversarial networks (GANs) have been successfully applied to zero-shot learning (ZSL) and achieved state-of-the-art performance. By synthesizing virtual unseen visual features, GAN-based methods convert the challenging…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Jingjing Li , Mengmeng Jing , Ke Lu , Lei Zhu , Yang Yang , Zi Huang

Diffusion-based text-to-image personalization have achieved great success in generating subjects specified by users among various contexts. Even though, existing finetuning-based methods still suffer from model overfitting, which greatly…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Henglei Lv , Jiayu Xiao , Liang Li , Qingming Huang

Machine unlearning aims to remove the influence of specific samples from a trained model. A key challenge in this process is over-unlearning, where the model's performance on the remaining data significantly drops due to the change in the…

Machine Learning · Computer Science 2025-07-30 Huiqiang Chen , Tianqing Zhu , Xin Yu , Wanlei Zhou

Existing few-shot image generation approaches typically employ fusion-based strategies, either on the image or the feature level, to produce new images. However, previous approaches struggle to synthesize high-frequency signals with fine…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Mengping Yang , Zhe Wang , Ziqiu Chi , Wenyi Feng

Recent advances in deep learning demonstrate the ability to generate synthetic gaze data. However, most approaches have primarily focused on generating data from random noise distributions or global, predefined latent embeddings, whereas…

Human-Computer Interaction · Computer Science 2025-11-14 Kamrul Hasan , Dmytro Katrychuk , Mehedi Hasan Raju , Oleg V. Komogortsev

Personalized text-to-image generation models enable users to create images that depict their individual possessions in diverse scenes, finding applications in various domains. To achieve the personalization capability, existing methods rely…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Yu Zeng , Vishal M. Patel , Haochen Wang , Xun Huang , Ting-Chun Wang , Ming-Yu Liu , Yogesh Balaji

Disentangled generative models map a latent code vector to a target space, while enforcing that a subset of the learned latent codes are interpretable and associated with distinct properties of the target distribution. Recent advances have…

Machine Learning · Computer Science 2020-08-10 Zinan Lin , Kiran Koshy Thekumparampil , Giulia Fanti , Sewoong Oh