English
Related papers

Related papers: InstantID: Zero-shot Identity-Preserving Generatio…

200 papers

Facial images have extensive practical applications. Although the current large-scale text-image diffusion models exhibit strong generation capabilities, it is challenging to generate the desired facial images using only text prompt. Image…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Dawei Dai , Mingming Jia , Yinxiu Zhou , Hang Xing , Chenghang Li

Existing image-to-image transformation approaches primarily focus on synthesizing visually pleasing data. Generating images with correct identity labels is challenging yet much less explored. It is even more challenging to deal with image…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Wei Xiong , Yutong He , Yixuan Zhang , Wenhan Luo , Lin Ma , Jiebo Luo

Creating content with specified identities (ID) has attracted significant interest in the field of generative models. In the field of text-to-image generation (T2I), subject-driven creation has achieved great progress with the identity…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Ze Ma , Daquan Zhou , Chun-Hsiao Yeh , Xue-She Wang , Xiuyu Li , Huanrui Yang , Zhen Dong , Kurt Keutzer , Jiashi Feng

Large-scale text-to-image generative models have been a revolutionary breakthrough in the evolution of generative AI, allowing us to synthesize diverse images that convey highly complex visual concepts. However, a pivotal challenge in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Narek Tumanyan , Michal Geyer , Shai Bagon , Tali Dekel

Current diffusion models for human image animation struggle to ensure identity (ID) consistency. This paper presents StableAnimator, the first end-to-end ID-preserving video diffusion framework, which synthesizes high-quality videos without…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Shuyuan Tu , Zhen Xing , Xintong Han , Zhi-Qi Cheng , Qi Dai , Chong Luo , Zuxuan Wu

While large-scale pre-trained text-to-image models can synthesize diverse and high-quality human-centered images, novel challenges arise with a nuanced task of "identity fine editing": precisely modifying specific features of a subject…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Haonan Lin , Mengmeng Wang , Yan Chen , Wenbin An , Yuzhe Yao , Guang Dai , Qianying Wang , Yong Liu , Jingdong Wang

Generative diffusion models have advanced image editing with high-quality results and intuitive interfaces such as prompts and semantic drawing. However, these interfaces lack precise control, and the associated methods typically specialize…

Generative image editing using diffusion models has become a prevalent application in today's AI cloud services. In production environments, image editing typically involves a mask that specifies the regions of an image template to be…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-28 Xiaoxiao Jiang , Suyi Li , Lingyun Yang , Tianyu Feng , Zhipeng Di , Weiyi Lu , Guoxuan Zhu , Xiu Lin , Kan Liu , Yinghao Yu , Tao Lan , Guodong Yang , Lin Qu , Liping Zhang , Wei Wang

In recent years, face super-resolution (FSR) methods have achieved remarkable progress, generally maintaining high image fidelity and identity (ID) consistency under standard settings. However, in extreme degradation scenarios (e.g., scale…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Jiarui Yang , Hang Guo , Wen Huang , Tao Dai , Shutao Xia

We present Lynx, a high-fidelity model for personalized video synthesis from a single input image. Built on an open-source Diffusion Transformer (DiT) foundation model, Lynx introduces two lightweight adapters to ensure identity fidelity.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Shen Sang , Tiancheng Zhi , Tianpei Gu , Jing Liu , Linjie Luo

Growing privacy concerns and regulations like GDPR and CCPA necessitate pseudonymization techniques that protect identity in image datasets. However, retaining utility is also essential. Traditional methods like masking and blurring degrade…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Kartik Patwari , David Schneider , Xiaoxiao Sun , Chen-Nee Chuah , Lingjuan Lyu , Vivek Sharma

One little-explored frontier of image generation and editing is the task of interpolating between two input images, a feature missing from all currently deployed image generation pipelines. We argue that such a feature can expand the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Clinton J. Wang , Polina Golland

Recently, diffusion models have made significant strides in synthesizing realistic 2D human images based on provided text prompts. Building upon this, researchers have extended 2D text-to-image diffusion models into the 3D domain for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Weijie Wang , Jichao Zhang , Chang Liu , Xia Li , Xingqian Xu , Humphrey Shi , Nicu Sebe , Bruno Lepri

Diffusion-based text-to-image generation models trained on extensive text-image pairs have demonstrated the ability to produce photorealistic images aligned with textual descriptions. However, a significant limitation of these models is…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Mingyuan Zhou , Zhendong Wang , Huangjie Zheng , Hai Huang

Recent advancement in personalized image generation have unveiled the intriguing capability of pre-trained text-to-image models on learning identity information from a collection of portrait images. However, existing solutions are…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Yang Liu , Cheng Yu , Lei Shang , Yongyi He , Ziheng Wu , Xingjun Wang , Chao Xu , Haoyu Xie , Weida Wang , Yuze Zhao , Lin Zhu , Chen Cheng , Weitao Chen , Yuan Yao , Wenmeng Zhou , Jiaqi Xu , Qiang Wang , Yingda Chen , Xuansong Xie , Baigui Sun

Recent advances in text-to-image diffusion models have spurred significant interest in continuous story image generation. In this paper, we introduce Storynizor, a model capable of generating coherent stories with strong inter-frame…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yuhang Ma , Wenting Xu , Chaoyi Zhao , Keqiang Sun , Qinfeng Jin , Zeng Zhao , Changjie Fan , Zhipeng Hu

As large-scale text-to-image generation models have made remarkable progress in the field of text-to-image generation, many fine-tuning methods have been proposed. However, these models often struggle with novel objects, especially with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Jianxiang Lu , Cong Xie , Hui Guo

Personalized text-to-image generation has gained significant attention for its capability to generate high-fidelity portraits of specific identities conditioned on user-defined prompts. Existing methods typically involve test-time…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Yujia Wu , Yiming Shi , Jiwei Wei , Chengwei Sun , Yang Yang , Heng Tao Shen

Recent advances in generative models trained on large-scale datasets have made it possible to synthesize high-quality samples across various domains. Moreover, the emergence of strong inversion networks enables not only a reconstruction of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Juwon Seo , Sung-Hoon Lee , Tae-Young Lee , Seungjun Moon , Gyeong-Moon Park

Preserving face identity is a critical yet persistent challenge in diffusion-based image restoration. While reference faces offer a path forward, existing reference-based methods often fail to fully exploit their potential. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Mo Zhou , Keren Ye , Viraj Shah , Kangfu Mei , Mauricio Delbracio , Peyman Milanfar , Vishal M. Patel , Hossein Talebi