English
Related papers

Related papers: FantasyID: Face Knowledge Enhanced ID-Preserving V…

200 papers

Recently, we have seen a surge of personalization methods for text-to-image (T2I) diffusion models to learn a concept using a few images. Existing approaches, when used for face personalization, suffer to achieve convincing inversion with…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Rishubh Parihar , Sachidanand VS , Sabariswaran Mani , Tejan Karmali , R. Venkatesh Babu

In latest years plethora of identity-preserving adapters for a personalized generation with diffusion models have been released. Their main disadvantage is that they are dominantly trained jointly with base diffusion models, which suffer…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Sergey Karpukhin , Vadim Titov , Andrey Kuznetsov , Aibek Alanov

Identity-preserving face synthesis aims to generate synthetic face images of virtual subjects that can substitute real-world data for training face recognition models. While prior arts strive to create images with consistent identities and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Yuxi Mi , Zhizhou Zhong , Yuge Huang , Qiuyang Yuan , Xuan Zhao , Jianqing Xu , Shouhong Ding , ShaoMing Wang , Rizen Guo , Shuigeng Zhou

Recent progress in diffusion models has significantly advanced the field of human image animation. While existing methods can generate temporally consistent results for short or regular motions, significant challenges remain, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Shen Zheng , Jiaran Cai , Yuansheng Guan , Shenneng Huang , Xingpei Ma , Junjie Cao , Hanfeng Zhao , Qiang Zhang , Shunsi Zhang , Xiao-Ping Zhang

Tuning-free face personalization methods have developed along two distinct paradigms: text embedding approaches that map facial features into the text embedding space, and adapter-based methods that inject features through auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Lianyu Pang , Ji Zhou , Qiping Wang , Baoquan Zhao , Zhenguo Yang , Qing Li , Xudong Mao

Portrait customization (PC) has recently garnered significant attention due to its potential applications. However, existing PC methods lack precise identity (ID) preservation and face control. To address these tissues, we propose Diff-PC,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yifang Xu , Benxiang Zhai , Chenyu Zhang , Ming Li , Yang Li , Sidan Du

There has been significant progress in personalized image synthesis with methods such as Textual Inversion, DreamBooth, and LoRA. Yet, their real-world applicability is hindered by high storage demands, lengthy fine-tuning processes, and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Qixun Wang , Xu Bai , Haofan Wang , Zekui Qin , Anthony Chen , Huaxia Li , Xu Tang , Yao Hu

Diffusion Transformers (DiT) have emerged as a widely adopted backbone for high-fidelity image and video generation, yet their iterative denoising process incurs high computational costs. Existing training-free acceleration methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Hanshuai Cui , Zhiqing Tang , Qianli Ma , Zhi Yao , Weijia Jia

Recent advances in image-to-video (I2V) generation have achieved remarkable progress in synthesizing high-quality, temporally coherent videos from static images. Among all the applications of I2V, human-centric video generation includes a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Liao Shen , Wentao Jiang , Yiran Zhu , Jiahe Li , Tiezheng Ge , Zhiguo Cao , Bo Zheng

Text-conditioned image editing has greatly benefitted from the advancements in Image Diffusion Models. However, extending these techniques to facial video editing introduces challenges in preserving facial identity throughout the source…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Huanghao Yin , Shenkun Xu , Kanle Shi , Junhai Yong , Bin Wang

The text-to-image (T2I) personalization diffusion model can generate images of the novel concept based on the user input text caption. However, existing T2I personalized methods either require test-time fine-tuning or fail to generate…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Xiao Guo , Manh Tran , Jiaxin Cheng , Xiaoming Liu

We propose EditID, a training-free approach based on the DiT architecture, which achieves highly editable customized IDs for text to image generation. Existing text-to-image models for customized IDs typically focus more on ID consistency…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Guandong Li , Zhaobin Chu

Recent research arXiv:2410.15027 arXiv:2410.23775 has highlighted the inherent in-context generation capabilities of pretrained diffusion transformers (DiTs), enabling them to seamlessly adapt to diverse visual tasks with minimal or no…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Lianghua Huang , Wei Wang , Zhi-Fan Wu , Yupeng Shi , Chen Liang , Tong Shen , Han Zhang , Huanzhang Dou , Yu Liu , Jingren Zhou

In this paper, we introduce DreamID, a diffusion-based face swapping model that achieves high levels of ID similarity, attribute preservation, image fidelity, and fast inference speed. Unlike the typical face swapping training process,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Fulong Ye , Miao Hua , Pengze Zhang , Xinghui Li , Qichao Sun , Songtao Zhao , Qian He , Xinglong Wu

Personalized image generation aims to produce images of user-specified concepts while enabling flexible editing. Recent training-free approaches, while exhibit higher computational efficiency than training-based methods, struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Haoran Feng , Zehuan Huang , Lin Li , Hairong Lv , Lu Sheng

With the rapid advancement of diffusion models, talking face generation has made remarkable progress. However, existing diffusion-based methods still require task-specific fine-tuning and large-scale audiovisual datasets, resulting in high…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Hao Wu , Xiangyang Luo , Hao Wang , Jiawei Zhang , Yi Zhang , Jinwei Wang

Diffusion Transformers (DiTs) have recently driven significant progress in text-to-video (T2V) generation. However, generating multiple videos with consistent characters and backgrounds remains a significant challenge. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Han Yan , Xibin Song , Yifu Wang , Hongdong Li , Pan Ji , Chao Ma

Talking head generation is a significant research topic that still faces numerous challenges. Previous works often adopt generative adversarial networks or regression models, which are plagued by generation quality and average facial shape…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Ziyu Yao , Xuxin Cheng , Zhiqi Huang

Recent Text-to-Video (T2V) models have demonstrated powerful capability in visual simulation of real-world geometry and physical laws, indicating its potential as implicit world models. Inspired by this, we explore the feasibility of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yu Li , Menghan Xia , Gongye Liu , Jianhong Bai , Xintao Wang , Conglang Zhang , Yuxuan Lin , Ruihang Chu , Pengfei Wan , Yujiu Yang

In facial image generation, current text-to-image models often suffer from facial attribute leakage and insufficient physical consistency when responding to local semantic instructions. In this study, we propose Face-MakeUpV2, a facial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Dawei Dai , Yinxiu Zhou , Chenghang Li , Guolai Jiang , Chengfang Zhang