English
Related papers

Related papers: ConsistentID: Portrait Generation with Multimodal …

200 papers

Existing diffusion models show great potential for identity-preserving generation. However, personalized portrait generation remains challenging due to the diversity in user profiles, including variations in appearance and lighting…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Han Yang , Enis Simsar , Sotiris Anagnostidis , Yanlong Zang , Thomas Hofmann , Ziwei Liu

Human-centric generative models designed for AI-driven storytelling must bring together two core capabilities: identity consistency and precise control over human performance. While recent diffusion-based approaches have made significant…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Foivos Paraperas Papantoniou , Stefanos Zafeiriou

Recent advances in generative modeling have enabled the generation of high-quality synthetic data that is applicable in a variety of domains, including face recognition. Here, state-of-the-art generative models typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Darian Tomašević , Fadi Boutros , Chenhao Lin , Naser Damer , Vitomir Štruc , Peter Peer

Personalizing Stable Diffusion for professional portrait generation from amateur photos faces challenges in maintaining facial resemblance. This paper evaluates the impact of augmentation strategies on two personalization methods:…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Koray Ulusan , Benjamin Kiefer

Synthetic face datasets are increasingly used to overcome the limitations of real-world biometric data, including privacy concerns, demographic imbalance, and high collection costs. However, many existing methods lack fine-grained control…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Raul Ismayilov , Dzemila Sero , Luuk Spreeuwers

Recent advancements in video generation have significantly impacted various downstream applications, particularly in identity-preserving video generation (IPT2V). However, existing methods struggle with "copy-paste" artifacts and low…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Jiangchuan Wei , Shiyue Yan , Wenfeng Lin , Boyuan Liu , Renjie Chen , Mingyu Guo

Identity-consistent generation has become an important focus in text-to-image research, with recent models achieving notable success in producing images aligned with a reference identity. Yet, the scarcity of large-scale paired datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Hengyuan Xu , Wei Cheng , Peng Xing , Yixiao Fang , Shuhan Wu , Rui Wang , Xianfang Zeng , Daxin Jiang , Gang Yu , Xingjun Ma , Yu-Gang Jiang

Face editing methods, essential for tasks like virtual avatars, digital human synthesis and identity preservation, have traditionally been built upon GAN-based techniques, while recent focus has shifted to diffusion-based models due to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Mengting Wei , Tuomas Varanka , Yante Li , Xingxun Jiang , Huai-Qian Khor , Guoying Zhao

Nowadays, the wide application of virtual digital human promotes the comprehensive prosperity and development of digital culture supported by digital economy. The personalized portrait automatically generated by AI technology needs both the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Runchuan Zhu , Naye Ji , Youbing Zhao , Fan Zhang

Text-to-image (T2I) models have significantly advanced the development of artificial intelligence, enabling the generation of high-quality images in diverse contexts based on specific text prompts. However, existing T2I-based methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Salaheldin Mohamed , Dong Han , Yong Li

Recent advances in text-to-image generation have driven interest in generating personalized human images that depict specific identities from reference images. Although existing methods achieve high-fidelity identity preservation, they are…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Xirui Hu , Jiahao Wang , Hao Chen , Weizhan Zhang , Benqi Wang , Yikun Li , Haishun Nan

Despite recent progress in diffusion models, generating realistic head portraits from novel viewpoints remains a significant challenge. Most current approaches are constrained to limited angular ranges, predominantly focusing on frontal or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Stathis Galanakis , Alexandros Lattas , Stylianos Moschoglou , Bernhard Kainz , Stefanos Zafeiriou

We propose a novel framework for ID-preserving generation using a multi-modal encoding strategy rather than injecting identity features via adapters into pre-trained models. Our method treats identity and text as a unified conditioning…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Zichuan Liu , Liming Jiang , Qing Yan , Yumin Jia , Hao Kang , Xin Lu

AI systems rely on extensive training on large datasets to address various tasks. However, image-based systems, particularly those used for demographic attribute prediction, face significant challenges. Many current face image datasets…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Georgia Baltsou , Ioannis Sarridis , Christos Koutlis , Symeon Papadopoulos

The growing demand for diverse and high-quality facial datasets for training and testing biometric systems is challenged by privacy regulations, data scarcity, and ethical concerns. Synthetic facial images offer a potential solution, yet…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Ananya Kadali , Sunnie Jehan-Morrison , Orasiki Wellington , Barney Evans , Precious Durojaiye , Richard Guest

Face swapping aims to optimize realistic facial image generation by leveraging the identity of a source face onto a target face while preserving pose, expression, and context. However, existing methods, especially GAN-based methods, often…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Md Shohel Rana , Tanoy Debnath

We introduce PortraitGen, a powerful portrait video editing method that achieves consistent and expressive stylization with multimodal prompts. Traditional portrait video editing methods often struggle with 3D and temporal consistency, and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Xuan Gao , Haiyao Xiao , Chenglai Zhong , Shimin Hu , Yudong Guo , Juyong Zhang

In the field of personalized image generation, the ability to create images preserving concepts has significantly improved. Creating an image that naturally integrates multiple concepts in a cohesive and visually appealing composition can…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Chanran Kim , Jeongin Lee , Shichang Joung , Bongmo Kim , Yeul-Min Baek

Facial appearance editing is crucial for digital avatars, AR/VR, and personalized content creation, driving realistic user experiences. However, preserving identity with generative models is challenging, especially in scenarios with limited…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 MD Wahiduzzaman Khan , Mingshan Jia , Xiaolin Zhang , En Yu , Caifeng Shan , Kaska Musial-Gabrys

The advance of Generative Adversarial Networks (GANs) enables realistic face image synthesis. However, synthesizing face images that preserve facial identity as well as have high diversity within each identity remains challenging. To…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Yujun Shen , Bolei Zhou , Ping Luo , Xiaoou Tang