English
Related papers

Related papers: IP-FaceDiff: Identity-Preserving Facial Video Edit…

200 papers

Large-scale text-to-video models have shown remarkable abilities, but their direct application in video editing remains challenging due to limited available datasets. Current video editing methods commonly require per-video fine-tuning of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Zhenghao Zhang , Zuozhuo Dai , Long Qin , Weizhi Wang

Despite promising progress in face swapping task, realistic swapped images remain elusive, often marred by artifacts, particularly in scenarios involving high pose variation, color differences, and occlusion. To address these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Sanoojan Baliah , Qinliang Lin , Shengcai Liao , Xiaodan Liang , Muhammad Haris Khan

The performance of automated face recognition systems is inevitably impacted by the facial aging process. However, high quality datasets of individuals collected over several years are typically small in scale. In this work, we propose,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Sudipta Banerjee , Govind Mittal , Ameya Joshi , Chinmay Hegde , Nasir Memon

The rapid advancement of pretrained text-driven diffusion models has significantly enriched applications in image generation and editing. However, as the demand for personalized content editing increases, new challenges emerge especially…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Rui Jiang , Xinghe Fu , Guangcong Zheng , Teng Li , Taiping Yao , Xi Li

Recent advancements in diffusion frameworks have significantly enhanced video editing, achieving high fidelity and strong alignment with textual prompts. However, conventional approaches using image diffusion models fall short in handling…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Yixuan Zhu , Haolin Wang , Shilin Ma , Wenliang Zhao , Yansong Tang , Lei Chen , Jie Zhou

This paper presents a powerful framework to customize video creations by incorporating multiple specific identity (ID) photos, with video diffusion Transformers, referred to as Ingredients. Generally, our method consists of three primary…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Zhengcong Fei , Debang Li , Di Qiu , Changqian Yu , Mingyuan Fan

Face reenactment aims to generate realistic talking head videos by transferring motion from a driving video to a static source image while preserving the source identity. Although existing methods based on either implicit or explicit…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Mingtao Guo , Guanyu Xing , Yanci Zhang , Yanli Liu

Text-to-image (T2I) diffusion models have revolutionized visual content creation, but extending these capabilities to text-to-video (T2V) generation remains a challenge, particularly in preserving temporal consistency. Existing methods that…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Dohun Lee , Bryan S Kim , Geon Yeong Park , Jong Chul Ye

The spread of misinformation through synthetically generated yet realistic images and videos has become a significant problem, calling for robust manipulation detection methods. Despite the predominant effort of detecting face manipulation…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Ekraam Sabir , Jiaxin Cheng , Ayush Jaiswal , Wael AbdAlmageed , Iacopo Masi , Prem Natarajan

Text-to-image (T2I) customization aims to create images that embody specific visual concepts delineated in textual descriptions. However, existing works still face a main challenge, concept overfitting. To tackle this challenge, we first…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Weili Zeng , Yichao Yan , Qi Zhu , Zhuo Chen , Pengzhi Chu , Weiming Zhao , Xiaokang Yang

Existing works have advanced Text-to-Image (TTI) diffusion models for video editing in a one-shot learning manner. Despite their low requirements of data and computation, these methods might produce results of unsatisfied consistency with…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Zicheng Zhang , Bonan Li , Xuecheng Nie , Congying Han , Tiande Guo , Luoqi Liu

Text-guided 3D face synthesis has achieved remarkable results by leveraging text-to-image (T2I) diffusion models. However, most existing works focus solely on the direct generation, ignoring the editing, restricting them from synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Yunjie Wu , Yapeng Meng , Zhipeng Hu , Lincheng Li , Haoqian Wu , Kun Zhou , Weiwei Xu , Xin Yu

Leveraging Stable Diffusion for the generation of personalized portraits has emerged as a powerful and noteworthy tool, enabling users to create high-fidelity, custom character avatars based on their specific prompts. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Siying Cui , Jia Guo , Xiang An , Jiankang Deng , Yongle Zhao , Xinyu Wei , Ziyong Feng

Diffusion-based generative models have recently shown remarkable image and video editing capabilities. However, local video editing, particularly removal of small attributes like glasses, remains a challenge. Existing methods either alter…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Rotem Shalev-Arkushin , Aharon Azulay , Tavi Halperin , Eitan Richardson , Amit H. Bermano , Ohad Fried

Text-to-image models (T2I) such as StableDiffusion have been used to generate high quality images of people. However, due to the random nature of the generation process, the person has a different appearance e.g. pose, face, and clothing,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Soon Yau Cheong , Armin Mustafa , Andrew Gilbert

With the prosper of video diffusion models, down-stream applications like video editing have been significantly promoted without consuming much computational cost. One particular challenge in this task lies at the motion transfer process…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Ge Wang , Songlin Fan , Hangxu Liu , Quanjian Song , Hewei Wang , Jinfeng Xu

The rapid development of image generation and editing algorithms in recent years has enabled ordinary user to produce realistic images. However, the current AI painting ecosystem predominantly relies on text-driven diffusion models (T2I),…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Jiaming Chu , Lei Jin , Tao Wang , Junliang Xing , Jian Zhao

Recently audio-driven talking face video generation has attracted considerable attention. However, very few researches address the issue of emotional editing of these talking face videos with continuously controllable expressions, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhiyao Sun , Yu-Hui Wen , Tian Lv , Yanan Sun , Ziyang Zhang , Yaoyuan Wang , Yong-Jin Liu

Age transformation of facial images is a technique that edits age-related person's appearances while preserving the identity. Existing deep learning-based methods can reproduce natural age transformations; however, they only reproduce…

Graphics · Computer Science 2025-02-21 Taishi Ito , Yuki Endo , Yoshihiro Kanamori

Diffusion-based face swapping achieves state-of-the-art performance, yet it also exacerbates the potential harm of malicious face swapping to violate portraiture right or undermine personal reputation. This has spurred the development of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Yilong Huang , Songze Li