中文
相关论文

相关论文: Personalized Face Inpainting with Diffusion Models…

200 篇论文

Achieving ID-preserving text-to-video (T2V) generation remains challenging despite recent advances in diffusion-based models. Existing approaches often fail to capture fine-grained facial dynamics or maintain temporal identity coherence. To…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Qi Xie , Yongjia Ma , Donglin Di , Xuehao Gao , Xun Yang

Diffusion-based Image Editing (DIE) is an emerging research hot-spot, which often applies a semantic mask to control the target area for diffusion-based editing. However, most existing solutions obtain these masks via manual operations or…

计算机视觉与模式识别 · 计算机科学 2024-01-24 Siyu Zou , Jiji Tang , Yiyi Zhou , Jing He , Chaoyi Zhao , Rongsheng Zhang , Zhipeng Hu , Xiaoshuai Sun

Diffusion models have demonstrated impressive performance in various image generation, editing, enhancement and translation tasks. In particular, the pre-trained text-to-image stable diffusion models provide a potential solution to the…

计算机视觉与模式识别 · 计算机科学 2024-07-10 Tao Yang , Rongyuan Wu , Peiran Ren , Xuansong Xie , Lei Zhang

Multimodal editing large models have demonstrated powerful editing capabilities across diverse tasks. However, a persistent and long-standing limitation is the decline in facial identity (ID) consistency during realistic portrait editing.…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Yuran Dong , Hang Dai , Mang Ye

Drawing on recent advancements in diffusion models for text-to-image generation, identity-preserved personalization has made significant progress in accurately capturing specific identities with just a single reference image. However,…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Yi Wu , Ziqiang Li , Heliang Zheng , Chaoyue Wang , Bin Li

Recent advancements in personalized image generation using diffusion models have been noteworthy. However, existing methods suffer from inefficiencies due to the requirement for subject-specific fine-tuning. This computationally intensive…

计算机视觉与模式识别 · 计算机科学 2023-12-12 Xu Peng , Junwei Zhu , Boyuan Jiang , Ying Tai , Donghao Luo , Jiangning Zhang , Wei Lin , Taisong Jin , Chengjie Wang , Rongrong Ji

Blind face restoration aims to recover high-quality facial images from various unidentified sources of degradation, posing significant challenges due to the minimal information retrievable from the degraded images. Prior knowledge-based…

计算机视觉与模式识别 · 计算机科学 2024-12-31 Wanglong Lu , Jikai Wang , Tao Wang , Kaihao Zhang , Xianta Jiang , Hanli Zhao

Speech-driven 3D facial animation has been an attractive task in both academia and industry. Traditional methods mostly focus on learning a deterministic mapping from speech to animation. Recent approaches start to consider the…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Peng Chen , Xiaobao Wei , Ming Lu , Yitong Zhu , Naiming Yao , Xingyu Xiao , Hui Chen

We address the problem of learning person-specific facial priors from a small number (e.g., 20) of portrait photos of the same person. This enables us to edit this specific person's facial appearance, such as expression and lighting, while…

计算机视觉与模式识别 · 计算机科学 2023-04-14 Zheng Ding , Xuaner Zhang , Zhihao Xia , Lars Jebe , Zhuowen Tu , Xiuming Zhang

Face editing methods, essential for tasks like virtual avatars, digital human synthesis and identity preservation, have traditionally been built upon GAN-based techniques, while recent focus has shifted to diffusion-based models due to…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Mengting Wei , Tuomas Varanka , Yante Li , Xingxun Jiang , Huai-Qian Khor , Guoying Zhao

Face stylization refers to the transformation of a face into a specific portrait style. However, current methods require the use of example-based adaptation approaches to fine-tune pre-trained generative models so that they demand lots of…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Jin Liu , Huaibo Huang , Chao Jin , Ran He

Portrait animation aims to generate photo-realistic videos from a single source image by reenacting the expression and pose from a driving video. While early methods relied on 3D morphable models or feature warping techniques, they often…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Mallikarjun B. R. , Fei Yin , Vikram Voleti , Nikita Drobyshev , Maksim Lapin , Aaryaman Vasishta , Varun Jampani

Multiview diffusion models have rapidly emerged as a powerful tool for content creation with spatial consistency across viewpoints, offering rich visual realism without requiring explicit geometry and appearance representation. However,…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Hubert Kompanowski , Varun Jampani , Aaryaman Vasishta , Binh-Son Hua

Face swapping aims to seamlessly transfer a source facial identity onto a target while preserving target attributes such as pose and expression. Diffusion models, known for their superior generative capabilities, have recently shown promise…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Dailan He , Xiahong Wang , Shulun Wang , Guanglu Song , Bingqi Ma , Hao Shao , Yu Liu , Hongsheng Li

Speech-Driven Facial Animation (SDFA) has gained significant attention due to its applications in movies, video games, and virtual reality. However, most existing models are trained on single-language data, limiting their effectiveness in…

计算机视觉与模式识别 · 计算机科学 2026-04-20 Federico Nocentini , Kwanggyoon Seo , Qingju Liu , Claudio Ferrari , Stefano Berretti , David Ferman , Hyeongwoo Kim , Pablo Garrido , Akin Caliskan

Leveraging Stable Diffusion for the generation of personalized portraits has emerged as a powerful and noteworthy tool, enabling users to create high-fidelity, custom character avatars based on their specific prompts. However, existing…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Siying Cui , Jia Guo , Xiang An , Jiankang Deng , Yongle Zhao , Xinyu Wei , Ziyong Feng

Facial attribute editing aims to manipulate attributes on the human face, e.g., adding a mustache or changing the hair color. Existing approaches suffer from a serious compromise between correct attribute generation and preservation of the…

计算机视觉与模式识别 · 计算机科学 2020-07-14 Zhenliang He , Meina Kan , Jichao Zhang , Shiguang Shan

Diffusion-based approaches have recently achieved strong results in face swapping, offering improved visual quality over traditional GAN-based methods. However, even state-of-the-art models often suffer from fine-grained artifacts and poor…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Weston Bondurant , Arkaprava Sinha , Hieu Le , Srijan Das , Stephanie Schuckers

Generative diffusion models can serve as a prior which ensures that solutions of image restoration systems adhere to the manifold of natural images. However, for restoring facial images, a personalized prior is necessary to accurately…

计算机视觉与模式识别 · 计算机科学 2023-12-29 Pradyumna Chari , Sizhuo Ma , Daniil Ostashev , Achuta Kadambi , Gurunandan Krishnan , Jian Wang , Kfir Aberman

Diffusion models can synthesize realistic co-speech video from audio for various applications, such as video creation and virtual agents. However, existing diffusion-based methods are slow due to numerous denoising steps and costly…

计算机视觉与模式识别 · 计算机科学 2025-10-06 Beijia Lu , Ziyi Chen , Jing Xiao , Jun-Yan Zhu