English
Related papers

Related papers: DVFace: Spatio-Temporal Dual-Prior Diffusion for V…

200 papers

Face swapping aims to generate results that combine the identity from the source with attributes from the target. Existing methods primarily focus on image-based face swapping. When processing videos, each frame is handled independently,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Xu Chen , Keke He , Junwei Zhu , Yanhao Ge , Wei Li , Chengjie Wang

Portrait animation aims to generate photo-realistic videos from a single source image by reenacting the expression and pose from a driving video. While early methods relied on 3D morphable models or feature warping techniques, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Mallikarjun B. R. , Fei Yin , Vikram Voleti , Nikita Drobyshev , Maksim Lapin , Aaryaman Vasishta , Varun Jampani

The remarkable generative capabilities of diffusion models have motivated extensive research in both image and video editing. Compared to video editing which faces additional challenges in the time dimension, image editing has witnessed the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Wenqi Ouyang , Yi Dong , Lei Yang , Jianlou Si , Xingang Pan

Although diffusion-based zero-shot image restoration and enhancement methods have achieved great success, applying them to video restoration or enhancement will lead to severe temporal flickering. In this paper, we propose the first…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Cong Cao , Huanjing Yue , Shangbin Xie , Xin Liu , Jingyu Yang

Recently, latent diffusion models has demonstrated promising performance in real-world video super-resolution (VSR) task, which can reconstruct high-quality videos from distorted low-resolution input through multiple diffusion steps.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Hanting Li , Huaao Tang , Jianhong Han , Tianxiong Zhou , Jiulong Cui , Haizhen Xie , Yan Chen , Jie Hu

Text-conditioned image editing has greatly benefitted from the advancements in Image Diffusion Models. However, extending these techniques to facial video editing introduces challenges in preserving facial identity throughout the source…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Huanghao Yin , Shenkun Xu , Kanle Shi , Junhai Yong , Bin Wang

Existing video frame interpolation (VFI) methods often adopt a frame-centric approach, processing videos as independent short segments (e.g., triplets), which leads to temporal inconsistencies and motion artifacts. To overcome this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Xinyu Peng , Han Li , Yuyang Huang , Ziyang Zheng , Yaoming Wang , Xin Chen , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong

As a very common type of video, face videos often appear in movies, talk shows, live broadcasts, and other scenes. Real-world online videos are often plagued by degradations such as blurring and quantization noise, due to the high…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yutong Wang , Jiajie Teng , Jiajiong Cao , Yuming Li , Chenguang Ma , Hongteng Xu , Dixin Luo

Facial Appearance Editing (FAE) aims to modify physical attributes, such as pose, expression and lighting, of human facial images while preserving attributes like identity and background, showing great importance in photograph. In spite of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Qilin Wang , Jiangning Zhang , Chengming Xu , Weijian Cao , Ying Tai , Yue Han , Yanhao Ge , Hong Gu , Chengjie Wang , Yanwei Fu

Face restoration has achieved remarkable advancements through the years of development. However, ensuring that restored facial images exhibit high fidelity, preserve authentic features, and avoid introducing artifacts or biases remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jingkai Wang , Wu Miao , Jue Gong , Zheng Chen , Xing Liu , Hong Gu , Yutong Liu , Yulun Zhang

Generating realistic cast shadows for inserted foreground objects is a crucial yet challenging problem in image composition, where maintaining geometric consistency of shadow and object in complex scenes remains difficult due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jing Li , Jing Zhang

Inspired by the impressive performance of recent face image editing methods, several studies have been naturally proposed to extend these methods to the face video editing task. One of the main challenges here is temporal consistency among…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Gyeongman Kim , Hajin Shim , Hyunsu Kim , Yunjey Choi , Junho Kim , Eunho Yang

Diffusion models have shown great potential in generating realistic image detail. However, adapting these models to video super-resolution (VSR) remains challenging due to their inherent stochasticity and lack of temporal modeling. Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yong Liu , Jinshan Pan , Yinchuan Li , Qingji Dong , Chao Zhu , Yu Guo , Fei Wang

Modern text-to-video (T2V) diffusion models can synthesize visually compelling clips, yet they remain brittle at fine-scale structure: even state-of-the-art generators often produce distorted faces and hands, warped backgrounds, and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Tejas Panambur , Ishan Rajendrakumar Dave , Chongjian Ge , Ersin Yumer , Xue Bai

Image restoration is a classic low-level problem aimed at recovering high-quality images from low-quality images with various degradations such as blur, noise, rain, haze, etc. However, due to the inherent complexity and non-uniqueness of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuhong Zhang , Hengsheng Zhang , Xinning Chai , Zhengxue Cheng , Rong Xie , Li Song , Wenjun Zhang

Blind face restoration is an important task in computer vision and has gained significant attention due to its wide-range applications. Previous works mainly exploit facial priors to restore face images and have demonstrated high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Xiaoxu Chen , Jingfan Tan , Tao Wang , Kaihao Zhang , Wenhan Luo , Xiaochun Cao

Face Restoration (FR) is a crucial area within image and video processing, focusing on reconstructing high-quality portraits from degraded inputs. Despite advancements in image FR, video FR remains relatively under-explored, primarily due…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Zhiyao Wang , Xu Chen , Chengming Xu , Junwei Zhu , Xiaobin Hu , Jiangning Zhang , Chengjie Wang , Yuqi Liu , Yiyi Zhou , Rongrong Ji

Due to storage and bandwidth limitations, videos transmitted over the Internet often exhibit low quality, characterized by low-resolution and compression artifacts. Although video super-resolution (VSR) is an efficient video enhancing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Hongyu An , Xinfeng Zhang , Shijie Zhao , Li Zhang , Ruiqin Xiong

Video restoration aims to reconstruct high quality video sequences from low quality inputs, addressing tasks such as super resolution, denoising, and deblurring. Traditional regression based methods often produce unrealistic details and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Sicheng Gao , Nancy Mehta , Zongwei Wu , Radu Timofte

Video Face Swapping (VFS) requires seamlessly injecting a source identity into a target video while meticulously preserving the original pose, expression, lighting, background, and dynamic information. Existing methods struggle to maintain…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Xu Guo , Fulong Ye , Xinghui Li , Pengqi Tu , Pengze Zhang , Qichao Sun , Songtao Zhao , Xiangwang Hou , Qian He