English
Related papers

Related papers: DiffFace: Diffusion-based Face Swapping with Facia…

200 papers

In this work, we address a challenge in video inpainting: reconstructing occluded regions in dynamic, real-world scenarios. Motivated by the need for continuous human motion monitoring in healthcare settings, where facial features are…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zheyan Zhang , Diego Klabjan , Renee CB Manworren

Image-based head swapping task aims to stitch a source head to another source body flawlessly. This seldom-studied task faces two major challenges: 1) Preserving the head and body from various sources while generating a seamless transition…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Qinghe Wang , Lijie Liu , Miao Hua , Pengfei Zhu , Wangmeng Zuo , Qinghua Hu , Huchuan Lu , Bing Cao

Conditional diffusion models have exhibited superior performance in high-fidelity text-guided visual generation and editing. Nevertheless, prevailing text-guided visual diffusion models primarily focus on incorporating text-visual…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Ling Yang , Zhilong Zhang , Zhaochen Yu , Jingwei Liu , Minkai Xu , Stefano Ermon , Bin Cui

To better preserve an individual's identity, face restoration has evolved from reference-free to reference-based approaches, which leverage high-quality reference images of the same identity to enhance identity fidelity in the restored…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Teer Song , Yue Zhang , Yu Tian , Ziyang Wang , Xianlin Zhang , Guixuan Zhang , Xuan Liu , Xueming Li , Yasen Zhang

Video face restoration aims to enhance degraded face videos into high-quality results with realistic facial details, stable identity, and temporal coherence. Recent diffusion-based methods have brought strong generative priors to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Zheng Chen , Bowen Chai , Rongjun Gao , Mingtao Nie , Xi Li , Bingnan Duan , Jianping Fang , Xiaohong Liu , Linghe Kong , Yulun Zhang

The objective for establishing dense correspondence between paired images consists of two terms: a data term and a prior term. While conventional techniques focused on defining hand-designed prior terms, which are difficult to formulate,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Jisu Nam , Gyuseong Lee , Sunwoo Kim , Hyeonsu Kim , Hyoungwon Cho , Seyeon Kim , Seungryong Kim

Denosing diffusion model, as a generative model, has received a lot of attention in the field of image generation recently, thanks to its powerful generation capability. However, diffusion models have not yet received sufficient research in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 ZiHan Cao , ShiQi Cao , Xiao Wu , JunMing Hou , Ran Ran , Liang-Jian Deng

We present a new multi-modal face image generation method that converts a text prompt and a visual input, such as a semantic mask or scribble map, into a photo-realistic face image. To do this, we combine the strengths of Generative…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Jihyun Kim , Changjae Oh , Hoseok Do , Soohyun Kim , Kwanghoon Sohn

Hairstyle transfer is a challenging task in the image editing field that modifies the hairstyle of a given face image while preserving its other appearance and background features. The existing hairstyle transfer approaches heavily rely on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Chaeyeon Chung , Sunghyun Park , Jeongho Kim , Jaegul Choo

Our goal is to develop fine-grained real-image editing methods suitable for real-world applications. In this paper, we first summarize four requirements for these methods and propose a novel diffusion-based image editing framework with…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Naoki Matsunaga , Masato Ishii , Akio Hayakawa , Kenji Suzuki , Takuya Narihira

The proliferation of diffusion-based deepfake technologies poses significant risks for unauthorized and unethical facial image manipulation. While traditional countermeasures have primarily focused on passive detection methods, this paper…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Hon Ming Yam , Zhongliang Guo , Chun Pong Lau

With the growing interest in foundation models for brain signals, graph-based pretraining has emerged as a promising paradigm for learning transferable representations from connectome data. However, existing contrastive and masked…

Machine Learning · Computer Science 2026-03-10 Xinxu Wei , Rong Zhou , Lifang He , Yu Zhang

Denoising diffusion probabilistic models (DDPMs) have been proven capable of synthesizing high-quality images with remarkable diversity when trained on large amounts of data. Typical diffusion models and modern large-scale conditional…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

Denoising diffusion probabilistic models that were initially proposed for realistic image generation have recently shown success in various perception tasks (e.g., object detection and image segmentation) and are increasingly gaining…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Runyang Feng , Yixing Gao , Tze Ho Elden Tse , Xueqing Ma , Hyung Jin Chang

Guidance serves as a key concept in diffusion models, yet its effectiveness is often limited by the need for extra data annotation or classifier pretraining. That is why guidance was harnessed from self-supervised learning backbones, like…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Vincent Tao Hu , Yunlu Chen , Mathilde Caron , Yuki M. Asano , Cees G. M. Snoek , Bjorn Ommer

Preserving face identity is a critical yet persistent challenge in diffusion-based image restoration. While reference faces offer a path forward, existing reference-based methods often fail to fully exploit their potential. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Mo Zhou , Keren Ye , Viraj Shah , Kangfu Mei , Mauricio Delbracio , Peyman Milanfar , Vishal M. Patel , Hossein Talebi

Image generative models, particularly diffusion-based models, have surged in popularity due to their remarkable ability to synthesize highly realistic images. However, since these models are data-driven, they inherit biases from the…

Machine Learning · Computer Science 2025-03-18 Lin-Chun Huang , Ching Chieh Tsao , Fang-Yi Su , Jung-Hsien Chiang

We consider the problem of face swapping in images, where an input identity is transformed into a target identity while preserving pose, facial expression, and lighting. To perform this mapping, we use convolutional neural networks trained…

Computer Vision and Pattern Recognition · Computer Science 2017-07-28 Iryna Korshunova , Wenzhe Shi , Joni Dambre , Lucas Theis

We introduce a novel approach to single-view face relighting in the wild, addressing challenges such as global illumination and cast shadows. A common scheme in recent methods involves intrinsically decomposing an input image into 3D shape,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Puntawat Ponglertnapakorn , Nontawat Tritrong , Supasorn Suwajanakorn

Generative models have advanced significantly in realistic image synthesis, with diffusion models excelling in quality and stability. Recent multi-view diffusion models improve 3D-aware street view generation, but they struggle to produce…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Ji Li , Zhiwei Li , Shihao Li , Zhenjiang Yu , Boyang Wang , Haiou Liu