English
Related papers

Related papers: DiffusionRig: Learning Personalized Priors for Fac…

200 papers

The success of face recognition (FR) systems has led to serious privacy concerns due to potential unauthorized surveillance and user tracking on social networks. Existing methods for enhancing privacy fail to generate natural face images…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Liqin Wang , Qianyue Hu , Wei Lu , Xiangyang Luo

Facial Appearance Editing (FAE) aims to modify physical attributes, such as pose, expression and lighting, of human facial images while preserving attributes like identity and background, showing great importance in photograph. In spite of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Qilin Wang , Jiangning Zhang , Chengming Xu , Weijian Cao , Ying Tai , Yue Han , Yanhao Ge , Hong Gu , Chengjie Wang , Yanwei Fu

In human-centric content generation, the pre-trained text-to-image models struggle to produce user-wanted portrait images, which retain the identity of individuals while exhibiting diverse expressions. This paper introduces our efforts…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Renshuai Liu , Bowen Ma , Wei Zhang , Zhipeng Hu , Changjie Fan , Tangjie Lv , Yu Ding , Xuan Cheng

We introduce SynthLight, a diffusion model for portrait relighting. Our approach frames image relighting as a re-rendering problem, where pixels are transformed in response to changes in environmental lighting conditions. Using a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Sumit Chaturvedi , Mengwei Ren , Yannick Hold-Geoffroy , Jingyuan Liu , Julie Dorsey , Zhixin Shu

Recent diffusion-based methods have achieved impressive results on animating images of human subjects. However, most of that success has built on human-specific body pose representations and extensive training with labeled real videos. In…

Graphics · Computer Science 2025-03-21 Zeqi Gu , Difan Liu , Timothy Langlois , Matthew Fisher , Abe Davis

Modern cameras' performance in low-light conditions remains suboptimal due to fundamental limitations in photon shot noise and sensor read noise. Generative image restoration methods have shown promising results compared to traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Xijun Wang , Prateek Chennuri , Dilshan Godaliyadda , Yu Yuan , Bole Ma , Xingguang Zhang , Hamid R. Sheikh , Stanley Chan

Generative diffusion models can serve as a prior which ensures that solutions of image restoration systems adhere to the manifold of natural images. However, for restoring facial images, a personalized prior is necessary to accurately…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Pradyumna Chari , Sizhuo Ma , Daniil Ostashev , Achuta Kadambi , Gurunandan Krishnan , Jian Wang , Kfir Aberman

We present a novel framework for free-viewpoint facial performance relighting using diffusion-based image-to-image translation. Leveraging a subject-specific dataset containing diverse facial expressions captured under various lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Mingming He , Pascal Clausen , Ahmet Levent Taşel , Li Ma , Oliver Pilarski , Wenqi Xian , Laszlo Rikker , Xueming Yu , Ryan Burgert , Ning Yu , Paul Debevec

Image retouching aims to enhance the visual quality of photos. Considering the different aesthetic preferences of users, the target of retouching is subjective. However, current retouching methods mostly adopt deterministic models, which…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Zheng-Peng Duan , Jiawei zhang , Zheng Lin , Xin Jin , Dongqing Zou , Chunle Guo , Chongyi Li

We present a novel approach to face aging that addresses the limitations of current methods which treat aging as a global, homogeneous process. Existing techniques using GANs and diffusion models often condition generation on a reference…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Lais Isabelle Alves dos Santos , Julien Despois , Thibaut Chauffier , Sileye O. Ba , Giovanni Palma

Benefiting from the significant advancements in text-to-image diffusion models, research in personalized image generation, particularly customized portrait generation, has also made great strides recently. However, existing methods either…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Benxiang Zhai , Yifang Xu , Guofeng Zhang , Yang Li , Sidan Du

Privacy protection has become a top priority as the proliferation of AI techniques has led to widespread collection and misuse of personal data. Anonymization and visual identity information hiding are two important facial privacy…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Xiao He , Mingrui Zhu , Dongxin Chen , Nannan Wang , Xinbo Gao

Text-guided image editing has recently experienced rapid development. However, simultaneously performing multiple editing actions on a single image, such as background replacement and specific subject attribute changes, while maintaining…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Pengzhi Li , QInxuan Huang , Yikang Ding , Zhiheng Li

Despite significant advances in modeling image priors via diffusion models, 3D-aware image editing remains challenging, in part because the object is only specified via a single image. To tackle this challenge, we propose 3D-Fixup, a new…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Yen-Chi Cheng , Krishna Kumar Singh , Jae Shin Yoon , Alex Schwing , Liangyan Gui , Matheus Gadelha , Paul Guerrero , Nanxuan Zhao

Speech-driven 3D facial animation synthesis has been a challenging task both in industry and research. Recent methods mostly focus on deterministic deep learning methods meaning that given a speech input, the output is always the same.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Stefan Stan , Kazi Injamamul Haque , Zerrin Yumak

Synthetic face recognition (SFR) aims to generate synthetic face datasets that mimic the distribution of real face data, which allows for training face recognition models in a privacy-preserving manner. Despite the remarkable potential of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Shen Li , Jianqing Xu , Jiaying Wu , Miao Xiong , Ailin Deng , Jiazhen Ji , Yuge Huang , Wenjie Feng , Shouhong Ding , Bryan Hooi

Diffusion-based editing enables realistic modification of local image regions, making AI-generated content harder to detect. Existing AIGC detection benchmarks focus on classifying entire images, overlooking the localization of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Hai Ci , Ziheng Peng , Pei Yang , Yingxin Xuan , Mike Zheng Shou

Facial Beauty Prediction (FBP) is a challenging computer vision task due to its subjective nature and the subtle, holistic features that influence human perception. Prevailing methods, often based on deep convolutional networks or standard…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Djamel Eddine Boukhari , Ali chemsa

Face recognition poses serious privacy risks due to its reliance on sensitive and immutable biometric data. While modern systems mitigate privacy risks by mapping facial images to embeddings (commonly regarded as privacy-preserving), model…

Cryptography and Security · Computer Science 2026-05-04 Hanrui Wang , Shuo Wang , Chun-Shien Lu , Isao Echizen

Diffusion models have recently enabled precise and photorealistic facial editing across a wide range of semantic attributes. Beyond single-step modifications, a growing class of applications now demands the ability to analyze and track…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yule Zhu , Ping Liu , Zhedong Zheng , Wei Liu