English
Related papers

Related papers: Realistic and Efficient Face Swapping: A Unified A…

200 papers

In controllable generation tasks, flexibly manipulating the generated images to attain a desired appearance or structure based on a single input image cue remains a critical and longstanding challenge. Achieving this requires the effective…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xi Wang , Yichen Peng , Heng Fang , Yilin Wang , Haoran Xie , Xi Yang , Chuntao Li

Diffusion-based video editing have reached impressive quality and can transform either the global style, local structure, and attributes of given video inputs, following textual edit prompts. However, such solutions typically incur heavy…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Kumara Kahatapitiya , Adil Karjauv , Davide Abati , Fatih Porikli , Yuki M. Asano , Amirhossein Habibian

Despite the rapid advancement of unsupervised learning in visual representation, it requires training on large-scale datasets that demand costly data collection, and pose additional challenges due to concerns regarding data privacy.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 David Junhao Zhang , Mutian Xu , Chuhui Xue , Wenqing Zhang , Xiaoguang Han , Song Bai , Mike Zheng Shou

In this work, we propose a novel framework to enable diffusion models to adapt their generation quality based on real-time network bandwidth constraints. Traditional diffusion models produce high-fidelity images by performing a fixed number…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Xi Zhang , Hanwei Zhu , Yan Zhong , Jiamang Wang , Weisi Lin

With the rapid development of face recognition (FR) systems, the privacy of face images on social media is facing severe challenges due to the abuse of unauthorized FR systems. Some studies utilize adversarial attack techniques to defend…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Yuhao Sun , Lingyun Yu , Hongtao Xie , Jiaming Li , Yongdong Zhang

Current face anonymization techniques often depend on identity loss calculated by face recognition models, which can be inaccurate and unreliable. Additionally, many methods require supplementary data such as facial landmarks and masks to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Han-Wei Kung , Tuomas Varanka , Sanjay Saha , Terence Sim , Nicu Sebe

Diffusion Transformer (DiT) has emerged as the new trend of generative diffusion models on image generation. In view of extremely slow convergence in typical DiT, recent breakthroughs have been driven by mask strategy that significantly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Rui Zhu , Yingwei Pan , Yehao Li , Ting Yao , Zhenglong Sun , Tao Mei , Chang Wen Chen

Speech-driven 3D facial animation is important for many multimedia applications. Recent work has shown promise in using either Diffusion models or Transformer architectures for this task. However, their mere aggregation does not lead to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Zhiyuan Ma , Xiangyu Zhu , Guojun Qi , Chen Qian , Zhaoxiang Zhang , Zhen Lei

Diffusion probabilistic models (DPMs) have exhibited exceptional proficiency in generating visual media of outstanding quality and realism. Nonetheless, their potential in non-generative domains, such as face recognition, has yet to be…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Bowen Sun , Shibao Zheng

While modern diffusion models excel at generating diverse single images, extending this to sequential generation reveals a fundamental challenge: balancing narrative dynamism with multi-character coherence. Existing methods often falter at…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Qi Zhao , Jun Chen , Ivor Tsang , Guang Dai

Facial video editing has become increasingly important for content creators, enabling the manipulation of facial expressions and attributes. However, existing models encounter challenges such as poor editing quality, high computational…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Tharun Anand , Aryan Garg , Kaushik Mitra

We tackle the problem of generating highly realistic and plausible mirror reflections using diffusion-based generative models. We formulate this problem as an image inpainting task, allowing for more user control over the placement of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Ankit Dhiman , Manan Shah , Rishubh Parihar , Yash Bhalgat , Lokesh R Boregowda , R Venkatesh Babu

With the rise of large, publicly-available text-to-image diffusion models, text-guided real image editing has garnered much research attention recently. Existing methods tend to either rely on some form of per-instance or per-task…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Adham Elarabawy , Harish Kamath , Samuel Denton

Similar to facial beautification in real life, 3D virtual avatars require personalized customization to enhance their visual appeal, yet this area remains insufficiently explored. Although current 3D Gaussian editing methods can be adapted…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yiming Zhong , Xiaolin Zhang , Ligang Liu , Yao Zhao , Yunchao Wei

The rapid evolution of diffusion models has democratized face swapping but also raises concerns about privacy and identity security. Existing proactive defenses, often adapted from image editing attacks, prove ineffective in this context.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Liqin Wang , Qianyue Hu , Wei Lu , Xiangyang Luo

Diffusion models achieve remarkable quality in image generation, but at a cost. Iterative denoising requires many time steps to produce high fidelity images. We argue that the denoising process is crucially limited by an accumulation of the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Hui Lu , Albert ali Salah , Ronald Poppe

Diffusion models have achieved impressive performance on multi-focus image fusion (MFIF). However, a key challenge in applying diffusion models to the ill-posed MFIF problem is that defocus blur can make common symmetric geometric…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Bo Li , Tingting Bao , Lingling Zhang , Weiping Fu , Yaxian Wang , Jun Liu

Volumetric video relighting is essential for bringing captured performances into virtual worlds, but current approaches struggle to deliver temporally stable, production-ready results. Diffusion-based intrinsic decomposition methods show…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Elisabeth Jüttner , Janelle Pfeifer , Leona Krath , Stefan Korfhage , Hannah Dröge , Matthias B. Hullin , Markus Plack

Text-guided image generation and editing using diffusion models have achieved remarkable advancements. Among these, tuning-free methods have gained attention for their ability to perform edits without extensive model adjustments, offering…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Wenyi Mo , Tianyu Zhang , Yalong Bai , Bing Su , Ji-Rong Wen

Diffusion models gain increasing popularity for their generative capabilities. Recently, there have been surging needs to generate customized images by inverting diffusion models from exemplar images, and existing inversion methods mainly…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Ziqi Huang , Tianxing Wu , Yuming Jiang , Kelvin C. K. Chan , Ziwei Liu