English
Related papers

Related papers: Qffusion: Controllable Portrait Video Editing via …

200 papers

We present a novel task called online video editing, which is designed to edit \textbf{streaming} frames while maintaining temporal consistency. Unlike existing offline video editing assuming all frames are pre-established and accessible,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Feng Chen , Zhen Yang , Bohan Zhuang , Qi Wu

Text-guided image editing has recently experienced rapid development. However, simultaneously performing multiple editing actions on a single image, such as background replacement and specific subject attribute changes, while maintaining…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Pengzhi Li , QInxuan Huang , Yikang Ding , Zhiheng Li

In this paper, we address the problem of face aging: generating past or future facial images by incorporating age-related changes to the given face. Previous aging methods rely solely on human facial image datasets and are thus constrained…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Xiangyi Chen , Stéphane Lathuilière

Despite the great success of large-scale text-to-image diffusion models in image generation and image editing, existing methods still struggle to edit the layout of real images. Although a few works have been proposed to tackle this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Tao Xia , Yudi Zhang , Ting Liu Lei Zhang

We present a diffusion-based video editing framework, namely DiffusionAtlas, which can achieve both frame consistency and high fidelity in editing video object appearance. Despite the success in image editing, diffusion models still…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Shao-Yu Chang , Hwann-Tzong Chen , Tyng-Luh Liu

Diffusion models have revolutionized the field of content synthesis and editing. Recent models have replaced the traditional UNet architecture with the Diffusion Transformer (DiT), and employed flow-matching for improved training and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Omri Avrahami , Or Patashnik , Ohad Fried , Egor Nemchinov , Kfir Aberman , Dani Lischinski , Daniel Cohen-Or

Hairstyle transfer is a challenging task in the image editing field that modifies the hairstyle of a given face image while preserving its other appearance and background features. The existing hairstyle transfer approaches heavily rely on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Chaeyeon Chung , Sunghyun Park , Jeongho Kim , Jaegul Choo

Acquiring high-quality data for training discriminative models is a crucial yet challenging aspect of building effective predictive systems. In this paper, we present Diffusion Inversion, a simple yet effective method that leverages the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yongchao Zhou , Hshmat Sahak , Jimmy Ba

Facial video editing has become increasingly important for content creators, enabling the manipulation of facial expressions and attributes. However, existing models encounter challenges such as poor editing quality, high computational…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Tharun Anand , Aryan Garg , Kaushik Mitra

We introduce HunyuanPortrait, a diffusion-based condition control method that employs implicit representations for highly controllable and lifelike portrait animation. Given a single portrait image as an appearance reference and video clips…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Zunnan Xu , Zhentao Yu , Zixiang Zhou , Jun Zhou , Xiaoyu Jin , Fa-Ting Hong , Xiaozhong Ji , Junwei Zhu , Chengfei Cai , Shiyu Tang , Qin Lin , Xiu Li , Qinglin Lu

In latest years plethora of identity-preserving adapters for a personalized generation with diffusion models have been released. Their main disadvantage is that they are dominantly trained jointly with base diffusion models, which suffer…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Sergey Karpukhin , Vadim Titov , Andrey Kuznetsov , Aibek Alanov

Recent advancements in large-scale text-to-image diffusion models have enabled many applications in image editing. However, none of these methods have been able to edit the layout of single existing images. To address this gap, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Zhiyuan Zhang , Zhitong Huang , Jing Liao

Portrait Fidelity Generation is a prominent research area in generative models.Current methods face challenges in generating full-body images with low-resolution faces, especially in multi-ID photo phenomenon.To tackle these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Zhaoli Deng , Fanyi Wang , Junkang Zhang , Fan Chen , Meng Zhang , Wendong Zhang , Wen Liu , Zhenpeng Mi

For recent diffusion-based generative models, maintaining consistent content across a series of generated images, especially those containing subjects and complex details, presents a significant challenge. In this paper, we propose a new…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Yupeng Zhou , Daquan Zhou , Ming-Ming Cheng , Jiashi Feng , Qibin Hou

We propose a novel inference technique based on a pretrained diffusion model for text-conditional video generation. Our approach, called FIFO-Diffusion, is conceptually capable of generating infinitely long videos without additional…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Jihwan Kim , Junoh Kang , Jinyoung Choi , Bohyung Han

While diffusion models have achieved remarkable progress in style transfer tasks, existing methods typically rely on fine-tuning or optimizing pre-trained models during inference, leading to high computational costs and challenges in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Bo Huang , Wenlun Xu , Qizhuo Han , Haodong Jing , Ying Li

Facial attribute editing aims to modify target attributes while preserving attribute-irrelevant content and overall image fidelity. Existing GAN-based methods provide favorable controllability, but often suffer from weak alignment between…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Wenmin Huang , Weiqi Luo , Xiaochun Cao , Jiwu Huang

Video generation, while capable of generating realistic videos, is computationally expensive and slow, prohibiting real-time applications. In this paper, we observe that video latents encoded via an autoencoder under the Latent Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Dennis Menn , Chih-Hsien Chou

Recent advances in generative AI have significantly enhanced image and video editing, particularly in the context of text prompt control. State-of-the-art approaches predominantly rely on diffusion models to accomplish these tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Haoyu Ma , Shahin Mahdizadehaghdam , Bichen Wu , Zhipeng Fan , Yuchao Gu , Wenliang Zhao , Lior Shapira , Xiaohui Xie

While diffusion models have shown great potential in portrait generation, generating expressive, coherent, and controllable cinematic portrait videos remains a significant challenge. Existing intermediate signals for portrait generation,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Junyi Wang , Yudong Guo , Boyang Guo , Shengming Yang , Juyong Zhang