English
Related papers

Related papers: Ingredients: Blending Custom Photos with Video Dif…

200 papers

Face swapping transfers the identity of a source face to a target face while retaining the attributes like expression, pose, hair, and background of the target face. Advanced face swapping methods have achieved attractive results. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Runqi Wang , Yang Chen , Sijie Xu , Tianyao He , Wei Zhu , Dejia Song , Nemo Chen , Xu Tang , Yao Hu

A central goal in AI is to represent scenes as compositions of discrete objects, enabling fine-grained, controllable image and video generation. Yet leading diffusion models treat images holistically and rely on text conditioning, creating…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Adil Kaan Akan

Synthetic data has emerged as a practical alternative to authentic face datasets for training face recognition (FR) systems, especially as privacy and legal concerns increasingly restrict the use of real biometric data. Recent advances in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Fadi Boutros , Eduarda Caldeira , Tahar Chettaoui , Naser Damer

Image fusion seeks to seamlessly integrate foreground objects with background scenes, producing realistic and harmonious fused images. Unlike existing methods that directly insert objects into the background, adaptive and interactive fusion…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Junjia Huang , Pengxiang Yan , Jiyang Liu , Jie Wu , Zhao Wang , Yitong Wang , Liang Lin , Guanbin Li

Diffusion Handles is a novel approach to enabling 3D object edits on diffusion images. We accomplish these edits using existing pre-trained diffusion models, and 2D image depth estimation, without any fine-tuning or 3D object retrieval. The…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Karran Pandey , Paul Guerrero , Matheus Gadelha , Yannick Hold-Geoffroy , Karan Singh , Niloy Mitra

Recent advances in video insertion based on diffusion models are impressive. However, existing methods rely on complex control signals but struggle with subject consistency, limiting their practical applicability. In this paper, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Jinshu Chen , Xinghui Li , Xu Bai , Tianxiang Ma , Pengze Zhang , Zhuowei Chen , Gen Li , Lijie Liu , Songtao Zhao , Bingchuan Li , Qian He

Group portrait editing is highly desirable since users constantly want to add a person, delete a person, or manipulate existing persons. It is also challenging due to the intricate dynamics of human interactions and the diverse gestures. In…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Yuming Jiang , Nanxuan Zhao , Qing Liu , Krishna Kumar Singh , Shuai Yang , Chen Change Loy , Ziwei Liu

The rapid development of AI models has led to a growing emphasis on enhancing their capabilities for complex input data such as videos. While large-scale video datasets have been introduced to support this growth, the unique challenges of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yinjie Zhao , Heng Zhao , Bihan Wen , Yew-Soon Ong , Joey Tianyi Zhou

The rapid advancement of pretrained text-driven diffusion models has significantly enriched applications in image generation and editing. However, as the demand for personalized content editing increases, new challenges emerge especially…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Rui Jiang , Xinghe Fu , Guangcong Zheng , Teng Li , Taiping Yao , Xi Li

Diffusion models have achieved significant success in image and video generation. This motivates a growing interest in video editing tasks, where videos are edited according to provided text descriptions. However, most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Zhen Xing , Qi Dai , Zihao Zhang , Hui Zhang , Han Hu , Zuxuan Wu , Yu-Gang Jiang

Text-to-image diffusion models can generate diverse, high-fidelity images based on user-provided text prompts. Recent research has extended these models to support text-guided image editing. While text guidance is an intuitive editing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Jooyoung Choi , Yunjey Choi , Yunji Kim , Junho Kim , Sungroh Yoon

3D photography renders a static image into a video with appealing 3D visual effects. Existing approaches typically first conduct monocular depth estimation, then render the input frame to subsequent frames with various viewpoints, and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Xiaodong Wang , Chenfei Wu , Shengming Yin , Minheng Ni , Jianfeng Wang , Linjie Li , Zhengyuan Yang , Fan Yang , Lijuan Wang , Zicheng Liu , Yuejian Fang , Nan Duan

We make the distinction between (i) style transfer, in which a source image is manipulated to match the textures and colors of a target image, and (ii) essence transfer, in which one edits the source image to include high-level semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Hila Chefer , Sagie Benaim , Roni Paiss , Lior Wolf

Diffusion models have emerged as a powerful generative method for synthesizing high-quality and diverse set of images. In this paper, we propose a video generation method based on diffusion models, where the effects of motion are modeled in…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Kangfu Mei , Vishal M. Patel

Pose and body shape editing in a human image has received increasing attention. However, current methods often struggle with dataset biases and deteriorate realism and the person's identity when users make large edits. We propose a one-shot…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Yuta Okuyama , Yuki Endo , Yoshihiro Kanamori

Achieving flexible and high-fidelity identity-preserved image generation remains formidable, particularly with advanced Diffusion Transformers (DiTs) like FLUX. We introduce InfiniteYou (InfU), one of the earliest robust frameworks…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Liming Jiang , Qing Yan , Yumin Jia , Zichuan Liu , Hao Kang , Xin Lu

With the exponential growth in the usage of social media to share live updates about life, taking pictures has become an unavoidable phenomenon. Individuals unknowingly create a unique knowledge base with these images. The food images, in…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Nitish Nag , Bindu Rajanna , Ramesh Jain

Video object insertion is a critical task for dynamically inserting new objects into existing environments. Previous video generation methods focus primarily on synthesizing entire scenes while struggling with ensuring consistent object…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Xia Qi , Peishan Cong , Yichen Yao , Ziyi Wang , Yaoqin Ye , Yuexin Ma

Inverting visual representations within deep neural networks (DNNs) presents a challenging and important problem in the field of security and privacy for deep learning. The main goal is to invert the features of an unidentified target image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Sai Qian Zhang , Ziyun Li , Chuan Guo , Saeed Mahloujifar , Deeksha Dangwal , Edward Suh , Barbara De Salvo , Chiao Liu

Text-to-image personalization aims to teach a pre-trained diffusion model to reason about novel, user provided concepts, embedding them into new scenes guided by natural language prompts. However, current personalization approaches struggle…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Rinon Gal , Moab Arar , Yuval Atzmon , Amit H. Bermano , Gal Chechik , Daniel Cohen-Or