English
Related papers

Related papers: Learning Feature-Preserving Portrait Editing from …

200 papers

State-of-the-art diffusion models can generate highly realistic images based on various conditioning like text, segmentation, and depth. However, an essential aspect often overlooked is the specific camera geometry used during image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Andrey Voynov , Amir Hertz , Moab Arar , Shlomi Fruchter , Daniel Cohen-Or

Few-shot image generation aims to generate images of high quality and great diversity with limited data. However, it is difficult for modern GANs to avoid overfitting when trained on only a few images. The discriminator can easily remember…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

Traditional face editing methods often require a number of sophisticated and task specific algorithms to be applied one after the other --- a process that is tedious, fragile, and computationally intensive. In this paper, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Zhixin Shu , Ersin Yumer , Sunil Hadap , Kalyan Sunkavalli , Eli Shechtman , Dimitris Samaras

Traditional point-based image editing methods rely on iterative latent optimization or geometric transformations, which are either inefficient in their processing or fail to capture the semantic relationships within the image. These methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Biao Yang , Muqi Huang , Yuhui Zhang , Yun Xiong , Kun Zhou , Xi Chen , Shiyang Zhou , Huishuai Bao , Chuan Li , Feng Shi , Hualei Liu

Large text-to-image models have revolutionized the ability to generate imagery using natural language. However, particularly unique or personal visual concepts, such as pets and furniture, will not be captured by the original model. This…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Xingzhe He , Zhiwen Cao , Nicholas Kolkin , Lantao Yu , Kun Wan , Helge Rhodin , Ratheesh Kalarot

In recent years, the field of image generation has witnessed significant advancements, particularly in fine-tuning methods that align models with universal human preferences. This paper explores the critical role of preference data in the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Lingfan Zhang , Chen Liu , Chengming Xu , Kai Hu , Donghao Luo , Chengjie Wang , Yanwei Fu , Yuan Yao

Image-based virtual try-on is an increasingly important task for online shopping. It aims to synthesize images of a specific person wearing a specified garment. Diffusion model-based approaches have recently become popular, as they are…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Xu Yang , Changxing Ding , Zhibin Hong , Junhao Huang , Jin Tao , Xiangmin Xu

This paper tackles unpaired image enhancement, a task of learning a mapping function which transforms input images into enhanced images in the absence of input-output image pairs. Our method is based on generative adversarial networks…

Computer Vision and Pattern Recognition · Computer Science 2019-12-18 Satoshi Kosugi , Toshihiko Yamasaki

Text-to-image diffusion models have emerged as an evolutionary for producing creative content in image synthesis. Based on the impressive generation abilities of these models, instruction-guided diffusion models can edit images with simple…

Cryptography and Security · Computer Science 2024-08-21 Ruoxi Chen , Haibo Jin , Yixin Liu , Jinyin Chen , Haohan Wang , Lichao Sun

In this paper, we make the first attempt to align diffusion models for image inpainting with human aesthetic standards via a reinforcement learning framework, significantly improving the quality and visual appeal of inpainted images.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Kendong Liu , Zhiyu Zhu , Chuanhao Li , Hui Liu , Huanqiang Zeng , Junhui Hou

The advent of generative AI models has revolutionized digital content creation, yet it introduces challenges in maintaining copyright integrity due to generative parroting, where models mimic their training data too closely. Our research…

Machine Learning · Computer Science 2024-06-21 Saeid Asgari Taghanaki , Joseph Lambourne

In this paper, we are interested in generating fine-grained cartoon faces for various groups. We assume that one of these groups consists of sufficient training data while the others only contain few samples. Although the cartoon faces of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Nan Zhuang , Cheng Yang

We introduce a novel self-supervised learning method based on adversarial training. Our objective is to train a discriminator network to distinguish real images from images with synthetic artifacts, and then to extract features from its…

Computer Vision and Pattern Recognition · Computer Science 2018-06-14 Simon Jenni , Paolo Favaro

While generative models produce high-quality images of concepts learned from a large-scale database, a user often wishes to synthesize instantiations of their own concepts (for example, their family, pets, or items). Can we teach a model to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Nupur Kumari , Bingliang Zhang , Richard Zhang , Eli Shechtman , Jun-Yan Zhu

Recent works have explored text-guided image editing using diffusion models and generated edited images based on text prompts. However, the models struggle to accurately locate the regions to be edited and faithfully perform precise edits.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Qian Wang , Biao Zhang , Michael Birsak , Peter Wonka

The use of computational methods to evaluate aesthetics in photography has gained interest in recent years due to the popularization of convolutional neural networks and the availability of new annotated datasets. Most studies in this area…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Carlos Rodríguez-Pardo , Hakan Bilen

We address the task of multi-view image editing from sparse input views, where the inputs can be seen as a mix of images capturing the scene from different viewpoints. The goal is to modify the scene according to a textual instruction while…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Daniel Gilo , Or Litany

This paper introduces a novel dataset construction pipeline that samples pairs of frames from videos and uses multimodal large language models (MLLMs) to generate editing instructions for training instruction-based image manipulation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Mingdeng Cao , Xuaner Zhang , Yinqiang Zheng , Zhihao Xia

Existing methods for preference tuning of text-to-image (T2I) diffusion models often rely on computationally expensive generation steps to create positive and negative pairs of images. These approaches frequently yield training pairs that…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Sanjana Reddy , Ishaan Malhi , Sally Ma , Praneet Dutta

Hiding data using neural networks (i.e., neural steganography) has achieved remarkable success across both discriminative classifiers and generative adversarial networks. However, the potential of data hiding in diffusion models remains…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Haoyu Chen , Yunqiao Yang , Nan Zhong , Kede Ma