English
Related papers

Related papers: Language Guided Fashion Image Manipulation with Fe…

200 papers

StyleGAN2 is a state-of-the-art network in generating realistic images. Besides, it was explicitly trained to have disentangled directions in latent space, which allows efficient image manipulation by varying latent factors. Editing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Yuri Viazovetskyi , Vladimir Ivashkin , Evgeny Kashin

We introduce a general-purpose conditioning method for neural networks called FiLM: Feature-wise Linear Modulation. FiLM layers influence neural network computation via a simple, feature-wise affine transformation based on conditioning…

Computer Vision and Pattern Recognition · Computer Science 2017-12-20 Ethan Perez , Florian Strub , Harm de Vries , Vincent Dumoulin , Aaron Courville

Deep generative models like StyleGAN hold the promise of semantic image editing: modifying images by their content, rather than their pixel values. Unfortunately, working with arbitrary images requires inverting the StyleGAN generator,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Yohan Poirier-Ginter , Alexandre Lessard , Ryan Smith , Jean-François Lalonde

Recently, researchers have proposed powerful systems for generating and manipulating images using natural language instructions. However, it is difficult to precisely specify many common classes of image transformations with text alone. For…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Alec Helbling , Seongmin Lee , Polo Chau

Building facial analysis systems that generalize to extreme variations in lighting and facial expressions is a challenging problem that can potentially be alleviated using natural-looking synthetic data. Towards that, we propose LEGAN, a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Sandipan Banerjee , Ajjen Joshi , Prashant Mahajan , Sneha Bhattacharya , Survi Kyal , Taniya Mishra

Recent studies have shown that StyleGANs provide promising prior models for downstream tasks on image synthesis and editing. However, since the latent codes of StyleGANs are designed to control global styles, it is hard to achieve a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yichun Shi , Xiao Yang , Yangyue Wan , Xiaohui Shen

In recent years, text-guided image manipulation has gained increasing attention in the multimedia and computer vision community. The input to conditional image generation has evolved from image-only to multimodality. In this paper, we study…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Tianhao Zhang , Hung-Yu Tseng , Lu Jiang , Weilong Yang , Honglak Lee , Irfan Essa

Recently, a surge of face editing techniques have been proposed to employ the pretrained StyleGAN for semantic manipulation. To successfully edit a real image, one must first convert the input image into StyleGAN's latent variables.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Yin Yu , Ghasedi Kamran , Wu HsiangTao , Yang Jiaolong , Tong Xi , Fu Yun

Despite the recent success of GANs in synthesizing images conditioned on inputs such as a user sketch, text, or semantic labels, manipulating the high-level attributes of an existing natural photograph with GANs is challenging for two…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 David Bau , Hendrik Strobelt , William Peebles , Jonas Wulff , Bolei Zhou , Jun-Yan Zhu , Antonio Torralba

Leveraging StyleGAN's expressivity and its disentangled latent codes, existing methods can achieve realistic editing of different visual attributes such as age and gender of facial images. An intriguing yet challenging problem arises: Can…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Yingchen Yu , Fangneng Zhan , Rongliang Wu , Jiahui Zhang , Shijian Lu , Miaomiao Cui , Xuansong Xie , Xian-Sheng Hua , Chunyan Miao

Image manipulation can be considered a special case of image generation where the image to be produced is a modification of an existing image. Image generation and manipulation have been, for the most part, tasks that operate on raw pixels.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Helisa Dhamo , Azade Farshad , Iro Laina , Nassir Navab , Gregory D. Hager , Federico Tombari , Christian Rupprecht

Automatic image editing has great demands because of its numerous applications, and the use of natural language instructions is essential to achieving flexible and intuitive editing as the user imagines. A pioneering work in text-driven…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Tsuyoshi Baba , Kosuke Nishida , Kyosuke Nishida

Interactive fashion image manipulation, which enables users to edit images with sketches and color strokes, is an interesting research problem with great application value. Existing works often treat it as a general inpainting task and do…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Haoye Dong , Xiaodan Liang , Yixuan Zhang , Xujie Zhang , Zhenyu Xie , Bowen Wu , Ziqi Zhang , Xiaohui Shen , Jian Yin

In this paper, we propose a novel controllable text-to-image generative adversarial network (ControlGAN), which can effectively synthesise high-quality images and also control parts of the image generation according to natural language…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Bowen Li , Xiaojuan Qi , Thomas Lukasiewicz , Philip H. S. Torr

Can a generative model be trained to produce images from a specific domain, guided by a text prompt only, without seeing any image? In other words: can an image generator be trained "blindly"? Leveraging the semantic power of large scale…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Rinon Gal , Or Patashnik , Haggai Maron , Gal Chechik , Daniel Cohen-Or

Photo-realistic re-rendering of a human from a single image with explicit control over body pose, shape and appearance enables a wide range of applications, such as human appearance transfer, virtual try-on, motion imitation, and novel view…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Kripasindhu Sarkar , Vladislav Golyanik , Lingjie Liu , Christian Theobalt

Facial image manipulation has achieved great progress in recent years. However, previous methods either operate on a predefined set of face attributes or leave users little freedom to interactively manipulate images. To overcome these…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Cheng-Han Lee , Ziwei Liu , Lingyun Wu , Ping Luo

Editing of portrait images is a very popular and important research topic with a large variety of applications. For ease of use, control should be provided via a semantically meaningful parameterization that is akin to computer animation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Ayush Tewari , Mohamed Elgharib , Mallikarjun B R. , Florian Bernard , Hans-Peter Seidel , Patrick Pérez , Michael Zollhöfer , Christian Theobalt

Facial stylization aims to transform facial images into appealing, high-quality stylized portraits, with the critical challenge of accurately learning the target style while maintaining content consistency with the original image. Although…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Zhanyi Lu , Yue Zhou

Facial expression manipulation aims to change human facial expressions without affecting face recognition. In order to transform the facial expressions to target expressions, previous methods relied on expression labels to guide the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Dongya Sun , Yunfei Hu , Xianzhe Zhang , Yingsong Hu