English
Related papers

Related papers: IR-GAN: Image Manipulation with Linguistic Instruc…

200 papers

Low-light image enhancement exhibits an ill-posed nature, as a given image may have many enhanced versions, yet recent studies focus on building a deterministic mapping from input to an enhanced version. In contrast, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Xiaopeng Sun , Muxingzi Li , Tianyu He , Lubin Fan

The Visual Dialogue task requires an agent to engage in a conversation about an image with a human. It represents an extension of the Visual Question Answering task in that the agent needs to answer a question about an image, but it needs…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Qi Wu , Peng Wang , Chunhua Shen , Ian Reid , Anton van den Hengel

Recently, several methods based on generative adversarial network (GAN) have been proposed for the task of aligning cross-domain images or learning a joint distribution of cross-domain images. One of the methods is to use conditional GAN…

Computer Vision and Pattern Recognition · Computer Science 2017-07-06 Xudong Mao , Qing Li , Haoran Xie

We propose a novel lightweight generative adversarial network for efficient image manipulation using natural language descriptions. To achieve this, a new word-level discriminator is proposed, which provides the generator with fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Bowen Li , Xiaojuan Qi , Philip H. S. Torr , Thomas Lukasiewicz

Generating iris images which look realistic is both an interesting and challenging problem. Most of the classical statistical models are not powerful enough to capture the complicated texture representation in iris images, and therefore…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Shervin Minaee , Amirali Abdolrashidi

We propose a unified Generative Adversarial Network (GAN) for controllable image-to-image translation, i.e., transferring an image from a source to a target domain guided by controllable structures. In addition to conditioning on a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Hao Tang , Hong Liu , Nicu Sebe

In recent years, Generative Adversarial Networks (GANs) have improved steadily towards generating increasingly impressive real-world images. It is useful to steer the image generation process for purposes such as content creation. This can…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 David Stap , Maurits Bleeker , Sarah Ibrahimi , Maartje ter Hoeve

Generation of photo-realistic images, semantic editing and representation learning are a few of many potential applications of high resolution generative models. Recent progress in GANs have established them as an excellent choice for such…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Partha Ghosh , Dominik Zietlow , Michael J. Black , Larry S. Davis , Xiaochen Hu

Neural Image Classifiers are effective but inherently hard to interpret and susceptible to adversarial attacks. Solutions to both problems exist, among others, in the form of counterfactual examples generation to enhance explainability or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Rafael Bischof , Florian Scheidegger , Michael A. Kraus , A. Cristiano I. Malossi

Recently there has been an enormous interest in generative models for images in deep learning. In pursuit of this, Generative Adversarial Networks (GAN) and Variational Auto-Encoder (VAE) have surfaced as two most prominent and popular…

Computer Vision and Pattern Recognition · Computer Science 2017-01-18 Mahesh Gorijala , Ambedkar Dukkipati

In recent years, Generative Adversarial Networks (GANs) have seen significant advancements, leading to their widespread adoption across various fields. The original GAN architecture enables the generation of images without any specific…

Machine Learning · Computer Science 2024-09-04 Anis Bourou , Valérie Mezger , Auguste Genovesio

Building on top of the success of generative adversarial networks (GANs), conditional GANs attempt to better direct the data generation process by conditioning with certain additional information. Inspired by the most recent AC-GAN, in this…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Chengcheng Li , Zi Wang , Hairong Qi

In this paper, we address the task of semantic-guided image generation. One challenge common to most existing image-level generation methods is the difficulty in generating small objects and detailed local textures. To address this, in this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Hao Tang , Ling Shao , Philip H. S. Torr , Nicu Sebe

Semantic segmentation is one of the basic topics in computer vision, it aims to assign semantic labels to every pixel of an image. Unbalanced semantic label distribution could have a negative influence on segmentation accuracy. In this…

Computer Vision and Pattern Recognition · Computer Science 2019-11-27 Shuangting Liu , Jiaqi Zhang , Yuxin Chen , Yifan Liu , Zengchang Qin , Tao Wan

Conditional Generative Adversarial Networks (GANs) for cross-domain image-to-image translation have made much progress recently. Depending on the task complexity, thousands to millions of labeled image pairs are needed to train a…

Computer Vision and Pattern Recognition · Computer Science 2018-10-12 Zili Yi , Hao Zhang , Ping Tan , Minglun Gong

Image classification datasets are often imbalanced, characteristic that negatively affects the accuracy of deep-learning classifiers. In this work we propose balancing GAN (BAGAN) as an augmentation tool to restore balance in imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2018-06-06 Giovanni Mariani , Florian Scheidegger , Roxana Istrate , Costas Bekas , Cristiano Malossi

Content creation and image editing can benefit from flexible user controls. A common intermediate representation for conditional image generation is a semantic map, that has information of objects present in the image. When compared to raw…

Artificial Intelligence · Computer Science 2024-01-25 Chandrakanth Gudavalli , Erik Rosten , Lakshmanan Nataraj , Shivkumar Chandrasekaran , B. S. Manjunath

While recent advances in image editing have enabled impressive visual synthesis capabilities, current methods remain constrained by explicit textual instructions and limited editing operations, lacking deep comprehension of implicit user…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Dong Zhang , Lingfeng He , Rui Yan , Fei Shen , Jinhui Tang

This paper presents instruct-imagen, a model that tackles heterogeneous image generation tasks and generalizes across unseen tasks. We introduce *multi-modal instruction* for image generation, a task representation articulating a range of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Hexiang Hu , Kelvin C. K. Chan , Yu-Chuan Su , Wenhu Chen , Yandong Li , Kihyuk Sohn , Yang Zhao , Xue Ben , Boqing Gong , William Cohen , Ming-Wei Chang , Xuhui Jia

As a challenging task, text-to-image generation aims to generate photo-realistic and semantically consistent images according to the given text descriptions. Existing methods mainly extract the text information from only one sentence to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Xintian Wu , Hanbin Zhao , Liangli Zheng , Shouhong Ding , Xi Li