English
Related papers

Related papers: Unsupervised Attention-guided Image to Image Trans…

200 papers

Existing approaches for unsupervised metric learning focus on exploring self-supervision information within the input image itself. We observe that, when analyzing images, human eyes often compare images against each other instead of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Yang Li , Shichao Kan , Zhihai He

The task of unpaired image-to-image translation is highly challenging due to the lack of explicit cross-domain pairs of instances. We consider here diverse image translation (DIT), an even more challenging setting in which an image can have…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Yaxing Wang , Abel Gonzalez-Garcia , Joost van de Weijer , Luis Herranz

Current image-to-image translations do not control the output domain beyond the classes used during training, nor do they interpolate between different domains well, leading to implausible results. This limitation largely arises because…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Kunhee Kim , Sanghun Park , Eunyeong Jeon , Taehun Kim , Daijin Kim

Attention mechanisms have attracted considerable interest in image captioning because of its powerful performance. Existing attention-based models use feedback information from the caption generator as guidance to determine which of the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-11 Zhihao Zhu , Zhan Xue , Zejian Yuan

Natural language instructions are a powerful interface for editing the outputs of text-to-image diffusion models. However, several challenges need to be addressed: 1) underspecification (the need to model the implicit meaning of…

Computation and Language · Computer Science 2023-10-31 Tuhin Chakrabarty , Kanishk Singh , Arkadiy Saakyan , Smaranda Muresan

In the last few years, unpaired image-to-image translation has witnessed remarkable progress. Although the latest methods are able to generate realistic images, they crucially rely on a large number of labeled images. Recently, some methods…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Yaxing Wang , Salman Khan , Abel Gonzalez-Garcia , Joost van de Weijer , Fahad Shahbaz Khan

Visual attention plays an important role to understand images and demonstrates its effectiveness in generating natural language descriptions of images. On the other hand, recent studies show that language associated with an image can steer…

Computer Vision and Pattern Recognition · Computer Science 2016-12-13 Jonghwan Mun , Minsu Cho , Bohyung Han

Deep learning approaches have become the standard solution to many problems in computer vision and robotics, but obtaining sufficient training data in high enough quality is challenging, as human labor is error prone, time consuming, and…

Machine Learning · Computer Science 2021-06-16 Jan Blumenkamp , Andreas Baude , Tim Laue

Image inpainting is a non-trivial task in computer vision due to multiple possibilities for filling the missing data, which may be dependent on the global information of the image. Most of the existing approaches use the attention mechanism…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 Gourav Wadhwa , Abhinav Dhall , Subrahmanyam Murala , Usman Tariq

Image-to-image translation has recently received significant attention due to advances in deep learning. Most works focus on learning either a one-to-one mapping in an unsupervised way or a many-to-many mapping in a supervised way. However,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-15 Liqian Ma , Xu Jia , Stamatios Georgoulis , Tinne Tuytelaars , Luc Van Gool

We propose a novel attention model that can accurately attends to target objects of various scales and shapes in images. The model is trained to gradually suppress irrelevant regions in an input image via a progressive attentive process…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Paul Hongsuck Seo , Zhe Lin , Scott Cohen , Xiaohui Shen , Bohyung Han

Data efficiency, or the ability to generalize from a few labeled data, remains a major challenge in deep learning. Semi-supervised learning has thrived in traditional recognition tasks alleviating the need for large amounts of labeled data,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 George Eskandar , Shuai Zhang , Mohamed Abdelsamad , Mark Youssef , Diandian Guo , Bin Yang

In this paper, we tackle the problem of enhancing real-world low-light images with significant noise in an unsupervised fashion. Conventional unsupervised learning-based approaches usually tackle the low-light image enhancement problem…

Image and Video Processing · Electrical Eng. & Systems 2022-03-29 Wei Xiong , Ding Liu , Xiaohui Shen , Chen Fang , Jiebo Luo

Recently, there has been a surge in research in multimodal machine translation (MMT), where additional modalities such as images are used to improve translation quality of textual systems. A particular use for such multimodal systems is the…

Computation and Language · Computer Science 2022-07-07 Veneta Haralampieva , Ozan Caglayan , Lucia Specia

Unsupervised image-to-image translation (UNIT) aims at learning a mapping between several visual domains by using unpaired training images. Recent studies have shown remarkable success for multiple domains but they suffer from two main…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Yahui Liu , Marco De Nadai , Jian Yao , Nicu Sebe , Bruno Lepri , Xavier Alameda-Pineda

The recent enthusiasm for open-world vision systems show the high interest of the community to perform perception tasks outside of the closed-vocabulary benchmark setups which have been so popular until now. Being able to discover objects…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Oriane Siméoni , Éloi Zablocki , Spyros Gidaris , Gilles Puy , Patrick Pérez

Visual domain gaps often impact object detection performance. Image-to-image translation can mitigate this effect, where contrastive approaches enable learning of the image-to-image mapping under unsupervised regimes. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Danai Triantafyllidou , Sarah Parisot , Ales Leonardis , Steven McDonagh

Unsupervised meta-learning aims to learn feature representations from unsupervised datasets that can transfer to downstream tasks with limited labeled data. In this paper, we propose a novel approach to unsupervised meta-learning that…

Machine Learning · Computer Science 2025-02-11 Anna Vettoruzzo , Lorenzo Braccaioli , Joaquin Vanschoren , Marlena Nowaczyk

This work introduced a novel GAN architecture for unsupervised image translation on the task of face style transform. A spectral attention-based mechanism is embedded into the design along with spatial attention on the image contents. We…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Qizhou Wang , Maksim Makarenko

Image-to-image translation is affected by entanglement phenomena, which may occur in case of target data encompassing occlusions such as raindrops, dirt, etc. Our unsupervised model-based learning disentangles scene and occlusions, while…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Fabio Pizzati , Pietro Cerri , Raoul de Charette