English
Related papers

Related papers: ViT-Inception-GAN for Image Colourising

200 papers

One of the main motivations for training high quality image generative models is their potential use as tools for image manipulation. Recently, generative adversarial networks (GANs) have been able to generate images of remarkable quality.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Aviv Gabbay , Yedid Hoshen

Recently there has been an enormous interest in generative models for images in deep learning. In pursuit of this, Generative Adversarial Networks (GAN) and Variational Auto-Encoder (VAE) have surfaced as two most prominent and popular…

Computer Vision and Pattern Recognition · Computer Science 2017-01-18 Mahesh Gorijala , Ambedkar Dukkipati

Generative adversarial networks (GANs) are a powerful framework for generative tasks. However, they are difficult to train and tend to miss modes of the true data generation process. Although GANs can learn a rich representation of the…

Machine Learning · Computer Science 2017-11-27 Robin Winter , Djork-Arné Clevert

Image inpainting, the process of restoring missing or corrupted regions of an image by reconstructing pixel information, has recently seen considerable advancements through deep learning-based approaches. In this paper, we introduce a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Kourosh Kiani , Razieh Rastgoo , Alireza Chaji , Sergio Escalera

Generative adversarial networks (GANs) can synthesize high-quality (HQ) images, and GAN inversion is a technique that discovers how to invert given images back to latent space. While existing methods perform on StyleGAN inversion, they have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Cheng Yu , Wenmin Wang , Roberto Bugiolacchi

We introduce an inversion based method, denoted as IMAge-Guided model INvErsion (IMAGINE), to generate high-quality and diverse images from only a single training sample. We leverage the knowledge of image semantics from a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Pei Wang , Yijun Li , Krishna Kumar Singh , Jingwan Lu , Nuno Vasconcelos

Differentiable rendering has paved the way to training neural networks to perform "inverse graphics" tasks such as predicting 3D geometry from monocular photographs. To train high performing models, most of the current approaches rely on…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Yuxuan Zhang , Wenzheng Chen , Huan Ling , Jun Gao , Yinan Zhang , Antonio Torralba , Sanja Fidler

Image reconstruction including image restoration and denoising is a challenging problem in the field of image computing. We present a new method, called X-GANs, for reconstruction of arbitrary corrupted resource based on a variant of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Longfei Liu , Sheng Li , Yisong Chen , Guoping Wang

We introduce a novel generative autoencoder network model that learns to encode and reconstruct images with high quality and resolution, and supports smooth random sampling from the latent space of the encoder. Generative adversarial…

Machine Learning · Computer Science 2018-10-10 Ari Heljakka , Arno Solin , Juho Kannala

We review some of the most recent approaches to colorize gray-scale images using deep learning methods. Inspired by these, we propose a model which combines a deep Convolutional Neural Network trained from scratch with high-level features…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Federico Baldassarre , Diego González Morín , Lucas Rodés-Guirao

Image inpainting is a valuable technique for enhancing images that have been corrupted. The primary challenge in this research revolves around the extent of corruption in the input image that the deep learning model must restore. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Mehrshad Momen-Tayefeh , Mehrdad Momen-Tayefeh , Amir Ali Ghafourian Ghahramani

Area of image inpainting over relatively large missing regions recently advanced substantially through adaptation of dedicated deep neural networks. However, current network solutions still introduce undesired artifacts and noise to the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-21 Ugur Demir , Gozde Unal

Over the last decade, the process of automatic image colorization has been of significant interest for several application areas including restoration of aged or degraded images. This problem is highly ill-posed due to the large degrees of…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 Kamyar Nazeri , Eric Ng , Mehran Ebrahimi

Automatic colorization of images without human intervention has been a subject of interest in the machine learning community for a brief period of time. Assigning color to an image is a highly ill-posed problem because of its innate nature…

Image and Video Processing · Electrical Eng. & Systems 2021-12-30 Shreyas Kalvankar , Hrushikesh Pandit , Pranav Parwate , Atharva Patil , Snehal Kamalapur

In recent years, there has been a significant focus on research related to text-guided image inpainting. However, the task remains challenging due to several constraints, such as ensuring alignment between the image and the text, and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Jihoon Lee , Yunhong Min , Hwidong Kim , Sangtae Ahn

Recently, plain vision Transformers (ViTs) have shown impressive performance on various computer vision tasks, thanks to their strong modeling capacity and large-scale pretraining. However, they have not yet conquered the problem of image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Jingfeng Yao , Xinggang Wang , Shusheng Yang , Baoyuan Wang

Colorization is an ambiguous problem, with multiple viable colorizations for a single grey-level image. However, previous methods only produce the single most probable colorization. Our goal is to model the diversity intrinsic to the…

Computer Vision and Pattern Recognition · Computer Science 2017-04-28 Aditya Deshpande , Jiajun Lu , Mao-Chuang Yeh , Min Jin Chong , David Forsyth

Image inversion is a fundamental task in generative models, aiming to map images back to their latent representations to enable downstream applications such as editing, restoration, and style transfer. This paper provides a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Yinan Chen , Jiangning Zhang , Yali Bi , Xiaobin Hu , Teng Hu , Zhucun Xue , Ran Yi , Yong Liu , Ying Tai

In this paper, we propose a diffusion model that integrates a representation-conditioning mechanism, where the representations derived from a Vision Transformer (ViT) are used to condition the internal process of a Transformer-based…

Machine Learning · Computer Science 2025-05-13 Kosuke Ukita , Ye Xiaolong , Tsuyoshi Okita

Virtual Try-On (trying clothes virtually) is a promising application of the Generative Adversarial Network (GAN). However, it is an arduous task to transfer the desired clothing item onto the corresponding regions of a human body because of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Santosh Adhikari , Bishnu Bhusal , Prashant Ghimire , Anil Shrestha