English
Related papers

Related papers: Two approaches to inpainting microstructure with d…

200 papers

In this short report, we present a simple, yet effective approach to editing real images via generative adversarial networks (GAN). Unlike previous techniques, that treat all editing tasks as an operation that affects pixel values in the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 David Futschik , Michal Lukáč , Eli Shechtman , Daniel Sýkora

In addition to the forward inference of materials properties using machine learning, generative deep learning techniques applied on materials science allow the inverse design of materials, i.e., assessing the…

Materials Science · Physics 2024-10-01 Teng Long , Yixuan Zhang , Hongbin Zhang

In this paper we present an end-to-end deep learning framework to turn images that show dynamic content, such as vehicles or pedestrians, into realistic static frames. This objective encounters two main challenges: detecting all the dynamic…

Computer Vision and Pattern Recognition · Computer Science 2019-02-18 Berta Bescos , José Neira , Roland Siegwart , Cesar Cadena

Generative networks are fundamentally different in their aim and methods compared to CNNs for classification, segmentation, or object detection. They have initially not been meant to be an image analysis tool, but to produce naturally…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Markus Wenzel

Diffusion-based inpainting is a powerful tool for the reconstruction of images from sparse data. Its quality strongly depends on the choice of known data. Optimising their spatial location -- the inpainting mask -- is challenging. A…

Image and Video Processing · Electrical Eng. & Systems 2022-05-17 Tobias Alt , Pascal Peter , Joachim Weickert

Over the last decade, the process of automatic image colorization has been of significant interest for several application areas including restoration of aged or degraded images. This problem is highly ill-posed due to the large degrees of…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 Kamyar Nazeri , Eric Ng , Mehran Ebrahimi

Collecting well-annotated image datasets to train modern machine learning algorithms is prohibitively expensive for many tasks. One appealing alternative is rendering synthetic data where ground-truth annotations are generated…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Konstantinos Bousmalis , Nathan Silberman , David Dohan , Dumitru Erhan , Dilip Krishnan

Gatys et al. (2015) showed that optimizing pixels to match features in a convolutional network with respect reference image features is a way to render images of high visual quality. We show that unrolling this gradient-based optimization…

Machine Learning · Computer Science 2016-12-14 Daniel Jiwoong Im , Chris Dongjoo Kim , Hui Jiang , Roland Memisevic

Recovering badly damaged face images is a useful yet challenging task, especially in extreme cases where the masked or damaged region is very large. One of the major challenges is the ability of the system to generalize on faces outside the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Nilesh Pandey , Andreas Savakis

In this paper, we focus on image inpainting task, aiming at recovering the missing area of an incomplete image given the context information. Recent development in deep generative models enables an efficient end-to-end framework for image…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Yuhang Song , Chao Yang , Yeji Shen , Peng Wang , Qin Huang , C. -C. Jay Kuo

Image inpainting aims to complete the missing or corrupted regions of images with realistic contents. The prevalent approaches adopt a hybrid objective of reconstruction and perceptual quality by using generative adversarial networks.…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Yingchen Yu , Fangneng Zhan , Shijian Lu , Jianxiong Pan , Feiying Ma , Xuansong Xie , Chunyan Miao

Generative adversarial networks (GANs) provide an algorithmic framework for constructing generative models with several appealing properties: they do not require a likelihood function to be specified, only a generating procedure; they…

Machine Learning · Statistics 2017-02-28 Shakir Mohamed , Balaji Lakshminarayanan

Limited angle CT reconstruction is an under-determined linear inverse problem that requires appropriate regularization techniques to be solved. In this work we study how pre-trained generative adversarial networks (GANs) can be used to…

Image and Video Processing · Electrical Eng. & Systems 2020-01-30 Rushil Anirudh , Hyojin Kim , Jayaraman J. Thiagarajan , K. Aditya Mohan , Kyle M. Champley

We propose a new approach to Generative Adversarial Networks (GANs) to achieve an improved performance with additional robustness to its so-called and well recognized mode collapse. We first proceed by mapping the desired data onto a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-26 Shahin Mahdizadehaghdam , Ashkan Panahi , Hamid Krim

Converting text descriptions into images using Generative Adversarial Networks has become a popular research area. Visually appealing images have been generated successfully in recent years. Inspired by these studies, we investigated the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Azmi Can Özgen , Hazım Kemal Ekenel

In this paper we present several architectural and optimization recipes for generative adversarial network(GAN) based facial semantic inpainting. Current benchmark models are susceptible to initial solutions of non-convex optimization…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Avisek Lahiri , Arnav Jain , Divyasri Nadendla , Prabir Kumar Biswas

Generative adversarial networks (GANs) have demonstrated to be successful at generating realistic real-world images. In this paper we compare various GAN techniques, both supervised and unsupervised. The effects on training stability of…

Machine Learning · Computer Science 2018-03-28 Mathijs Pieters , Marco Wiering

One of the biggest challenges in the research of generative adversarial networks (GANs) is assessing the quality of generated samples and detecting various levels of mode collapse. In this work, we construct a novel measure of performance…

Machine Learning · Computer Science 2018-06-12 Valentin Khrulkov , Ivan Oseledets

The task of image generation started to receive some attention from artists and designers to inspire them in new creations. However, exploiting the results of deep generative models such as Generative Adversarial Networks can be long and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Baptiste Rozière , Morgane Riviere , Olivier Teytaud , Jérémy Rapin , Yann LeCun , Camille Couprie

We propose a system for surface completion and inpainting of 3D shapes using generative models, learnt on local patches. Our method uses a novel encoding of height map based local patches parameterized using 3D mesh quadrangulation of the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Kripasindhu Sarkar , Kiran Varanasi , Didier Stricker