English
Related papers

Related papers: Controllable Semantic Image Inpainting

200 papers

We introduce a novel image-to-painting method that facilitates the creation of large-scale, high-fidelity paintings with human-like quality and stylistic variation. To process large images and gain control over the painting process, we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Manuel Ladron de Guevara , Matthew Fisher , Aaron Hertzmann

Have you ever thought that you can be an intelligent painter? This means that you can paint a picture with a few expected objects in mind, or with a desirable scene. This is different from normal inpainting approaches for which the location…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Wing-Fung Ku , Wan-Chi Siu , Xi Cheng , H. Anthony Chan

Recent advances in deep generative models have shown promising potential in image inpanting, which refers to the task of predicting missing pixel values of an incomplete image using the known context. However, existing methods can be slow…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Chao Yang , Yuhang Song , Xiaofeng Liu , Qingming Tang , C. -C. Jay Kuo

Inpainting-based codecs store sparse, quantised pixel data directly and decode by interpolating the discarded image parts. This interpolation can be used simultaneously for efficient coding by predicting pixel data to be stored. Such joint…

Image and Video Processing · Electrical Eng. & Systems 2020-10-21 Rahul Mohideen Kaja Mohideen , Pascal Peter , Tobias Alt , Joachim Weickert , Alexander Scheer

Our work focuses on unsupervised and generative methods that address the following goals: (a) learning unsupervised generative representations that discover latent factors controlling image semantic attributes, (b) studying how this ability…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 William Paul , I-Jeng Wang , Fady Alajaji , Philippe Burlina

Inpainting-based image compression is a promising alternative to classical transform-based lossy codecs. Typically it stores a carefully selected subset of all pixel locations and their colour values. In the decoding phase the missing…

Image and Video Processing · Electrical Eng. & Systems 2023-05-16 Ferdinand Jost , Vassillen Chizhov , Joachim Weickert

We propose Generative Probabilistic Image Colorization, a diffusion-based generative process that trains a sequence of probabilistic models to reverse each step of noise corruption. Given a line-drawing image as input, our method suggests…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Chie Furusawa , Shinya Kitaoka , Michael Li , Yuri Odagiri

Humans are capable of building holistic representations for images at various levels, from local objects, to pairwise relations, to global structures. The interpretation of structures involves reasoning over repetition and symmetry of the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Jiayuan Mao , Xiuming Zhang , Yikai Li , William T. Freeman , Joshua B. Tenenbaum , Jiajun Wu

In the last few years, Neural Painting (NP) techniques became capable of producing extremely realistic artworks. This paper advances the state of the art in this emerging research domain by proposing the first approach for Interactive NP.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Elia Peruzzo , Willi Menapace , Vidit Goel , Federica Arrigoni , Hao Tang , Xingqian Xu , Arman Chopikyan , Nikita Orlov , Yuxiao Hu , Humphrey Shi , Nicu Sebe , Elisa Ricci

Recent inversion methods have shown that real images can be inverted into StyleGAN's latent space and numerous edits can be achieved on those images thanks to the semantically rich feature representations of well-trained GAN models.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Ahmet Burak Yildirim , Hamza Pehlivan , Bahri Batuhan Bilecen , Aysegul Dundar

Models based on deep convolutional neural networks (CNN) have significantly improved the performance of semantic segmentation. However, learning these models requires a large amount of training images with pixel-level labels, which are very…

Computer Vision and Pattern Recognition · Computer Science 2018-02-05 Linwei Ye , Zhi Liu , Yang Wang

We present a novel CNN-based image editing strategy that allows the user to change the semantic information of an image over an arbitrary region by manipulating the feature-space representation of the image in a trained GAN model. We will…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Ryohei Suzuki , Masanori Koyama , Takeru Miyato , Taizan Yonetsuji , Huachun Zhu

Image captioning is a technology that produces text-based descriptions for an image. Deep learning-based solutions built on top of feature recognition may very well serve the purpose. But as with any other machine learning solution, the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Rishi Kesav Mohan , Sanjay Sureshkumar , Vignesh Sivasubramaniam

Generative adversarial networks (GANs) can now generate photo-realistic images. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN internally conditioned on a set of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-10 Xingzhe He , Bastian Wandt , Helge Rhodin

We propose a novel study of generating unseen arbitrary viewpoints for infrared imagery in the non-linear feature subspace . Current methods use synthetic images and often result in blurry and distorted outputs. Our approach on the contrary…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Maliha Arif , Abhijit Mahalanobis

Image inpainting, the task of reconstructing missing segments in corrupted images using available data, faces challenges in ensuring consistency and fidelity, especially under information-scarce conditions. Traditional evaluation methods,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Tianyi Chen , Jianfu Zhang , Yan Hong , Yiyi Zhang , Liqing Zhang

Completing a corrupted image with correct structures and reasonable textures for a mixed scene remains an elusive challenge. Since the missing hole in a mixed scene of a corrupted image often contains various semantic information,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Liang Liao , Jing Xiao , Zheng Wang , Chia-Wen Lin , Shin'ichi Satoh

Image Inpainting is one of the very popular tasks in the field of image processing with broad applications in computer vision. In various practical applications, images are often deteriorated by noise due to the presence of corrupted, lost,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Harsh Patel , Amey Kulkarni , Shivam Sahni , Udit Vyas

Sketch-based image editing aims to synthesize and modify photos based on the structural information provided by the human-drawn sketches. Since sketches are difficult to collect, previous methods mainly use edge maps instead of sketches to…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Shuai Yang , Zhangyang Wang , Jiaying Liu , Zongming Guo

This paper presents a robust and transparent scheme of watermarking that exploits the human visual systems' sensitivity to frequency, along with local image characteristics obtained from the spatial domain. The underlying idea is generating…

Cryptography and Security · Computer Science 2007-05-23 Arvind Parthasarathy