English
Related papers

Related papers: Spatial PixelCNN: Generating Images from Patches

200 papers

Generating high-resolution, photo-realistic images has been a long-standing goal in machine learning. Recently, Nguyen et al. (2016) showed one interesting way to synthesize novel images by performing gradient ascent in the latent space of…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Anh Nguyen , Jeff Clune , Yoshua Bengio , Alexey Dosovitskiy , Jason Yosinski

Diffusion probabilistic models have been successful in generating high-quality and diverse images. However, traditional models, whose input and output are high-resolution images, suffer from excessive memory requirements, making them less…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Shinei Arakawa , Hideki Tsunashima , Daichi Horita , Keitaro Tanaka , Shigeo Morishima

Constructing powerful generative models for natural images is a challenging task. PixelCNN models capture details and local information in images very well but have limited receptive field. Variational autoencoders with a factorial decoder…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Hossein Sadeghi , Evgeny Andriyash , Walter Vinci , Lorenzo Buffoni , Mohammad H. Amin

We present compositional nearest neighbors (CompNN), a simple approach to visually interpreting distributed representations learned by a convolutional neural network (CNN) for pixel-level tasks (e.g., image synthesis and segmentation). It…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Victor Fragoso , Chunhui Liu , Aayush Bansal , Deva Ramanan

Generative Adversarial Networks (GANs) have proven successful for unsupervised image generation. Several works have extended GANs to image inpainting by conditioning the generation with parts of the image to be reconstructed. Despite their…

Image and Video Processing · Electrical Eng. & Systems 2020-02-05 Cyprien Ruffino , Romain Hérault , Eric Laloy , Gilles Gasso

Region-adaptive normalization (RAN) methods have been widely used in the generative adversarial network (GAN)-based image-to-image translation technique. However, since these approaches need a mask image to infer the pixel-wise affine…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Yoon-Jae Yeo , Min-Cheol Sagong , Seung Park , Sung-Jea Ko , Yong-Goo Shin

Semantic inpainting is the task of inferring missing pixels in an image given surrounding pixels and high level image semantics. Most semantic inpainting algorithms are deterministic: given an image with missing regions, a single inpainted…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Emilien Dupont , Suhas Suresha

Some image restoration tasks like demosaicing require difficult training samples to learn effective models. Existing methods attempt to address this data training problem by manually collecting a new training dataset that contains adequate…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Shuyang Sun , Liang Chen , Gregory Slabaugh , Philip Torr

Try to generate new bridge types using generative artificial intelligence technology. Using symmetric structured image dataset of three-span beam bridge, arch bridge, cable-stayed bridge and suspension bridge , based on Python programming…

Machine Learning · Computer Science 2024-01-12 Hongjun Zhang

Modeling the distribution of natural images is a landmark problem in unsupervised learning. This task requires an image model that is at once expressive, tractable and scalable. We present a deep neural network that sequentially predicts…

Computer Vision and Pattern Recognition · Computer Science 2016-08-22 Aaron van den Oord , Nal Kalchbrenner , Koray Kavukcuoglu

Generative Adversarial Networks (GANs) have proven successful for unsupervised image generation. Several works extended GANs to image inpainting by conditioning the generation with parts of the image one wants to reconstruct. However, these…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Cyprien Ruffino , Romain Hérault , Eric Laloy , Gilles Gasso

Conventional image sensors digitize high-resolution images at fast frame rates, producing a large amount of data that needs to be transmitted off the sensor for further processing. This is challenging for perception systems operating on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Haley M. So , Laurie Bose , Piotr Dudek , Gordon Wetzstein

High-dimensional generative models have many applications including image compression, multimedia generation, anomaly detection and data completion. State-of-the-art estimators for natural images are autoregressive, decomposing the joint…

Machine Learning · Computer Science 2020-06-30 Ajay Jain , Pieter Abbeel , Deepak Pathak

The high dimensionality of images presents architecture and sampling-efficiency challenges for likelihood-based generative models. Previous approaches such as VQ-VAE use deep autoencoders to obtain compact representations, which are more…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Charlie Nash , Jacob Menick , Sander Dieleman , Peter W. Battaglia

Convolutional neural networks for visual recognition require large amounts of training samples and usually benefit from data augmentation. This paper proposes PatchMix, a data augmentation method that creates new samples by composing…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Paola Cascante-Bonilla , Arshdeep Sekhon , Yanjun Qi , Vicente Ordonez

We introduce FewGAN, a generative model for generating novel, high-quality and diverse images whose patch distribution lies in the joint patch distribution of a small number of N>1 training samples. The method is, in essence, a hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Lior Ben-Moshe , Sagie Benaim , Lior Wolf

PixelCNNs are a recently proposed class of powerful generative models with tractable likelihood. Here we discuss our implementation of PixelCNNs which we make available at https://github.com/openai/pixel-cnn. Our implementation contains a…

Machine Learning · Computer Science 2017-01-24 Tim Salimans , Andrej Karpathy , Xi Chen , Diederik P. Kingma

We introduce SinGAN, an unconditional generative model that can be learned from a single natural image. Our model is trained to capture the internal distribution of patches within the image, and is then able to generate high quality,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Tamar Rott Shaham , Tali Dekel , Tomer Michaeli

We introduce a new problem of generating an image based on a small number of key local patches without any geometric prior. In this work, key local patches are defined as informative regions of the target object or scene. This is a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-04 Donghoon Lee , Sangdoo Yun , Sungjoon Choi , Hwiyeon Yoo , Ming-Hsuan Yang , Songhwai Oh

Convolutional neural networks (CNNs) are usually built by stacking convolutional operations layer-by-layer. Although CNN has shown strong capability to extract semantics from raw pixels, its capacity to capture spatial relationships of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Xingang Pan , Xiaohang Zhan , Jianping Shi , Ping Luo , Xiaogang Wang , Xiaoou Tang