English
Related papers

Related papers: Positional Encoding as Spatial Inductive Bias in G…

200 papers

Recent advances in the field of generative models and in particular generative adversarial networks (GANs) have lead to substantial progress for controlled image editing, especially compared with the pre-deep learning era. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Gwilherm Lesné , Yann Gousseau , Saïd Ladjal , Alasdair Newson

Probabilistic inversion within a multiple-point statistics framework is often computationally prohibitive for high-dimensional problems. To partly address this, we introduce and evaluate a new training-image based inversion approach for…

Machine Learning · Statistics 2019-01-09 Eric Laloy , Romain Hérault , Diederik Jacques , Niklas Linde

Generating images from a single sample, as a newly developing branch of image synthesis, has attracted extensive attention. In this paper, we formulate this problem as sampling from the conditional distribution of a single image, and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-07 ZiCheng Zhang , CongYing Han , TianDe Guo

In this work, we are dedicated to text-guided image generation and propose a novel framework, i.e., CLIP2GAN, by leveraging CLIP model and StyleGAN. The key idea of our CLIP2GAN is to bridge the output feature embedding space of CLIP and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yixuan Wang , Wengang Zhou , Jianmin Bao , Weilun Wang , Li Li , Houqiang Li

Recent image inpainting methods have made great progress but often struggle to generate plausible image structures when dealing with large holes in complex images. This is partially due to the lack of effective network structures that can…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Haitian Zheng , Zhe Lin , Jingwan Lu , Scott Cohen , Eli Shechtman , Connelly Barnes , Jianming Zhang , Ning Xu , Sohrab Amirghodsi , Jiebo Luo

Transformer architecture has enabled recent progress in speech enhancement. Since Transformers are position-agostic, positional encoding is the de facto standard component used to enable Transformers to distinguish the order of elements in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-15 Qiquan Zhang , Meng Ge , Hongxu Zhu , Eliathamby Ambikairajah , Qi Song , Zhaoheng Ni , Haizhou Li

StyleGAN's disentangled style representation enables powerful image editing by manipulating the latent variables, but accurately mapping real-world images to their latent variables (GAN inversion) remains a challenge. Existing GAN inversion…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Anand Bhattad , Viraj Shah , Derek Hoiem , D. A. Forsyth

One of the main motivations for training high quality image generative models is their potential use as tools for image manipulation. Recently, generative adversarial networks (GANs) have been able to generate images of remarkable quality.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Aviv Gabbay , Yedid Hoshen

Positional encodings have enabled recent works to train a single adversarial network that can generate images of different scales. However, these approaches are either limited to a set of discrete scales or struggle to maintain good…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Evangelos Ntavelis , Mohamad Shahbazi , Iason Kastanis , Radu Timofte , Martin Danelljan , Luc Van Gool

Traditional deep generative models of images and other spatial modalities can only generate fixed sized outputs. The generated images have exactly the same resolution as the training images, which is dictated by the number of layers in the…

Machine Learning · Computer Science 2020-07-27 Chaochao Lu , Richard E. Turner , Yingzhen Li , Nate Kushman

Implicit neural representations (INRs) are increasingly being used as tools to map coordinates to signals, encompassing applications from neural fields to texture compression, shape representations, and beyond. Most INR methods are based on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Guillaume Perez , Janarbek Matai , Takahiro Harada

StyleGAN2 was demonstrated to be a powerful image generation engine that supports semantic editing. However, in order to manipulate a real-world image, one first needs to be able to retrieve its corresponding latent representation in…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Erez Sheffi , Michael Rotman , Lior Wolf

Generative models make huge progress to the photorealistic image synthesis in recent years. To enable human to steer the image generation process and customize the output, many works explore the interpretable dimensions of the latent space…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Jianyuan Wang , Lalit Bhagat , Ceyuan Yang , Yinghao Xu , Yujun Shen , Hongdong Li , Bolei Zhou

We present a generative image inpainting system to complete images with free-form mask and guidance. The system is based on gated convolutions learned from millions of images without additional labelling efforts. The proposed gated…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Jiahui Yu , Zhe Lin , Jimei Yang , Xiaohui Shen , Xin Lu , Thomas Huang

Recent deep generative models are able to provide photo-realistic images as well as visual or textual content embeddings useful to address various tasks of computer vision and natural language processing. Their usefulness is nevertheless…

Machine Learning · Computer Science 2020-01-29 Antoine Plumerault , Hervé Le Borgne , Céline Hudelot

Generative Adversarial Networks (GANs) typically learn a distribution of images in a large image dataset, and are then able to generate new images from this distribution. However, each natural image has its own internal statistics, captured…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Assaf Shocher , Shai Bagon , Phillip Isola , Michal Irani

Recent work has shown that a variety of semantics emerge in the latent space of Generative Adversarial Networks (GANs) when being trained to synthesize images. However, it is difficult to use these learned semantics for real image editing.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Jiapeng Zhu , Yujun Shen , Deli Zhao , Bolei Zhou

Generative adversarial networks (GANs) synthesize realistic images from random latent vectors. Although manipulating the latent vectors controls the synthesized outputs, editing real images with GANs suffers from i) time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Hyunsu Kim , Yunjey Choi , Junho Kim , Sungjoo Yoo , Youngjung Uh

This study reports an unintuitive finding that positional encoding enhances learning of recurrent neural networks (RNNs). Positional encoding is a high-dimensional representation of time indices on input data. Most famously, positional…

Machine Learning · Computer Science 2024-11-28 Takashi Morita

Intrinsic images, in the original sense, are image-like maps of scene properties like depth, normal, albedo or shading. This paper demonstrates that StyleGAN can easily be induced to produce intrinsic images. The procedure is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Anand Bhattad , Daniel McKee , Derek Hoiem , D. A. Forsyth