English
Related papers

Related papers: Positional Encoding as Spatial Inductive Bias in G…

200 papers

In recent years, there has been a growing interest in Semantic Image Synthesis (SIS) through the use of Generative Adversarial Networks (GANs) and diffusion models. This field has seen innovations such as the implementation of specialized…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Khaled M. Seyam , Julian Wiederer , Markus Braun , Bin Yang

We propose a kernelized deep local-patch descriptor based on efficient match kernels of neural network activations. Response of each receptive field is encoded together with its spatial location using explicit feature maps. Two location…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Arun Mukundan , Giorgos Tolias , Ondrej Chum

Image-to-image translation is to learn a mapping between images from a source domain and images from a target domain. In this paper, we introduce the attention mechanism directly to the generative adversarial network (GAN) architecture and…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Hajar Emami , Majid Moradi Aliabadi , Ming Dong , Ratna Babu Chinnam

We propose a new approach to Generative Adversarial Networks (GANs) to achieve an improved performance with additional robustness to its so-called and well recognized mode collapse. We first proceed by mapping the desired data onto a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-26 Shahin Mahdizadehaghdam , Ashkan Panahi , Hamid Krim

Despite remarkable recent progress on both unconditional and conditional image synthesis, it remains a long-standing problem to learn generative models that are capable of synthesizing realistic and sharp images from reconfigurable spatial…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Wei Sun , Tianfu Wu

Positional encoding (PE) underpins how permutation-invariant Transformers represent sequence order, yet how positional information is processed and stored remains poorly understood. Modern PE methods such as RoPE still struggle on tasks…

Computation and Language · Computer Science 2026-05-29 Pierre-Antoine Lequeu , Camille Barboule , Benjamin Piwowarski

Learning to translate images from a source to a target domain with applications such as converting simple line drawing to oil painting has attracted significant attention. The quality of translated images is directly related to two crucial…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Mohammadreza Naderi , Nader Karimi , Ali Emami , Shahram Shirani , Shadrokh Samavi

This paper investigates an open research task of text-to-image synthesis for automatically generating or manipulating images from text descriptions. Prevailing methods mainly use the text as conditions for GAN generation, and train…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Hao Wang , Guosheng Lin , Steven C. H. Hoi , Chunyan Miao

This manuscript investigates the integration of positional encoding -- a technique widely used in computer graphics -- into the input vector of a binary classification model for self-collision detection. The results demonstrate the benefits…

Robotics · Computer Science 2026-04-21 Bartłomiej Kulecki , Dominik Belter

Unsupervised text encoding models have recently fueled substantial progress in NLP. The key idea is to use neural networks to convert words in texts to vector space representations based on word positions in a sentence and their contexts,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Gengchen Mai , Krzysztof Janowicz , Bo Yan , Rui Zhu , Ling Cai , Ni Lao

Neural language models process sequences of words, but the mathematical operations inside them are insensitive to the order in which words appear. Positional encodings are the component added to remedy this. Despite their importance,…

Machine Learning · Computer Science 2026-04-08 Giansalvo Cirrincione

Generative adversarial network (GAN) has achieved impressive success on cross-domain generation, but it faces difficulty in cross-modal generation due to the lack of a common distribution between heterogeneous data. Most existing methods of…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Wen-Cheng Chen , Chien-Wen Chen , Min-Chun Hu

Generative adversarial networks (GANs) have attained photo-realistic quality in image generation. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN which is trained…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xingzhe He , Bastian Wandt , Helge Rhodin

We propose a novel approach for multi-modal Image-to-image (I2I) translation. To tackle the one-to-many relationship between input and output domains, previous works use complex training objectives to learn a latent embedding, jointly with…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Moustafa Meshry , Yixuan Ren , Larry S Davis , Abhinav Shrivastava

Multi-layer perceptrons (MLP) have proven to be effective scene encoders when combined with higher-dimensional projections of the input, commonly referred to as \textit{positional encoding}. However, scenes with a wide frequency spectrum…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Zoe Landgraf , Alexander Sorkine Hornung , Ricardo Silveira Cabral

Generative Adversarial Networks (GANs) have established themselves as a prevalent approach to image synthesis. Of these, StyleGAN offers a fascinating case study, owing to its remarkable visual quality and an ability to support a large…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Amit H. Bermano , Rinon Gal , Yuval Alaluf , Ron Mokady , Yotam Nitzan , Omer Tov , Or Patashnik , Daniel Cohen-Or

Disentanglement learning is crucial for obtaining disentangled representations and controllable generation. Current disentanglement methods face several inherent limitations: difficulty with high-resolution images, primarily focusing on…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Weili Nie , Tero Karras , Animesh Garg , Shoubhik Debnath , Anjul Patney , Ankit B. Patel , Anima Anandkumar

Area of image inpainting over relatively large missing regions recently advanced substantially through adaptation of dedicated deep neural networks. However, current network solutions still introduce undesired artifacts and noise to the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-21 Ugur Demir , Gozde Unal

Conditioning is crucial for stable training of full-head 3D GANs. Without any conditioning signal, the model suffers from severe mode collapse, making it impractical to training. However, a series of previous full-head 3D GANs…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Heyuan Li , Huimin Zhang , Yuda Qiu , Zhengwentai Sun , Keru Zheng , Lingteng Qiu , Peihao Li , Qi Zuo , Ce Chen , Yujian Zheng , Yuming Gu , Zilong Dong , Xiaoguang Han

We address the problem of finding realistic geometric corrections to a foreground object such that it appears natural when composited into a background image. To achieve this, we propose a novel Generative Adversarial Network (GAN)…

Computer Vision and Pattern Recognition · Computer Science 2018-03-06 Chen-Hsuan Lin , Ersin Yumer , Oliver Wang , Eli Shechtman , Simon Lucey