English
Related papers

Related papers: Context Encoders: Feature Learning by Inpainting

200 papers

In the last few years, neural networks have been intensively used to develop meaningful distributed representations of words and contexts around them. When these representations, also known as "embeddings", are learned from unsupervised…

Computation and Language · Computer Science 2019-08-07 Giuseppe Marra , Andrea Zugarini , Stefano Melacci , Marco Maggini

In a given scene, humans can often easily predict a set of immediate future events that might happen. However, generalized pixel-level anticipation in computer vision systems is difficult because machine learning struggles with the…

Computer Vision and Pattern Recognition · Computer Science 2016-06-28 Jacob Walker , Carl Doersch , Abhinav Gupta , Martial Hebert

End-to-end training from scratch of current deep architectures for new computer vision problems would require Imagenet-scale datasets, and this is not always possible. In this paper we present a method that is able to take advantage of…

Computer Vision and Pattern Recognition · Computer Science 2017-05-25 Lluis Gomez , Yash Patel , Marçal Rusiñol , Dimosthenis Karatzas , C. V. Jawahar

Image captioning is the process of automatically generating a description of an image in natural language. Image captioning is one of the significant challenges in image understanding since it requires not only recognizing salient objects…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Ghadah Alabduljabbar , Hafida Benhidour , Said Kerrache

While deep neural networks have led to human-level performance on computer vision tasks, they have yet to demonstrate similar gains for holistic scene understanding. In particular, 3D context has been shown to be an extremely important cue…

Computer Vision and Pattern Recognition · Computer Science 2017-08-17 Yinda Zhang , Mingru Bai , Pushmeet Kohli , Shahram Izadi , Jianxiong Xiao

In this paper, we analyze if cascade usage of the context encoder with increasing input can improve the results of the inpainting. For this purpose, we train context encoder for 64x64 pixels images in a standard way and use its resized…

Computer Vision and Pattern Recognition · Computer Science 2018-03-13 Bartosz Zieliński , Łukasz Struski , Marek Śmieja , Jacek Tabor

Vision encoders are increasingly used in modern applications, from vision-only models to multimodal systems such as vision-language models. Despite their remarkable success, it remains unclear how these architectures represent features…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Eduard Allakhverdov , Dmitrii Tarasov , Elizaveta Goncharova , Andrey Kuznetsov

Image inpainting is an effective method to enhance distorted digital images. Different inpainting methods use the information of neighboring pixels to predict the value of missing pixels. Recently deep neural networks have been used to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Mohammad H. Givkashi , Mahshid Hadipour , Arezoo PariZanganeh , Zahra Nabizadeh , Nader Karimi , Shadrokh Samavi

In-context learning is a remarkable capability of transformers, referring to their ability to adapt to specific tasks based on a short history or context. Previous research has found that task-specific information is locally encoded within…

Machine Learning · Computer Science 2025-01-17 Liu Yang , Ziqian Lin , Kangwook Lee , Dimitris Papailiopoulos , Robert Nowak

Natural image matting is an important problem in computer vision and graphics. It is an ill-posed problem when only an input image is available without any external information. While the recent deep learning approaches have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2019-10-04 Qiqi Hou , Feng Liu

Semantic image inpainting is a challenging task where large missing regions have to be filled based on the available visual data. Existing methods which extract information from only a single image generally produce unsatisfactory results…

Computer Vision and Pattern Recognition · Computer Science 2017-07-14 Raymond A. Yeh , Chen Chen , Teck Yian Lim , Alexander G. Schwing , Mark Hasegawa-Johnson , Minh N. Do

The ability to integrate context, including perceptual and temporal cues, plays a pivotal role in grounding the meaning of a linguistic utterance. In order to measure to what extent current vision-and-language models master this ability, we…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Benno Krojer , Vaibhav Adlakha , Vibhav Vineet , Yash Goyal , Edoardo Ponti , Siva Reddy

Recently, much advance has been made in image captioning, and an encoder-decoder framework has achieved outstanding performance for this task. In this paper, we propose an extension of the encoder-decoder framework by adding a component…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Wenhao Jiang , Lin Ma , Xinpeng Chen , Hanwang Zhang , Wei Liu

The character information in natural scene images contains various personal information, such as telephone numbers, home addresses, etc. It is a high risk of leakage the information if they are published. In this paper, we proposed a scene…

Computer Vision and Pattern Recognition · Computer Science 2017-05-09 Toshiki Nakamura , Anna Zhu , Keiji Yanai , Seiichi Uchida

This paper describes a fast and accurate semantic image segmentation approach that encodes not only the discriminative features from deep neural networks, but also the high-order context compatibility among adjacent objects as well as low…

Computer Vision and Pattern Recognition · Computer Science 2016-05-16 Falong Shen , Gang Zeng

Recently image inpainting has witnessed rapid progress due to generative adversarial networks (GAN) that are able to synthesize realistic contents. However, most existing GAN-based methods for semantic inpainting apply an auto-encoder…

Computer Vision and Pattern Recognition · Computer Science 2017-12-22 Haofeng Li , Guanbin Li , Liang Lin , Yizhou Yu

Unsupervised meta-learning aims to learn feature representations from unsupervised datasets that can transfer to downstream tasks with limited labeled data. In this paper, we propose a novel approach to unsupervised meta-learning that…

Machine Learning · Computer Science 2025-02-11 Anna Vettoruzzo , Lorenzo Braccaioli , Joaquin Vanschoren , Marlena Nowaczyk

Context-dependence in human cognition process is a well-established fact. Following this, we introduced the image segmentation method that can use context to classify a pixel on the basis of its membership to a particular object-class of…

Computer Vision and Pattern Recognition · Computer Science 2012-02-10 Upendra Kumar , Tapobrata Lahiri , Manoj Kumar Pal

Over the past several years, we have witnessed impressive progress in the field of learned image compression. Recent learned image codecs are commonly based on autoencoders, that first encode an image into low-dimensional latent…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Zongyu Guo , Zhizheng Zhang , Runsen Feng , Zhibo Chen

We propose the Graph Context Encoder (GCE), a simple but efficient approach for graph representation learning based on graph feature masking and reconstruction. GCE models are trained to efficiently reconstruct input graphs similarly to a…

Machine Learning · Computer Science 2021-06-21 Oriel Frigo , Rémy Brossard , David Dehaene