English
Related papers

Related papers: Improving Image Autoencoder Embeddings with Percep…

200 papers

We present an unsupervised visual feature learning algorithm driven by context-based pixel prediction. By analogy with auto-encoders, we propose Context Encoders -- a convolutional neural network trained to generate the contents of an…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Deepak Pathak , Philipp Krahenbuhl , Jeff Donahue , Trevor Darrell , Alexei A. Efros

Autoencoders are composed of coding and decoding units, hence they hold the inherent potential of high-performance data compression and signal compressed sensing. The main disadvantages of current autoencoders comprise the following several…

Machine Learning · Computer Science 2022-07-28 Honggui Li , Dimitri Galayko , Maria Trocan , Mohamad Sawan

Recently, intermediate feature maps of pre-trained convolutional neural networks have shown significant perceptual quality improvements, when they are used in the loss function for training new networks. It is believed that these features…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Taimoor Tariq , Okan Tarhan Tursun , Munchurl Kim , Piotr Didyk

Ensemble weather predictions typically show systematic errors that have to be corrected via post-processing. Even state-of-the-art post-processing methods based on neural networks often solely rely on location-specific predictors that…

Machine Learning · Computer Science 2022-04-12 Sebastian Lerch , Kai L. Polsterer

This paper proposes an explicit way to optimize the super-resolution network for generating visually pleasing images. The previous approaches use several loss functions which is hard to interpret and has the implicit relationships to…

Image and Video Processing · Electrical Eng. & Systems 2020-09-02 Tomoki Yoshida , Kazutoshi Akita , Muhammad Haris , Norimichi Ukita

Images vary in how memorable they are to humans. Inspired by findings from cognitive science and computer vision, we explore correlates of image memorability in pretrained transformer-based vision encoders for the first time. Focusing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Ece Takmaz , Albert Gatt , Jakub Dotlacil

Autoencoding, which aims to reconstruct the input images through a bottleneck latent representation, is one of the classic feature representation learning strategies. It has been shown effective as an auxiliary task for semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Yuhao Lin , Haiming Xu , Lingqiao Liu , Jinan Zou , Javen Qinfeng Shi

Prototypical network for Few shot learning tries to learn an embedding function in the encoder that embeds images with similar features close to one another in the embedding space. However, in this process, the support set samples for a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Manas Gogoi , Sambhavi Tiwari , Shekhar Verma

Recent work has shown that learned image compression strategies can outperform standard hand-crafted compression algorithms that have been developed over decades of intensive research on the rate-distortion trade-off. With growing…

Image and Video Processing · Electrical Eng. & Systems 2021-11-04 Felipe Codevilla , Jean Gabriel Simard , Ross Goroshin , Chris Pal

Models for image representation learning are typically designed for either recognition or generation. Various forms of contrastive learning help models learn to convert images to embeddings that are useful for classification, detection, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Matthew Gwilliam , Xiao Wang , Xuefeng Hu , Zhenheng Yang

We propose an end-to-end learned image compression codec wherein the analysis transform is jointly trained with an object classification task. This study affirms that the compressed latent representation can predict human perceptual…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Chen-Hsiu Huang , Ja-Ling Wu

Point tracking is a challenging task in computer vision, aiming to establish point-wise correspondence across long video sequences. Recent advancements have primarily focused on temporal modeling techniques to improve local feature…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Zikai Song , Ying Tang , Run Luo , Lintao Ma , Junqing Yu , Yi-Ping Phoebe Chen , Wei Yang

In the recent times, autoencoders, besides being used for compression, have been proven quite useful even for regenerating similar images or help in image denoising. They have also been explored for anomaly detection in a few cases.…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Shruti Mittal , Dattaraj Rao

Zero-shot learning (ZSL) aims to recognize the novel object categories using the semantic representation of categories, and the key idea is to explore the knowledge of how the novel class is semantically related to the familiar classes.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Ying Shi , Wei Wei , Zhiming Zheng

Network embedding is an effective technique to learn the low-dimensional representations of nodes in networks. Real-world networks are usually with multiplex or having multi-view representations from different relations. Recently, there has…

Machine Learning · Computer Science 2022-03-08 Qifan Wang , Yi Fang , Anirudh Ravula , Ruining He , Bin Shen , Jingang Wang , Xiaojun Quan , Dongfang Liu

Vision foundation models (FMs) achieve state-of-the-art performance in medical imaging. However, they encode information in abstract latent representations that clinicians cannot interrogate or verify. The goal of this study is to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Philipp Wesp , Robbie Holland , Vasiliki Sideri-Lampretsa , Sergios Gatidis

We propose a novel approach to improve a visual-semantic embedding model by incorporating concept representations captured from an external structured knowledge base. We investigate its performance on image classification under both…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Mirantha Jayathilaka , Tingting Mu , Uli Sattler

Recent studies have shown that many deep metric learning loss functions perform very similarly under the same experimental conditions. One potential reason for this unexpected result is that all losses let the network focus on similar image…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Konstantin Kobs , Michael Steininger , Andrzej Dulny , Andreas Hotho

Visual Semantic Embedding (VSE) aims to extract the semantics of images and their descriptions, and embed them into the same latent space for cross-modal information retrieval. Most existing VSE networks are trained by adopting a hard…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Yan Gong , Georgina Cosma

Learned image reconstruction techniques using deep neural networks have recently gained popularity, and have delivered promising empirical results. However, most approaches focus on one single recovery for each observation, and thus neglect…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Chen Zhang , Riccardo Barbano , Bangti Jin