English
Related papers

Related papers: Pretraining Image Encoders without Reconstruction …

200 papers

Autoencoding, which aims to reconstruct the input images through a bottleneck latent representation, is one of the classic feature representation learning strategies. It has been shown effective as an auxiliary task for semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Yuhao Lin , Haiming Xu , Lingqiao Liu , Jinan Zou , Javen Qinfeng Shi

We present an unsupervised visual feature learning algorithm driven by context-based pixel prediction. By analogy with auto-encoders, we propose Context Encoders -- a convolutional neural network trained to generate the contents of an…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Deepak Pathak , Philipp Krahenbuhl , Jeff Donahue , Trevor Darrell , Alexei A. Efros

Over the years, computer vision researchers have spent an immense amount of effort on designing image features for the visual object recognition task. We propose to incorporate this valuable experience to guide the task of training deep…

Computer Vision and Pattern Recognition · Computer Science 2016-11-15 Ming-Yu Liu , Arun Mallya , Oncel C. Tuzel , Xi Chen

The joint optimization of the reconstruction and classification error is a hard non convex problem, especially when a non linear mapping is utilized. In order to overcome this obstacle, a novel optimization strategy is proposed, in which a…

Machine Learning · Computer Science 2022-11-07 Ioannis A. Nellas , Sotiris K. Tasoulis , Vassilis P. Plagianakos , Spiros V. Georgakopoulos

Weakly-supervised anomaly detection aims at learning an anomaly detector from a limited amount of labeled data and abundant unlabeled data. Recent works build deep neural networks for anomaly detection by discriminatively mapping the normal…

Machine Learning · Computer Science 2021-08-29 Yingjie Zhou , Xucheng Song , Yanru Zhang , Fanxing Liu , Ce Zhu , Lingqiao Liu

To train Variational Autoencoders (VAEs) to generate realistic imagery requires a loss function that reflects human perception of image similarity. We propose such a loss function based on Watson's perceptual model, which computes a…

Machine Learning · Computer Science 2021-01-07 Steffen Czolbe , Oswin Krause , Ingemar Cox , Christian Igel

Learned image reconstruction techniques using deep neural networks have recently gained popularity, and have delivered promising empirical results. However, most approaches focus on one single recovery for each observation, and thus neglect…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Chen Zhang , Riccardo Barbano , Bangti Jin

Hashing-based methods seek compact and efficient binary codes that preserve the neighborhood structure in the original data space. For most existing hashing methods, an image is first encoded as a vector of hand-crafted visual feature,…

Computer Vision and Pattern Recognition · Computer Science 2015-07-17 Guoqiang Zhong , Pan Yang , Sijiang Wang , Junyu Dong

We consider image transformation problems, where an input image is transformed into an output image. Recent methods for such problems typically train feed-forward convolutional neural networks using a \emph{per-pixel} loss between the…

Computer Vision and Pattern Recognition · Computer Science 2016-03-29 Justin Johnson , Alexandre Alahi , Li Fei-Fei

Image-generating machine learning models are typically trained with loss functions based on distance in the image space. This often leads to over-smoothed results. We propose a class of loss functions, which we call deep perceptual…

Machine Learning · Computer Science 2016-02-10 Alexey Dosovitskiy , Thomas Brox

Recent learning-based lossless image compression methods encode an image in the unit of subimages and achieve comparable performances to conventional non-learning algorithms. However, these methods do not consider the performance drop in…

Image and Video Processing · Electrical Eng. & Systems 2021-12-14 Hochang Rhee , Yeong Il Jang , Seyun Kim , Nam Ik Cho

Autoencoders learn data representations through reconstruction. Robust training is the key factor affecting the quality of the learned representations and, consequently, the accuracy of the application that use them. Previous works…

Neural and Evolutionary Computing · Computer Science 2018-07-11 Maisa Doaud , Michael Mayo

Training-free perceptual image codec adopt pre-trained unconditional generative model during decoding to avoid training new conditional generative model. However, they heavily rely on diffusion inversion or sample communication, which take…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 Ziran Zhu , Tongda Xu , Minye Huang , Dailan He , Xingtong Ge , Xinjie Zhang , Ling Li , Yan Wang

Many classical Computer Vision problems, such as essential matrix computation and pose estimation from 3D to 2D correspondences, can be solved by finding the eigenvector corresponding to the smallest, or zero, eigenvalue of a matrix…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Zheng Dang , Kwang Moo Yi , Yinlin Hu , Fei Wang , Pascal Fua , Mathieu Salzmann

Perceptual losses have emerged as powerful tools for training networks to enhance Low-Dose Computed Tomography (LDCT) images, offering an alternative to traditional pixel-wise losses such as Mean Squared Error, which often lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Gabriel A. Viana , Luis F. Alves Pereira , Tsang Ing Ren , George D. C. Cavalcanti , Jan Sijbers

Harnessing the power of pre-training on large-scale datasets like ImageNet forms a fundamental building block for the progress of representation learning-driven solutions in computer vision. Medical images are inherently different from…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Jeya Maria Jose Valanarasu , Yucheng Tang , Dong Yang , Ziyue Xu , Can Zhao , Wenqi Li , Vishal M. Patel , Bennett Landman , Daguang Xu , Yufan He , Vishwesh Nath

Current vision language pretraining models are dominated by methods using region visual features extracted from object detectors. Given their good performance, the extract-then-process pipeline significantly restricts the inference speed…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Xiaofeng Yang , Fayao Liu , Guosheng Lin

Lane detection is crucial for vehicle localization which makes it the foundation for automated driving and many intelligent and advanced driving assistant systems. Available vision-based lane detection methods do not make full use of the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Ruohan Li , Yongqi Dong

An effective technique for obtaining high-quality representations is adding a projection head on top of the encoder during training, then discarding it and using the pre-projection representations. Despite its proven practical…

Machine Learning · Computer Science 2024-03-19 Yihao Xue , Eric Gan , Jiayi Ni , Siddharth Joshi , Baharan Mirzasoleiman

We propose an end-to-end learned image compression codec wherein the analysis transform is jointly trained with an object classification task. This study affirms that the compressed latent representation can predict human perceptual…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Chen-Hsiu Huang , Ja-Ling Wu