English
Related papers

Related papers: Variational AutoEncoder for Reference based Image …

200 papers

This paper addresses the problem of lossy image compression, a fundamental problem in image processing and information theory that is involved in many real-world applications. We start by reviewing the framework of variational autoencoders…

Image and Video Processing · Electrical Eng. & Systems 2023-12-06 Zhihao Duan , Ming Lu , Jack Ma , Yuning Huang , Zhan Ma , Fengqing Zhu

In this paper, we propose a Text-Degradation Invariant Auto Encoder (Text-DIAE), a self-supervised model designed to tackle two tasks, text recognition (handwritten or scene-text) and document image enhancement. We start by employing a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Mohamed Ali Souibgui , Sanket Biswas , Andres Mafla , Ali Furkan Biten , Alicia Fornés , Yousri Kessentini , Josep Lladós , Lluis Gomez , Dimosthenis Karatzas

We propose a quantum implicit neural representation (QINR)-based autoencoder (AE) and variational autoencoder (VAE) for image reconstruction and generation tasks. Our purpose is to demonstrate that the QINR in VAEs and AEs can transform…

Machine Learning · Computer Science 2026-03-17 Saadet Müzehher Eren

The key idea of variational auto-encoders (VAEs) resembles that of traditional auto-encoder models in which spatial information is supposed to be explicitly encoded in the latent space. However, the latent variables in VAEs are vectors,…

Machine Learning · Computer Science 2019-01-23 Zhengyang Wang , Hao Yuan , Shuiwang Ji

In this paper we tackle Image Super Resolution (ISR), using recent advances in Visual Auto-Regressive (VAR) modeling. VAR iteratively estimates the residual in latent space between gradually increasing image scales, a process referred to as…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Enrique Sanchez , Isma Hadji , Adrian Bulat , Christos Tzelepis , Brais Martinez , Georgios Tzimiropoulos

Learning useful representations without supervision remains a key challenge in machine learning. In this paper, we propose a simple yet powerful generative model that learns such discrete representations. Our model, the Vector…

Machine Learning · Computer Science 2018-05-31 Aaron van den Oord , Oriol Vinyals , Koray Kavukcuoglu

Autoencoders have found widespread application in both their original deterministic form and in their variational formulation (VAEs). In scientific applications and in image processing it is often of interest to consider data that are…

Machine Learning · Statistics 2025-09-09 Justin Bunker , Mark Girolami , Hefin Lambley , Andrew M. Stuart , T. J. Sullivan

Learning latent representations that are simultaneously expressive, geometrically well-structured, and reliably calibrated remains a central challenge for Variational Autoencoders (VAEs). Standard VAEs typically assume a diagonal Gaussian…

Machine Learning · Computer Science 2025-12-02 Mehmet Can Yavuz

In this paper we present seven techniques that everybody should know to improve example-based single image super resolution (SR): 1) augmentation of data, 2) use of large dictionaries with efficient search structures, 3) cascading, 4) image…

Computer Vision and Pattern Recognition · Computer Science 2015-11-09 Radu Timofte , Rasmus Rothe , Luc Van Gool

Unmanned underwater image analysis for marine monitoring faces two key challenges: (i) degraded image quality due to light attenuation and (ii) hardware storage constraints limiting high-resolution image collection. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Rita Pucci , Niki Martinel

Deep learning-based image processing algorithms, including image super-resolution methods, have been proposed with significant improvement in performance in recent years. However, their implementations and evaluations are dispersed in terms…

Image and Video Processing · Electrical Eng. & Systems 2020-06-03 Jun-Ho Choi , Jun-Hyuk Kim , Jong-Seok Lee

Variational AutoEncoders (VAEs) provide a means to generate representational latent embeddings. Previous research has highlighted the benefits of achieving representations that are disentangled, particularly for downstream tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2019-11-18 Matthew J. Vowels , Necati Cihan Camgoz , Richard Bowden

While diffusion models have achieved state-of-the-art performance in Image Super-Resolution (SR), their prohibitive computational and memory demands restrict their training and inference to fixed-size inputs. The standard workaround to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Shoukun Sun , Zhe Wang , Xiang Que , Jiyin Zhang , Xiaogang Ma

Super-resolution (SR), a classical inverse problem in computer vision, is inherently ill-posed, inducing a distribution of plausible solutions for every input. However, the desired result is not simply the expectation of this distribution,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Fengjia Zhang , Samrudhdhi B. Rangrej , Tristan Aumentado-Armstrong , Afsaneh Fazly , Alex Levinshtein

We present Recurrent Video Masked-Autoencoders (RVM): a novel approach to video representation learning that leverages recurrent computation to model the temporal structure of video data. RVM couples an asymmetric masking objective with a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Daniel Zoran , Nikhil Parthasarathy , Yi Yang , Drew A Hudson , Joao Carreira , Andrew Zisserman

Variational Auto-Encoders (VAEs) are capable of learning latent representations for high dimensional data. However, due to the i.i.d. assumption, VAEs only optimize the singleton variational distributions and fail to account for the…

Machine Learning · Computer Science 2020-04-20 Da Tang , Dawen Liang , Tony Jebara , Nicholas Ruozzi

In this paper, we propose to regularize ill-posed inverse problems using a deep hierarchical variational autoencoder (HVAE) as an image prior. The proposed method synthesizes the advantages of i) denoiser-based Plug \& Play approaches and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Jean Prost , Antoine Houdard , Andrés Almansa , Nicolas Papadakis

We present SR3, an approach to image Super-Resolution via Repeated Refinement. SR3 adapts denoising diffusion probabilistic models to conditional image generation and performs super-resolution through a stochastic denoising process.…

Image and Video Processing · Electrical Eng. & Systems 2021-07-01 Chitwan Saharia , Jonathan Ho , William Chan , Tim Salimans , David J. Fleet , Mohammad Norouzi

This paper presents a general-purpose video super-resolution (VSR) method, dubbed VSR-HE, specifically designed to enhance the perceptual quality of compressed content. Targeting scenarios characterized by heavy compression, the method…

Image and Video Processing · Electrical Eng. & Systems 2025-06-18 Yuxuan Jiang , Siyue Teng , Qiang Zhu , Chen Feng , Chengxi Zeng , Fan Zhang , Shuyuan Zhu , Bing Zeng , David Bull

We present a novel approach to enhance the capabilities of VQ-VAE models through the integration of a Residual Encoder and a Residual Pixel Attention layer, named Attentive Residual Encoder (AREN). The objective of our research is to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Angello Hoyos , Mariano Rivera