English
Related papers

Related papers: DAEs for Linear Inverse Problems: Improved Recover…

200 papers

In this paper, we propose to regularize ill-posed inverse problems using a deep hierarchical variational autoencoder (HVAE) as an image prior. The proposed method synthesizes the advantages of i) denoiser-based Plug \& Play approaches and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Jean Prost , Antoine Houdard , Andrés Almansa , Nicolas Papadakis

In this paper, we explore a new generative approach for learning visual representations. Our method, DARL, employs a decoder-only Transformer to predict image patches autoregressively. We find that training with Mean Squared Error (MSE)…

Machine Learning · Computer Science 2024-06-05 Yazhe Li , Jorg Bornschein , Ting Chen

Diffuse optical tomography (DOT) is a severely ill-posed nonlinear inverse problem that seeks to estimate optical parameters from boundary measurements. In the Bayesian framework, the ill-posedness is diminished by incorporating {\em a…

Numerical Analysis · Mathematics 2023-12-06 Anssi Manninen , Meghdoot Mozumder , Tanja Tarvainen , Andreas Hauptmann

We propose a MultiScale AutoEncoder(MSAE) based extreme image compression framework to offer visually pleasing reconstruction at a very low bitrate. Our method leverages the "priors" at different resolution scale to improve the compression…

Image and Video Processing · Electrical Eng. & Systems 2020-01-06 Chao Huang , Haojie Liu , Tong Chen , Qiu Shen , Zhan Ma

Variational Autoencoders (VAE) are popular generative models used to sample from complex data distributions. Despite their empirical success in various machine learning tasks, significant gaps remain in understanding their theoretical…

Machine Learning · Statistics 2025-12-23 Sobihan Surendran , Antoine Godichon-Baggioni , Sylvain Le Corff

The phase retrieval problem asks to recover a natural signal $y_0 \in \mathbb{R}^n$ from $m$ quadratic observations, where $m$ is to be minimized. As is common in many imaging problems, natural signals are considered sparse with respect to…

Information Theory · Computer Science 2018-07-12 Paul Hand , Oscar Leong , Vladislav Voroninski

Imbalanced data classification problem has always been a popular topic in the field of machine learning research. In order to balance the samples between majority and minority class. Oversampling algorithm is used to synthesize new minority…

Machine Learning · Computer Science 2019-09-02 Junyi Zou , Jinliang Zhang , Ping Jiang

Text style transfer aims to change the style of sentences while preserving the semantic meanings. Due to the lack of parallel data, the Denoising Auto-Encoder (DAE) is widely used in this task to model distributions of different sentence…

Computation and Language · Computer Science 2021-04-28 Jicheng Li , Yang Feng , Jiao Ou

The framework of variational autoencoders (VAEs) provides a principled method for jointly learning latent-variable models and corresponding inference models. However, the main drawback of this approach is the blurriness of the generated…

Machine Learning · Computer Science 2020-07-01 Ioannis Gatopoulos , Maarten Stol , Jakub M. Tomczak

Researchers have applied deep neural networks to image restoration tasks, in which they proposed various network architectures, loss functions, and training methods. In particular, adversarial training, which is employed in recent studies,…

Neural and Evolutionary Computing · Computer Science 2018-03-02 Masanori Suganuma , Mete Ozay , Takayuki Okatani

Variational Autoencoders (VAE) are probabilistic deep generative models underpinned by elegant theory, stable training processes, and meaningful manifold representations. However, they produce blurry images due to a lack of explicit…

Computer Vision and Pattern Recognition · Computer Science 2019-11-15 Prashnna K Gyawali , Rudra Saha , Linwei Wang , VSR Veeravasarapu , Maneesh Singh

In compressed sensing, the goal is to reconstruct the signal from an underdetermined system of linear measurements. Thus, prior knowledge about the signal of interest and its structure is required. Additionally, in many scenarios, the…

Machine Learning · Computer Science 2022-06-29 Anna Kuzina , Kumar Pratik , Fabio Valerio Massoli , Arash Behboodi

Generative models have attracted significant interest due to their ability to handle uncertainty by learning the inherent data distributions. However, two prominent generative models, namely Generative Adversarial Networks (GANs) and…

Machine Learning · Computer Science 2023-04-25 Yu Wang , Zhiwei Liu , Liangwei Yang , Philip S. Yu

Imaging inverse problems can be solved in an unsupervised manner using pre-trained diffusion models, but doing so requires approximating the gradient of the measurement-conditional score function in the diffusion reverse process. We show…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Matt C. Bendel , Saurav K. Shastri , Rizwan Ahmad , Philip Schniter

We present the first framework to solve linear inverse problems leveraging pre-trained latent diffusion models. Previously proposed algorithms (such as DPS and DDRM) only apply to pixel-space diffusion models. We theoretically analyze our…

Machine Learning · Computer Science 2023-07-04 Litu Rout , Negin Raoof , Giannis Daras , Constantine Caramanis , Alexandros G. Dimakis , Sanjay Shakkottai

Visual inspection of underwater structures by vehicles, e.g. remotely operated vehicles (ROVs), plays an important role in scientific, military, and commercial sectors. However, the automatic extraction of information using software tools…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Yousif Hashisho , Mohamad Albadawi , Tom Krause , Uwe Freiherr von Lukas

We propose two novel approaches to the recovery of an (approximately) sparse signal from noisy linear measurements in the case that the signal is a priori known to be non-negative and obey given linear equality constraints, such as simplex…

Information Theory · Computer Science 2015-06-17 Jeremy Vila , Philip Schniter

This paper introduces a novel generative encoder (GE) model for generative imaging and image processing with applications in compressed sensing and imaging, image compression, denoising, inpainting, deblurring, and super-resolution. The GE…

Image and Video Processing · Electrical Eng. & Systems 2019-06-03 Lin Chen , Haizhao Yang

Recent work leverages Vision Foundation Models as image encoders to boost the generative performance of latent diffusion models (LDMs), as their semantic feature distributions are easy to learn. However, such semantic features often lack…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Siyu Liu , Chujie Qin , Hubery Yin , Qixin Yan , Zheng-Peng Duan , Chen Li , Jing Lyu , Chun-Le Guo , Chongyi Li

Auto-Encoders are unsupervised models that aim to learn patterns from observed data by minimizing a reconstruction cost. The useful representations learned are often found to be sparse and distributed. On the other hand, compressed sensing…

Machine Learning · Statistics 2017-07-14 Devansh Arpit , Yingbo Zhou , Hung Q. Ngo , Nils Napp , Venu Govindaraju