English
Related papers

Related papers: Generalized Denoising Auto-Encoders as Generative …

200 papers

Compressed sensing techniques enable efficient acquisition and recovery of sparse, high-dimensional data signals via low-dimensional projections. In this work, we propose Uncertainty Autoencoders, a learning framework for unsupervised…

Machine Learning · Statistics 2019-04-15 Aditya Grover , Stefano Ermon

We study universal decoding over unknown discrete additive channels determined by a finite-state (unifilar) random process. Aiming at low-complexity decoders, we study variants of noise-guessing decoders that use estimators for the…

Information Theory · Computer Science 2025-07-24 Henrique K. Miyamoto , Sheng Yang

We describe a novel method for training high-quality image denoising models based on unorganized collections of corrupted images. The training does not need access to clean reference images, or explicit pairs of corrupted images, and can…

Machine Learning · Computer Science 2019-10-29 Samuli Laine , Tero Karras , Jaakko Lehtinen , Timo Aila

Lacking rich and realistic data, learned single image denoising algorithms generalize poorly to real raw images that do not resemble the data used for training. Although the problem can be alleviated by the heteroscedastic Gaussian model…

Image and Video Processing · Electrical Eng. & Systems 2020-04-10 Kaixuan Wei , Ying Fu , Jiaolong Yang , Hua Huang

In this work, we study the generalizability of diffusion models by looking into the hidden properties of the learned score functions, which are essentially a series of deep denoisers trained on various noise levels. We observe that as…

Machine Learning · Computer Science 2024-12-03 Xiang Li , Yixiang Dai , Qing Qu

This paper studies the problem of accurately recovering a structured signal from a small number of corrupted sub-Gaussian measurements. We consider three different procedures to reconstruct signal and corruption when different kinds of…

Information Theory · Computer Science 2017-05-23 Jinchi Chen , Yulong Liu

In this work, we dive deep into the impact of additive noise in pre-training deep networks. While various methods have attempted to use additive noise inspired by the success of latent denoising diffusion models, when used in combination…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Hyesong Choi , Daeun Kim , Sungmin Cha , Kwang Moo Yi , Dongbo Min

Denoising diffusion models are a class of generative models which have recently achieved state-of-the-art results across many domains. Gradual noise is added to the data using a diffusion process, which transforms the data distribution into…

Machine Learning · Statistics 2024-06-28 Francisco Vargas , Teodora Reu , Anna Kerekes , Michael M Bronstein

While deep neural networks have been shown to perform remarkably well in many machine learning tasks, labeling a large amount of ground truth data for supervised training is usually very costly to scale. Therefore, learning robust…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Jianbo Jiao , Linchao Bao , Yunchao Wei , Shengfeng He , Honghui Shi , Rynson Lau , Thomas S. Huang

Discriminative model learning for image denoising has been recently attracting considerable attentions due to its favorable denoising performance. In this paper, we take one step forward by investigating the construction of feed-forward…

Computer Vision and Pattern Recognition · Computer Science 2017-06-07 Kai Zhang , Wangmeng Zuo , Yunjin Chen , Deyu Meng , Lei Zhang

We provide a series of results for unsupervised learning with autoencoders. Specifically, we study shallow two-layer autoencoder architectures with shared weights. We focus on three generative models for data that are common in statistical…

Machine Learning · Statistics 2019-02-18 Thanh V. Nguyen , Raymond K. W. Wong , Chinmay Hegde

Discretization of continuous stochastic processes is needed to numerically simulate them or to infer models from experimental time series. However, depending on the nature of the process, the same discretization scheme, if not accurate…

Machine Learning · Statistics 2022-05-04 Federica Ferretti , Victor Chardès , Thierry Mora , Aleksandra M Walczak , Irene Giardina

Denoising is the process of removing noise from sound signals while improving the quality and adequacy of the sound signals. Denoising sound has many applications in speech processing, sound events classification, and machine failure…

Sound · Computer Science 2022-08-10 Thanh Tran , Sebastian Bader , Jan Lundgren

Physics-integrated generative modeling is a class of hybrid or grey-box modeling in which we augment the the data-driven model with the physics knowledge governing the data distribution. The use of physics knowledge allows the generative…

Machine Learning · Computer Science 2024-04-19 Sheikh Waqas Akhtar

One of the most important problems in regression-based error model is modeling the complex representation error caused by various corruptions and environment changes in images. For example, in robust face recognition, images are often…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Miaohua Zhang , Yongsheng Gao , Jun Zhou

Image noise is ubiquitous in photography. However, image noise is not compressible nor desirable, thus attempting to convey the noise in compressed image bitstreams yields sub-par results in both rate and distortion. We propose to…

Image and Video Processing · Electrical Eng. & Systems 2023-07-13 Benoit Brummer , Christophe De Vleeschouwer

In machine learning approach to image denoising a network is trained to recover a clean image from a noisy one. In this paper a novel structure is proposed based on training multiple specialized networks as opposed to existing structures…

Image and Video Processing · Electrical Eng. & Systems 2020-12-01 Seyed Mohsen Hosseini

Noise synthesis is a challenging low-level vision task aiming to generate realistic noise given a clean image along with the camera settings. To this end, we propose an effective generative model which utilizes clean features as guidance…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Mingyang Song , Yang Zhang , Tunç O. Aydın , Elham Amin Mansour , Christopher Schroers

We consider the problem of reconstructing a discrete-time signal (sequence) with continuous-valued components corrupted by a known memoryless channel. When performance is measured using a per-symbol loss function satisfying mild regularity…

Information Theory · Computer Science 2008-07-23 Kamakshi Sivaramakrishnan , Tsachy Weissman

Convolutional sparse coding (CSC) can learn representative shift-invariant patterns from multiple kinds of data. However, existing CSC methods can only model noises from Gaussian distribution, which is restrictive and unrealistic. In this…

Machine Learning · Computer Science 2020-04-22 Yaqing Wang , James T. Kwok , Lionel M. Ni