English
Related papers

Related papers: Reconstruction of Hidden Representation for Robust…

200 papers

We demonstrate a new deep learning autoencoder network, trained by a nonnegativity constraint algorithm (NCAE), that learns features which show part-based representation of data. The learning algorithm is based on constraining negative…

Machine Learning · Computer Science 2016-01-13 Ehsan Hosseini-Asl , Jacek M. Zurada , Olfa Nasraoui

This letter introduces a new denoiser that modifies the structure of denoising autoencoder (DAE), namely noise learning based DAE (nlDAE). The proposed nlDAE learns the noise of the input data. Then, the denoising is performed by…

Machine Learning · Computer Science 2022-01-24 Woong-Hee Lee , Mustafa Ozger , Ursula Challita , Ki Won Sung

In our previous work, we proposed a discriminative autoencoder (DcAE) for speech recognition. DcAE combines two training schemes into one. First, since DcAE aims to learn encoder-decoder mappings, the squared error between the reconstructed…

Sound · Computer Science 2022-06-16 Hung-Shin Lee , Pin-Tuan Huang , Yao-Fei Cheng , Hsin-Min Wang

As the rapid growth of high-speed and deep-tissue imaging in biomedical research, it is urgent to find a robust and effective denoising method to retain morphological features for further texture analysis and segmentation. Conventional…

Image and Video Processing · Electrical Eng. & Systems 2019-04-16 Sheng-Yong Niu , Lun-Zhang Guo , Yue Li , Tzung-Dau Wang , Yu Tsao , Tzu-Ming Liu

Recent work leverages Vision Foundation Models as image encoders to boost the generative performance of latent diffusion models (LDMs), as their semantic feature distributions are easy to learn. However, such semantic features often lack…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Siyu Liu , Chujie Qin , Hubery Yin , Qixin Yan , Zheng-Peng Duan , Chen Li , Jing Lyu , Chun-Le Guo , Chongyi Li

This paper introduces a methodology based on Denoising AutoEncoder (DAE) for missing data imputation. The proposed methodology, called mDAE hereafter, results from a modification of the loss function and a straightforward procedure for…

Machine Learning · Computer Science 2024-11-21 Mariette Dupuy , Marie Chavent , Remi Dubois

In contrast to fully-supervised models, self-supervised representation learning only needs a fraction of data to be labeled and often achieves the same or even higher downstream performance. The goal is to pre-train deep neural networks on…

Machine Learning · Computer Science 2025-04-09 Friederike Baier , Sebastian Mair , Samuel G. Fadel

With the mass construction of Gen III nuclear reactors, it is a popular trend to use deep learning (DL) techniques for fast and effective diagnosis of possible accidents. To overcome the common problems of previous work in diagnosing…

Signal Processing · Electrical Eng. & Systems 2022-09-26 Chengyuan Li , Zhifang Qiu , Zhangrui Yan , Meifu Li

Generative autoencoders offer a promising approach for controllable text generation by leveraging their latent sentence representations. However, current models struggle to maintain coherent latent spaces required to perform meaningful text…

Machine Learning · Computer Science 2020-07-08 Tianxiao Shen , Jonas Mueller , Regina Barzilay , Tommi Jaakkola

Recent work has shown how denoising and contractive autoencoders implicitly capture the structure of the data-generating density, in the case where the corruption noise is Gaussian, the reconstruction error is the squared error, and the…

Machine Learning · Computer Science 2013-11-12 Yoshua Bengio , Li Yao , Guillaume Alain , Pascal Vincent

Autoencoders have achieved great success in various computer vision applications. The autoencoder learns appropriate low dimensional image representations through the self-supervised paradigm, i.e., reconstruction. Existing studies mainly…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jianzhang Zheng , Hao Shen , Jian Yang , Xuan Tang , Mingsong Chen , Hui Yu , Jielong Guo , Xian Wei

Diffusion models have become the dominant paradigm for image generation and editing, with latent diffusion models shifting denoising to a compact latent space for efficiency and scalability. Recent attempts to leverage pretrained visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yue Gong , Hongyu Li , Shanyuan Liu , Bo Cheng , Yuhang Ma , Liebucha Wu , Xiaoyu Wu , Manyuan Zhang , Dawei Leng , Yuhui Yin , Lijun Zhang

Unsupervised dimensionality reduction is one of the commonly used techniques in the field of high dimensional data recognition problems. The deep autoencoder network which constrains the weights to be non-negative, can learn a low…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Anyong Qin , Zhaowei Shang , Zhuolin Tan , Taiping Zhang , Yuan Yan Tang

Researchers have applied deep neural networks to image restoration tasks, in which they proposed various network architectures, loss functions, and training methods. In particular, adversarial training, which is employed in recent studies,…

Neural and Evolutionary Computing · Computer Science 2018-03-02 Masanori Suganuma , Mete Ozay , Takayuki Okatani

Reconstruction error-based neural architectures constitute a classical deep learning approach to anomaly detection which has shown great performances. It consists in training an Autoencoder to reconstruct a set of examples deemed to…

Machine Learning · Computer Science 2024-06-06 Fabrizio Angiulli , Fabio Fassetti , Luca Ferragina

We discuss the similarities and differences between training an auto-encoder to minimize the reconstruction error, and training the same auto-encoder to compress the data via a generative model. Minimizing a codelength for the data using an…

Neural and Evolutionary Computing · Computer Science 2015-01-26 Yann Ollivier

In one-class novelty detection, a model learns solely on the in-class data to single out out-class instances. Autoencoder (AE) variants aim to compactly model the in-class data to reconstruct it exclusively, thus differentiating the…

Machine Learning · Computer Science 2022-07-25 Jaewoo Park , Yoon Gyo Jung , Andrew Beng Jin Teoh

Anomaly detection is the task of recognising novel samples which deviate significantly from pre-establishednormality. Abnormal classes are not present during training meaning that models must learn effective rep-resentations solely across…

Machine Learning · Computer Science 2023-03-08 Jack W Barker , Neelanjan Bhowmik , Yona Falinie A Gaus , Toby P Breckon

We present Deep Compression Autoencoder (DC-AE), a new family of autoencoder models for accelerating high-resolution diffusion models. Existing autoencoder models have demonstrated impressive results at a moderate spatial compression ratio…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Junyu Chen , Han Cai , Junsong Chen , Enze Xie , Shang Yang , Haotian Tang , Muyang Li , Yao Lu , Song Han

Recent work has shown that deep neural networks are highly sensitive to tiny perturbations of input images, giving rise to adversarial examples. Though this property is usually considered a weakness of learned models, we explore whether it…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Jiren Zhu , Russell Kaplan , Justin Johnson , Li Fei-Fei