English
Related papers

Related papers: On denoising autoencoders trained to minimise bina…

200 papers

We present the Tamed Cross Entropy (TCE) loss function, a robust derivative of the standard Cross Entropy (CE) loss used in deep learning for classification tasks. However, unlike other robust losses, the TCE loss is designed to exhibit the…

Machine Learning · Computer Science 2018-10-12 Manuel Martinez , Rainer Stiefelhagen

Text style transfer aims to change the style of sentences while preserving the semantic meanings. Due to the lack of parallel data, the Denoising Auto-Encoder (DAE) is widely used in this task to model distributions of different sentence…

Computation and Language · Computer Science 2021-04-28 Jicheng Li , Yang Feng , Jiao Ou

Error correcting codes play a central role in digital communication, ensuring that transmitted information can be accurately reconstructed despite channel impairments. Recently, autoencoder (AE) based approaches have gained attention for…

Information Theory · Computer Science 2025-11-13 Vukan Ninkovic , Dejan Vukobratovic

Recent work has advocated for the use of deep learning to perform power allocation in the downlink of massive MIMO (maMIMO) networks. Yet, such deep learning models are vulnerable to adversarial attacks. In the context of maMIMO power…

Signal Processing · Electrical Eng. & Systems 2023-03-21 Rajeev Sahay , Minjun Zhang , David J. Love , Christopher G. Brinton

Deep neural networks (DNNs) have achieved tremendous success in a variety of applications across many disciplines. Yet, their superior performance comes with the expensive cost of requiring correctly annotated large-scale datasets.…

Machine Learning · Computer Science 2018-12-03 Zhilu Zhang , Mert R. Sabuncu

Due to the rare occurrence of anomalous events, a typical approach to anomaly detection is to train an autoencoder (AE) with normal data only so that it learns the patterns or representations of the normal training data. At test time, the…

Machine Learning · Computer Science 2024-05-20 Marcella Astrid , Muhammad Zaigham Zaheer , Djamila Aouada , Seung-Ik Lee

We explore the use of deep neural networks for nonlinear dimensionality reduction in climate applications. We train convolutional autoencoders (CAEs) to encode two temperature field datasets from pre-industrial control runs in the CMIP5…

Atmospheric and Oceanic Physics · Physics 2018-09-06 J. A. Saenz , N. Lubbers , N. M. Urban

This paper introduces a methodology based on Denoising AutoEncoder (DAE) for missing data imputation. The proposed methodology, called mDAE hereafter, results from a modification of the loss function and a straightforward procedure for…

Machine Learning · Computer Science 2024-11-21 Mariette Dupuy , Marie Chavent , Remi Dubois

Deep convolutional neural networks (CNN) proved to be highly accurate to perform anatomical segmentation of medical images. However, some of the most popular CNN architectures for image segmentation still rely on post-processing strategies…

Image and Video Processing · Electrical Eng. & Systems 2019-06-07 Agostina J. Larrazabal , Cesar Martinez , Enzo Ferrante

Wildfire monitoring requires high-resolution atmospheric measurements, yet low-cost sensors on Unmanned Aerial Vehicles (UAVs) exhibit baseline drift, cross-sensitivity, and response lag that corrupt concentration estimates. Traditional…

Variational autoencoders (VAEs) learn representations of data by jointly training a probabilistic encoder and decoder network. Typically these models encode all features of the data into a single variable. Here we are interested in learning…

With the rapid advancement and increased use of deep learning models in image identification, security becomes a major concern to their deployment in safety-critical systems. Since the accuracy and robustness of deep learning models are…

Machine Learning · Computer Science 2022-08-31 Dvij Kalaria , Aritra Hazra , Partha Pratim Chakrabarti

The Denoising Autoencoder (DAE) enhances the flexibility of the data stream method in exploiting unlabeled samples. Nonetheless, the feasibility of DAE for data stream analytic deserves an in-depth study because it characterizes a fixed…

Machine Learning · Computer Science 2020-01-10 Andri Ashfahani , Mahardhika Pratama , Edwin Lughofer , Yew Soon Ong

Many real-world monitoring and surveillance applications require non-trivial anomaly detection to be run in the streaming model. We consider an incremental-learning approach, wherein a deep-autoencoding (DAE) model of what is normal is…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Albert Akhriev , Jakub Marecek

Autoencoders have been widely used for dimensional reduction and feature extraction. Various types of autoencoders have been proposed by introducing regularization terms. Most of these regularizations improve representation learning by…

Machine Learning · Computer Science 2020-06-26 Yuzhu Guo , Kang Pan , Simeng Li , Zongchang Han , Kexin Wang , Li Li

Increasingly many real world tasks involve data in multiple modalities or views. This has motivated the development of many effective algorithms for learning a common latent space to relate multiple domains. However, most existing…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Tanmoy Mukherjee , Makoto Yamada , Timothy M. Hospedales

Energy-based models parameterize the unnormalized log-probability of data samples, but there is a lack of guidance on how to construct the "energy". In this paper, we propose a Denoising-EBM which decomposes the image energy into "semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Weili Zeng

Deep learning has made significant strides in medical imaging, leveraging the use of large datasets to improve diagnostics and prognostics. However, large datasets often come with inherent errors through subject selection and acquisition.…

Even though machine learning (ML) techniques are being widely used in communications, the question of how to train communication systems has received surprisingly little attention. In this paper, we show that the commonly used binary…

Information Theory · Computer Science 2023-03-08 Reinhard Wiesmayr , Gian Marti , Chris Dick , Haochuan Song , Christoph Studer

Despite their ubiquity, variational autoencoders (VAEs) inherently suffer from posterior collapse, a failure mode in which latent variables are effectively ignored. This failure arises because explicit prior imposition drives optimization…

Machine Learning · Computer Science 2026-05-18 Hazhir Aliahmadi , Irina Babayan , Greg van Anders