English
Related papers

Related papers: A practical tutorial on autoencoders for nonlinear…

200 papers

Sparse autoencoders (SAEs) are a recent technique for decomposing neural network activations into human-interpretable features. However, in order for SAEs to identify all features represented in frontier models, it will be necessary to…

Machine Learning · Computer Science 2025-06-04 Anish Mudide , Joshua Engels , Eric J. Michaud , Max Tegmark , Christian Schroeder de Witt

Sparse autoencoders (SAEs) are one of the main methods to interpret the inner workings of deep neural networks (DNNs), decomposing activations into higher-dimensional features. However, they exhibit critical shortcomings where a large…

Machine Learning · Computer Science 2026-05-19 Michał Brzozowski , Neo Christopher Chung

Autoencoders have long been considered a nonlinear extension of Principal Component Analysis (PCA). Prior studies have demonstrated that linear autoencoders (LAEs) can recover the ordered, axis-aligned principal components of PCA by…

Machine Learning · Computer Science 2026-01-28 Qipeng Zhan , Zhuoping Zhou , Zexuan Wang , Li Shen

We present a coupled Variational Auto-Encoder (VAE) method that improves the accuracy and robustness of the probabilistic inferences on represented data. The new method models the dependency between input feature vectors (images) and weighs…

Machine Learning · Computer Science 2025-11-25 Shichen Cao , Jingjing Li , Kenric P. Nelson , Mark A. Kon

Variational Autoencoders (VAEs) have experienced recent success as data-generating models by using simple architectures that do not require significant fine-tuning of hyperparameters. However, VAEs are known to suffer from…

Machine Learning · Statistics 2020-07-22 Wei Cheng , Gregory Darnell , Sohini Ramachandran , Lorin Crawford

Feature selection has emerged as a crucial technique in refining recommender systems. Recent advancements leveraging Automated Machine Learning (AutoML) has drawn significant attention, particularly in two main categories: early feature…

Information Retrieval · Computer Science 2025-09-16 Fan Hu , Gaofeng Lu , Jun Chen , Chaonan Guo , Yuekui Yang , Xirong Li

The field of imbalanced self-supervised learning, especially in the context of tabular data, has not been extensively studied. Existing research has predominantly focused on image datasets. This paper aims to fill this gap by examining the…

Machine Learning · Computer Science 2024-03-26 Samuel Stocksieker , Denys Pommeret , Arthur Charpentier

In recent years Variation Autoencoders have become one of the most popular unsupervised learning of complicated distributions.Variational Autoencoder (VAE) provides more efficient reconstructive performance over a traditional autoencoder.…

Machine Learning · Statistics 2017-07-12 Gautam Ramachandra

The electrocardiogram (ECG) is an inexpensive and widely available tool for cardiac assessment. Despite its standardized format and small file size, the high complexity and inter-individual variability of ECG signals (typically a…

Machine Learning · Computer Science 2025-08-04 Christopher Harvey , Sumaiya Shomaji , Zijun Yao , Amit Noheria

Despite numerous studies of deep autoencoders (AEs) for unsupervised anomaly detection, AEs still lack a way to express uncertainty in their predictions, crucial for ensuring safe and trustworthy machine learning systems in high-stake…

Machine Learning · Computer Science 2022-02-28 Bang Xiang Yong , Alexandra Brintrup

Variational Autoencoders (VAEs) are well-established as a principled approach to probabilistic unsupervised learning with neural networks. Typically, an encoder network defines the parameters of a Gaussian distributed latent space from…

Machine Learning · Computer Science 2025-05-16 Alan Jeffares , Liyuan Liu

Autoencoders are a class of artificial neural networks which have gained a lot of attention in the recent past. Using the encoder block of an autoencoder the input image can be compressed into a meaningful representation. Then a decoder is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Sayan Nag

Density estimation, compression and data generation are crucial tasks in artificial intelligence. Variational Auto-Encoders (VAEs) constitute a single framework to achieve these goals. Here, we present a novel class of generative models,…

Machine Learning · Statistics 2021-07-07 Ioannis Gatopoulos , Jakub M. Tomczak

Until now, of highest relevance for remote sensing data processing and analysis have been techniques for pixel level image fusion. So, This paper attempts to undertake the study of Feature-Level based image fusion. For this purpose, feature…

Computer Vision and Pattern Recognition · Computer Science 2012-09-18 Firouz Abdullah Al-Wassai , N. V. Kalyankar , Ali A. Al-Zaky

The latent variables learned by VAEs have seen considerable interest as an unsupervised way of extracting features, which can then be used for downstream tasks. There is a growing interest in the question of whether features learned on one…

Machine Learning · Computer Science 2020-05-13 Saeid Asgari Taghanaki , Mohammad Havaei , Alex Lamb , Aditya Sanghi , Ara Danielyan , Tonya Custis

Recently, neural networks have gained attention for creating parametric and invertible multidimensional data projections. Parametric projections allow for embedding previously unseen data without recomputing the projection as a whole, while…

Machine Learning · Computer Science 2026-02-10 Frederik L. Dennig , Nina Geyer , Daniela Blumberg , Yannick Metz , Daniel A. Keim

Detecting anomalies for multivariate time-series without manual supervision continues a challenging problem due to the increased scale of dimensions and complexity of today's IT monitoring systems. Recent progress of unsupervised…

Machine Learning · Computer Science 2021-10-19 Qinfeng Xiao , Shikuan Shao , Jing Wang

Generating semantic segmentation datasets has consistently been laborious and time-consuming, particularly in the context of large models or specialized domains(i.e. Medical Imaging or Remote Sensing). Specifically, large models necessitate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Jiaru Jia , Mingzhe Liu , Jiake Xie , Xin Chen , Hong Zhang , Feixiang Zhao , Aiqing Yang

Variational autoencoders (VAEs) are used for transfer learning across various research domains such as music generation or medical image analysis. However, there is no principled way to assess before transfer which components to retrain or…

Machine Learning · Computer Science 2023-04-24 Lisa Bonheme , Marek Grzes

In Federated Learning (FL), anomaly detection (AD) is a challenging task due to the decentralized nature of data and the presence of non-IID data distributions. This study introduces a novel federated threshold calculation method that…

Machine Learning · Computer Science 2024-10-15 Sofiane Laridi , Gregory Palmer , Kam-Ming Mark Tam