English
Related papers

Related papers: Improving Variational Autoencoder using Random Fou…

200 papers

Denoising autoencoders (DAE) are trained to reconstruct their clean inputs with noise injected at the input level, while variational autoencoders (VAE) are trained with noise injected in their stochastic hidden layer, with a regularizer…

Machine Learning · Computer Science 2016-01-05 Daniel Jiwoong Im , Sungjin Ahn , Roland Memisevic , Yoshua Bengio

The current practice of manually processing features for high-dimensional and heterogeneous aviation data is labor-intensive, does not scale well to new problems, and is prone to information loss, affecting the effectiveness and…

Machine Learning · Computer Science 2020-11-10 Liya Wang , Panta Lucic , Keith Campbell , Craig Wanke

In recent years, the field of machine learning has made phenomenal progress in the pursuit of simulating real-world data generation processes. One notable example of such success is the variational autoencoder (VAE). In this work, with a…

Machine Learning · Statistics 2021-12-30 Hwan Goh , Sheroze Sheriffdeen , Jonathan Wittmer , Tan Bui-Thanh

Fine-tuning pre-trained transformers is a powerful technique for enhancing the performance of base models on specific tasks. From early applications in models like BERT to fine-tuning Large Language Models (LLMs), this approach has been…

Computation and Language · Computer Science 2025-02-25 Suneel Nadipalli

Medical anomaly detection aims to identify abnormal findings using only normal training data, playing a crucial role in health screening and recognizing rare diseases. Reconstruction-based methods, particularly those utilizing autoencoders…

Machine Learning · Computer Science 2024-07-10 Yu Cai , Hao Chen , Kwang-Ting Cheng

Data packet routing in aeronautical ad-hoc networks (AANETs) is challenging due to their high-dynamic topology. In this paper, we invoke deep reinforcement learning for routing in AANETs aiming at minimizing the end-to-end (E2E) delay.…

Networking and Internet Architecture · Computer Science 2021-10-29 Dong Liu , Jingjing Cui , Jiankang Zhang , Chenyang Yang , Lajos Hanzo

Variational autoencoders (VAEs) have been used extensively to discover low-dimensional latent factors governing neural activity and animal behavior. However, without careful model selection, the uncovered latent factors may reflect noise in…

Machine Learning · Computer Science 2023-12-13 Julia Huiming Wang , Dexter Tsin , Tatiana Engel

The omnipresence of deep learning architectures such as deep convolutional neural networks (CNN)s is fueled by the synergistic combination of ever-increasing labeled datasets and specialized hardware. Despite the indisputable success, the…

Machine Learning · Statistics 2016-11-29 Meshia Cédric Oveneke , Mitchel Aliosha-Perez , Yong Zhao , Dongmei Jiang , Hichem Sahli

Variational Autoencoders (VAEs) have become a popular approach for dimensionality reduction. However, despite their ability to identify latent low-dimensional structures embedded within high-dimensional data, these latent representations…

Machine Learning · Statistics 2020-08-27 Kaspar Märtens , Christopher Yau

A novel approach to detecting anomalies in time series data is presented in this paper. This approach is pivotal in domains such as data centers, sensor networks, and finance. Traditional methods often struggle with manual parameter tuning…

Machine Learning · Computer Science 2025-04-07 Bahareh Golchin , Banafsheh Rekabdar

Feedforward neural networks are widely used as universal predictive models to fit data distribution. Common gradient-based learning, however, suffers from many drawbacks making the training process ineffective and time-consuming.…

Machine Learning · Computer Science 2021-07-06 Grzegorz Dudek

Distinguishing manipulated from real images is becoming increasingly difficult as new sophisticated image forgery approaches come out by the day. Naive classification approaches based on Convolutional Neural Networks (CNNs) show excellent…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Davide Cozzolino , Justus Thies , Andreas Rössler , Christian Riess , Matthias Nießner , Luisa Verdoliva

In this tutorial, we explore Variational Autoencoders (VAEs), an essential framework for unsupervised learning, particularly suited for high-dimensional datasets such as neuroimaging. By integrating deep learning with Bayesian inference,…

Image and Video Processing · Electrical Eng. & Systems 2025-01-15 C. Vázquez-García , F. J. Martínez-Murcia , F. Segovia Román , Juan M. Górriz Sáez

We propose rectified factor networks (RFNs) to efficiently construct very sparse, non-linear, high-dimensional representations of the input. RFN models identify rare and small events in the input, have a low interference between code units,…

Machine Learning · Computer Science 2018-01-31 Djork-Arné Clevert , Andreas Mayr , Thomas Unterthiner , Sepp Hochreiter

Integrating physics models within machine learning models holds considerable promise toward learning robust models with improved interpretability and abilities to extrapolate. In this work, we focus on the integration of incomplete physics…

Machine Learning · Computer Science 2021-10-28 Naoya Takeishi , Alexandros Kalousis

Deep autoencoder has been extensively used for anomaly detection. Training on the normal data, the autoencoder is expected to produce higher reconstruction error for the abnormal inputs than the normal ones, which is adopted as a criterion…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Dong Gong , Lingqiao Liu , Vuong Le , Budhaditya Saha , Moussa Reda Mansour , Svetha Venkatesh , Anton van den Hengel

Variational autoencoders (VAEs), that are built upon deep neural networks have emerged as popular generative models in computer vision. Most of the work towards improving variational autoencoders has focused mainly on making the…

Machine Learning · Statistics 2016-11-17 Siddharth Agrawal , Ambedkar Dukkipati

In the autoencoder based anomaly detection paradigm, implementing the autoencoder in edge devices capable of learning in real-time is exceedingly challenging due to limited hardware, energy, and computational resources. We show that these…

Mesoscale and Nanoscale Physics · Physics 2025-08-27 Muhammad Sabbir Alam , Walid Al Misba , Jayasimha Atulasimha

To address limitations of the graph fractional Fourier transform (GFRFT) Wiener filtering and the traditional joint time-vertex fractional Fourier transform (JFRFT) Wiener filtering, this study proposes a filtering method based on the…

Signal Processing · Electrical Eng. & Systems 2025-07-30 Ziqi Yan , Zhichao Zhang

Data-driven fault diagnostics of safety-critical systems often faces the challenge of a complete lack of labeled data associated with faulty system conditions (i.e., fault types) at training time. Since an unknown number and nature of fault…

Machine Learning · Computer Science 2020-10-01 Manuel Arias Chao , Bryan T. Adey , Olga Fink