English
Related papers

Related papers: Deep Variational Autoencoder with Shallow Parallel…

200 papers

Variational autoencoders (VAEs) have ushered in a new era of unsupervised learning methods for complex distributions. Although these techniques are elegant in their approach, they are typically not useful for representation learning. In…

Machine Learning · Computer Science 2020-01-10 Ali Lotfi Rezaabad , Sriram Vishwanath

In this paper, we present a novel approach for training a Variational Autoencoder (VAE) on a highly imbalanced data set. The proposed training of a high-resolution VAE model begins with the training of a low-resolution core model, which can…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Dmitry Utyamishev , Inna Partin-Vaisband

In just three years, Variational Autoencoders (VAEs) have emerged as one of the most popular approaches to unsupervised learning of complicated distributions. VAEs are appealing because they are built on top of standard function…

Machine Learning · Statistics 2021-01-05 Carl Doersch

In real-world traffic surveillance, vehicle images captured under adverse weather, poor lighting, or high-speed motion often suffer from severe noise and blur. Such degradations significantly reduce the accuracy of license plate recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Cuong Nguyen , Dung T. Tran , Hong Nguyen , Xuan-Vu Phan , Nam-Phong Nguyen

Autoencoders have found widespread application in both their original deterministic form and in their variational formulation (VAEs). In scientific applications and in image processing it is often of interest to consider data that are…

Machine Learning · Statistics 2025-09-09 Justin Bunker , Mark Girolami , Hefin Lambley , Andrew M. Stuart , T. J. Sullivan

Sequence-to-sequence (Seq2seq) models have played an important role in the recent success of various natural language processing methods, such as machine translation, text summarization, and speech recognition. However, current Seq2seq…

Computation and Language · Computer Science 2018-06-05 Myeongjun Jang , Seungwan Seo , Pilsung Kang

The variational autoencoder (VAE) is a well-studied, deep, latent-variable model (DLVM) that efficiently optimizes the variational lower bound of the log marginal data likelihood and has a strong theoretical foundation. However, the VAE's…

Machine Learning · Computer Science 2024-10-08 Surojit Saha , Sarang Joshi , Ross Whitaker

A new form of the variational autoencoder (VAE) is proposed, based on the symmetric Kullback-Leibler divergence. It is demonstrated that learning of the resulting symmetric VAE (sVAE) has close connections to previously developed…

Machine Learning · Statistics 2017-10-23 Liqun Chen , Shuyang Dai , Yunchen Pu , Chunyuan Li , Qinliang Su , Lawrence Carin

Here we propose the Reweighted Autoencoded Variational Bayes for Enhanced Sampling (RAVE) method, a new iterative scheme that uses the deep learning framework of variational autoencoders to enhance sampling in molecular simulations. RAVE…

Chemical Physics · Physics 2018-02-13 Joao Marcelo Lamim Ribeiro , Pablo Bravo Collado , Yihang Wang , Pratyush Tiwary

Unsupervised learning can leverage large-scale data sources without the need for annotations. In this context, deep learning-based autoencoders have shown great potential in detecting anomalies in medical images. However, especially…

Image and Video Processing · Electrical Eng. & Systems 2020-01-03 David Zimmerer , Simon Kohl , Jens Petersen , Fabian Isensee , Klaus Maier-Hein

Robust recommendation aims at capturing true preference of users from noisy data, for which there are two lines of methods have been proposed. One is based on noise injection, and the other is to adopt the generative model Variational…

Information Retrieval · Computer Science 2021-07-01 Qiaomin Yi , Ning Yang , Philip S. Yu

We present fast, realistic image generation on high-resolution, multimodal datasets using hierarchical variational autoencoders (VAEs) trained on a deterministic autoencoder's latent space. In this two-stage setup, the autoencoder…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Troy Luhman , Eric Luhman

Recently, variational autoencoder (VAE), a deep representation learning (DRL) model, has been used to perform speech enhancement (SE). However, to the best of our knowledge, current VAE-based SE methods only apply VAE to the model speech…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-25 Yang Xiang , Jesper Lisby Højvang , Morten Højfeldt Rasmussen , Mads Græsbøll Christensen

Due to their unsupervised training and uncertainty estimation, deep Variational Autoencoders (VAEs) have become powerful tools for reconstruction-based Time Series Anomaly Detection (TSAD). Existing VAE-based TSAD methods, either…

Machine Learning · Computer Science 2024-01-09 Zhangkai Wu , Longbing Cao , Qi Zhang , Junxian Zhou , Hui Chen

Generally, the performance of deep neural networks (DNNs) heavily depends on the quality of data representation learning. Our preliminary work has emphasized the significance of deep representation learning (DRL) in the context of speech…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-18 Yang Xiang , Jingguang Tian , Xinhui Hu , Xinkang Xu , ZhaoHui Yin

In this thesis, we develop methods to enhance the interpretability of recent representation learning techniques in natural language processing (NLP) while accounting for the unavailability of annotated data. We choose to leverage…

Computation and Language · Computer Science 2023-05-05 Ghazi Felhi

Intelligent behaviour in the real-world requires the ability to acquire new knowledge from an ongoing sequence of experiences while preserving and reusing past knowledge. We propose a novel algorithm for unsupervised representation learning…

We present SAE-BrainMap, a novel framework that directly aligns deep learning visual model representations with voxel-level fMRI responses using sparse autoencoders (SAEs). First, we train layer-wise SAEs on model activations and compute…

Neurons and Cognition · Quantitative Biology 2025-06-16 Ziming Mao , Jia Xu , Zeqi Zheng , Haofang Zheng , Dabing Sheng , Yaochu Jin , Guoyuan Yang

Learning a robust video Variational Autoencoder (VAE) is essential for reducing video redundancy and facilitating efficient video generation. Directly applying image VAEs to individual frames in isolation can result in temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yazhou Xing , Yang Fei , Yingqing He , Jingye Chen , Jiaxin Xie , Xiaowei Chi , Qifeng Chen

3D geometric contents are becoming increasingly popular. In this paper, we study the problem of analyzing deforming 3D meshes using deep neural networks. Deforming 3D meshes are flexible to represent 3D animation sequences as well as…

Graphics · Computer Science 2018-03-30 Qingyang Tan , Lin Gao , Yu-Kun Lai , Shihong Xia