English
Related papers

Related papers: Addressing Variance Shrinkage in Variational Autoe…

200 papers

We propose a framework for the statistical evaluation of variational auto-encoders (VAEs) and test two instances of this framework in the context of modelling images of handwritten digits and a corpus of English text. Our take on evaluation…

Machine Learning · Computer Science 2022-04-08 Claartje Barkhof , Wilker Aziz

Variational autoencdoers (VAE) are a popular approach to generative modelling. However, exploiting the capabilities of VAEs in practice can be difficult. Recent work on regularised and entropic autoencoders have begun to explore the…

Machine Learning · Computer Science 2022-03-02 Gregory A. Daly , Jonathan E. Fieldsend , Gavin Tabor

Neural Networks play a growing role in many science disciplines, including physics. Variational Autoencoders (VAEs) are neural networks that are able to represent the essential information of a high dimensional data set in a low dimensional…

Machine Learning · Statistics 2021-12-08 Johannes Zacherl , Philipp Frank , Torsten A. Enßlin

Variational autoencoder (VAE) is a widely used generative model for learning latent representations. Burda et al. in their seminal paper showed that learning capacity of VAE is limited by over-pruning. It is a phenomenon where a significant…

Machine Learning · Computer Science 2020-08-10 Rayyan Ahmad Khan , Muhammad Umer Anwaar , Martin Kleinsteuber

Recent advances in Convolutional Neural Network (CNN) model interpretability have led to impressive progress in visualizing and understanding model predictions. In particular, gradient-based visual attention methods have driven much recent…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Wenqian Liu , Runze Li , Meng Zheng , Srikrishna Karanam , Ziyan Wu , Bir Bhanu , Richard J. Radke , Octavia Camps

Variational Autoencoders (VAE) and their variants have been widely used in a variety of applications, such as dialog generation, image generation and disentangled representation learning. However, the existing VAE models have some…

Machine Learning · Computer Science 2020-06-23 Huajie Shao , Shuochao Yao , Dachun Sun , Aston Zhang , Shengzhong Liu , Dongxin Liu , Jun Wang , Tarek Abdelzaher

This paper proposes a method for detecting anomalies in video data. A Variational Autoencoder (VAE) is used for reducing the dimensionality of video frames, generating latent space information that is comparable to low-dimensional sensory…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Giulia Slavic , Damian Campo , Mohamad Baydoun , Pablo Marin , David Martin , Lucio Marcenaro , Carlo Regazzoni

Medical anomaly detection aims to identify abnormal findings using only normal training data, playing a crucial role in health screening and recognizing rare diseases. Reconstruction-based methods, particularly those utilizing autoencoders…

Machine Learning · Computer Science 2024-07-10 Yu Cai , Hao Chen , Kwang-Ting Cheng

Variational autoencoders (VAEs) are powerful generative modelling methods, however they suffer from blurry generated samples and reconstructions compared to the images they have been trained on. Significant research effort has been spent to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Gustav Bredell , Kyriakos Flouris , Krishna Chaitanya , Ertunc Erdil , Ender Konukoglu

User attributes, such as gender and education, face severe incompleteness in social networks. In order to make this kind of valuable data usable for downstream tasks like user profiling and personalized recommendation, attribute inference…

Machine Learning · Computer Science 2021-06-01 Yadong Zhou , Zhihao Ding , Xiaoming Liu , Chao Shen , Lingling Tong , Xiaohong Guan

Variational autoencoders (VAEs) often suffer from posterior collapse, which is a phenomenon in which the learned latent space becomes uninformative. This is often related to the hyperparameter resembling the data variance. It can be shown…

Machine Learning · Computer Science 2022-08-23 Yuhta Takida , Wei-Hsiang Liao , Chieh-Hsin Lai , Toshimitsu Uesaka , Shusuke Takahashi , Yuki Mitsufuji

We propose a new class of physics-informed neural networks, called physics-informed Variational Autoencoder (PI-VAE), to solve stochastic differential equations (SDEs) or inverse problems involving SDEs. In these problems the governing…

Machine Learning · Statistics 2022-11-09 Weiheng Zhong , Hadi Meidani

Estimation of the value-at-risk (VaR) of a large portfolio of assets is an important task for financial institutions. As the joint log-returns of asset prices can often be projected to a latent space of a much smaller dimension, the use of…

Machine Learning · Computer Science 2021-12-06 Robert Sicks , Stefanie Grimm , Ralf Korn , Ivo Richert

As big spatial data becomes increasingly prevalent, classical spatiotemporal (ST) methods often do not scale well. While methods have been developed to account for high-dimensional spatial objects, the setting where there are exceedingly…

Applications · Statistics 2019-08-27 Samuel I. Berchuck , Felipe A. Medeiros , Sayan Mukherjee

Variational autoencoders (VAEs) are widely used deep generative models capable of learning unsupervised latent representations of data. Such representations are often difficult to interpret or control. We consider the problem of…

Machine Learning · Computer Science 2018-12-18 Jack Klys , Jake Snell , Richard Zemel

Autoencoder (AE) is a neural network (NN) architecture that is trained to reconstruct an input at its output. By measuring the reconstruction errors of new input samples, AE can detect anomalous samples deviated from the trained data…

Machine Learning · Computer Science 2023-02-16 Jinho Choi , Jihong Park , Abhinav Japesh , Adarsh

There are many problems in physics, biology, and other natural sciences in which symbolic regression can provide valuable insights and discover new laws of nature. A widespread Deep Neural Networks do not provide interpretable solutions.…

Machine Learning · Computer Science 2023-01-18 Sergei Popov , Mikhail Lazarev , Vladislav Belavin , Denis Derkach , Andrey Ustyuzhanin

Anomaly detection plays a pivotal role in numerous real-world scenarios, such as industrial automation and manufacturing intelligence. Recently, variational inference-based anomaly analysis has attracted researchers' and developers'…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Yurong Chen

Variation Autoencoder (VAE) has become a powerful tool in modeling the non-linear generative process of data from a low-dimensional latent space. Recently, several studies have proposed to use VAE for unsupervised clustering by using…

Machine Learning · Computer Science 2021-06-29 Qingyu Zhao , Nicolas Honnorat , Ehsan Adeli , Kilian M. Pohl

Variational autoencoders (VAE) have quickly become a central tool in machine learning, applicable to a broad range of data types and latent variable models. By far the most common first step, taken by seminal papers and by core software…

Machine Learning · Statistics 2020-01-01 Gabriel Loaiza-Ganem , John P. Cunningham