English
Related papers

Related papers: Variational Recurrent Auto-Encoders

200 papers

The variational autoencoder (VAE) framework remains a popular option for training unsupervised generative models, especially for discrete data where generative adversarial networks (GANs) require workaround to create gradient for the…

Machine Learning · Computer Science 2019-04-24 Jason Chou , Gautam Hathi

Representation learning over graph structured data has been mostly studied in static graph settings while efforts for modeling dynamic graphs are still scant. In this paper, we develop a novel hierarchical variational model that introduces…

Machine Learning · Computer Science 2020-04-24 Ehsan Hajiramezanali , Arman Hasanzadeh , Nick Duffield , Krishna R Narayanan , Mingyuan Zhou , Xiaoning Qian

Learning disentangled representations leads to interpretable models and facilitates data generation with style transfer, which has been extensively studied on static data such as images in an unsupervised learning framework. However, only a…

Machine Learning · Computer Science 2021-01-20 Jun Han , Martin Renqiang Min , Ligong Han , Li Erran Li , Xuan Zhang

There are many problems in physics, biology, and other natural sciences in which symbolic regression can provide valuable insights and discover new laws of nature. A widespread Deep Neural Networks do not provide interpretable solutions.…

Machine Learning · Computer Science 2023-01-18 Sergei Popov , Mikhail Lazarev , Vladislav Belavin , Denis Derkach , Andrey Ustyuzhanin

For a robot to perform complex manipulation tasks, it is necessary for it to have a good grasping ability. However, vision based robotic grasp detection is hindered by the unavailability of sufficient labelled data. Furthermore, the…

Machine Learning · Computer Science 2020-01-31 Mridul Mahajan , Tryambak Bhattacharjee , Arya Krishnan , Priya Shukla , G C Nandi

Sequential VAEs have been successfully considered for many high-dimensional time series modelling problems, with many variant models relying on discrete-time mechanisms such as recurrent neural networks (RNNs). On the other hand,…

Machine Learning · Computer Science 2023-08-21 Harrison Zhu , Carles Balsells Rodas , Yingzhen Li

Conditional Generative Models are now acknowledged an essential tool in Machine Learning. This paper focuses on their control. While many approaches aim at disentangling the data through the coordinate-wise control of their latent…

Machine Learning · Computer Science 2020-01-23 Victor Berger , Michèle Sebag

The variational auto-encoder (VAE) is a popular method for learning a generative model and embeddings of the data. Many real datasets are hierarchically structured. However, traditional VAEs map data in a Euclidean latent space which cannot…

Machine Learning · Statistics 2019-11-27 Emile Mathieu , Charline Le Lan , Chris J. Maddison , Ryota Tomioka , Yee Whye Teh

Variational auto-encoders (VAEs) are a powerful approach to unsupervised learning. They enable scalable approximate posterior inference in latent-variable models using variational inference (VI). A VAE posits a variational family…

Machine Learning · Computer Science 2022-06-08 Samarth Sinha , Adji B. Dieng

Integrating physics models within machine learning models holds considerable promise toward learning robust models with improved interpretability and abilities to extrapolate. In this work, we focus on the integration of incomplete physics…

Machine Learning · Computer Science 2021-10-28 Naoya Takeishi , Alexandros Kalousis

For planning of power systems and for the calibration of operational tools, it is essential to analyse system performance in a large range of representative scenarios. When the available historical data is limited, generative models are a…

Systems and Control · Electrical Eng. & Systems 2022-12-16 Chenguang Wang , Ensieh Sharifnia , Zhi Gao , Simon H. Tindemans , Peter Palensky

We propose a new unsupervised model for mapping a variable-duration speech segment to a fixed-dimensional representation. The resulting acoustic word embeddings can form the basis of search, discovery, and indexing systems for low- and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-07 Puyuan Peng , Herman Kamper , Karen Livescu

Variational Auto-Encoders (VAEs) have emerged as powerful probabilistic models for generative tasks. However, their convergence properties have not been rigorously proven. The challenge of proving convergence is inherently difficult due to…

Machine Learning · Computer Science 2024-09-10 Li Wang , Wei Huang

Variational autoencoders (VAEs) have received much attention recently as an end-to-end architecture for text generation with latent variables. In this paper, we investigate several multi-level structures to learn a VAE model to generate…

Computation and Language · Computer Science 2019-06-21 Dinghan Shen , Asli Celikyilmaz , Yizhe Zhang , Liqun Chen , Xin Wang , Jianfeng Gao , Lawrence Carin

Longitudinal datasets measured repeatedly over time from individual subjects, arise in many biomedical, psychological, social, and other studies. A common approach to analyse high-dimensional data that contains missing values is to learn a…

Machine Learning · Statistics 2021-04-21 Siddharth Ramchandran , Gleb Tikhonov , Kalle Kujanpää , Miika Koskinen , Harri Lähdesmäki

In this work, we propose a new recurrent autoencoder architecture, termed Feedback Recurrent AutoEncoder (FRAE), for online compression of sequential data with temporal dependency. The recurrent structure of FRAE is designed to efficiently…

Machine Learning · Computer Science 2020-02-18 Yang Yang , Guillaume Sautière , J. Jon Ryu , Taco S Cohen

We introduce a novel variational autoencoder (VAE) architecture that can generate realistic and diverse high energy physics events. The model we propose utilizes several techniques from VAE literature in order to simulate high fidelity jet…

High Energy Physics - Phenomenology · Physics 2020-09-11 Kosei Dohi

Generative modeling and self-supervised learning have in recent years made great strides towards learning from data in a completely unsupervised way. There is still however an open area of investigation into guiding a neural network to…

Machine Learning · Computer Science 2023-05-17 Vaishnavi Patil , Matthew Evanusa , Joseph JaJa

The task of concept prerequisite chain learning is to automatically determine the existence of prerequisite relationships among concept pairs. In this paper, we frame learning prerequisite relationships among concepts as an unsupervised…

Computation and Language · Computer Science 2020-04-23 Irene Li , Alexander Fabbri , Swapnil Hingmire , Dragomir Radev

Graph representation learning is a fundamental research theme and can be generalized to benefit multiple downstream tasks from the node and link levels to the higher graph level. In practice, it is desirable to develop task-agnostic general…

Machine Learning · Computer Science 2023-12-12 Hanxuan Yang , Qingchao Kong , Wenji Mao