中文
相关论文

相关论文: A Variational AutoEncoder for Transformers with No…

200 篇论文

Paradoxically, a Variational Autoencoder (VAE) could be pushed in two opposite directions, utilizing powerful decoder model for generating realistic images but collapsing the learned representation, or increasing regularization coefficient…

机器学习 · 计算机科学 2022-03-30 Trung Ngo , Najwa Laabid , Ville Hautamäki , Merja Heinäniemi

Recently, autoencoders (AEs) have gained interest for creating parametric and invertible projections of multidimensional data. Parametric projections make it possible to embed new, unseen samples without recalculating the entire projection,…

机器学习 · 计算机科学 2025-11-26 Frederik L. Dennig , Daniel A. Keim

This paper presents an infinite variational autoencoder (VAE) whose capacity adapts to suit the input data. This is achieved using a mixture model where the mixing coefficients are modeled by a Dirichlet process, allowing us to integrate…

机器学习 · 计算机科学 2016-11-28 Ehsan Abbasnejad , Anthony Dick , Anton van den Hengel

The recently developed variational autoencoders (VAEs) have proved to be an effective confluence of the rich representational power of neural networks with Bayesian methods. However, most work on VAEs use a rather simple prior over the…

机器学习 · 计算机科学 2017-08-29 Prasoon Goyal , Zhiting Hu , Xiaodan Liang , Chenyu Wang , Eric Xing

Variational autoencoders (VAE) represent a popular, flexible form of deep generative model that can be stochastically fit to samples from a given random process using an information-theoretic variational bound on the true underlying…

机器学习 · 计算机科学 2019-10-08 Bin Dai , Yu Wang , John Aston , Gang Hua , David Wipf

New system for i-vector speaker recognition based on variational autoencoder (VAE) is investigated. VAE is a promising approach for developing accurate deep nonlinear generative models of complex data. Experiments show that VAE provides…

声音 · 计算机科学 2017-05-26 Timur Pekhovsky , Maxim Korenevsky

Achieving precise semantic control over the latent spaces of Variational AutoEncoders (VAEs) holds significant value for downstream tasks in NLP as the underlying generative mechanisms could be better localised, explained and improved upon.…

计算与语言 · 计算机科学 2024-02-02 Yingji Zhang , Danilo S. Carvalho , Marco Valentino , Ian Pratt-Hartmann , Andre Freitas

Posterior collapse plagues VAEs for text, especially for conditional text generation with strong autoregressive decoders. In this work, we address this problem in variational neural machine translation by explicitly promoting mutual…

计算与语言 · 计算机科学 2019-09-23 Arya D. McCarthy , Xian Li , Jiatao Gu , Ning Dong

Vector-Quantized Variational Autoencoders (VQ-VAE)[1] provide an unsupervised model for learning discrete representations by combining vector quantization and autoencoders. In this paper, we study the use of VQ-VAE for representation…

图像与视频处理 · 电气工程与系统科学 2019-03-05 Hanwei Wu , Markus Flierl

Variational autoencoders (VAEs) combine latent variables with amortized variational inference, whose optimization usually converges into a trivial local optimum termed posterior collapse, especially in text modeling. By tracking the…

计算与语言 · 计算机科学 2020-04-21 Chen Wu , Prince Zizhuang Wang , William Yang Wang

In this thesis, we develop methods to enhance the interpretability of recent representation learning techniques in natural language processing (NLP) while accounting for the unavailability of annotated data. We choose to leverage…

计算与语言 · 计算机科学 2023-05-05 Ghazi Felhi

The variational auto-encoder (VAE) is a popular method for learning a generative model and embeddings of the data. Many real datasets are hierarchically structured. However, traditional VAEs map data in a Euclidean latent space which cannot…

机器学习 · 统计学 2019-11-27 Emile Mathieu , Charline Le Lan , Chris J. Maddison , Ryota Tomioka , Yee Whye Teh

Neuromorphic hardware equipped with learning capabilities can adapt to new, real-time data. While models of Spiking Neural Networks (SNNs) can now be trained using gradient descent to reach an accuracy comparable to equivalent conventional…

神经与进化计算 · 计算机科学 2022-03-09 Kenneth Stewart , Andreea Danielescu , Timothy Shea , Emre Neftci

In recent years, the field of machine learning has made phenomenal progress in the pursuit of simulating real-world data generation processes. One notable example of such success is the variational autoencoder (VAE). In this work, with a…

机器学习 · 统计学 2021-12-30 Hwan Goh , Sheroze Sheriffdeen , Jonathan Wittmer , Tan Bui-Thanh

In the field of machine learning, it is still a critical issue to identify and supervise the learned representation without manually intervening or intuition assistance to extract useful knowledge or serve for the downstream tasks. In this…

机器学习 · 计算机科学 2025-12-10 Shiqi Liu , Jingxin Liu , Qian Zhao , Xiangyong Cao , Huibin Li , Deyu Meng , Hongying Meng , Sheng Liu

Human perception is inherently multimodal. We integrate, for instance, visual, proprioceptive and tactile information into one experience. Hence, multimodal learning is of importance for building robotic systems that aim at robustly…

机器学习 · 计算机科学 2024-11-04 Carlotta Langer , Yasmin Kim Georgie , Ilja Porohovoj , Verena Vanessa Hafner , Nihat Ay

We present a coupled Variational Auto-Encoder (VAE) method that improves the accuracy and robustness of the probabilistic inferences on represented data. The new method models the dependency between input feature vectors (images) and weighs…

机器学习 · 计算机科学 2025-11-25 Shichen Cao , Jingjing Li , Kenric P. Nelson , Mark A. Kon

Recently, audio-visual speech enhancement has been tackled in the unsupervised settings based on variational auto-encoders (VAEs), where during training only clean data is used to train a generative model for speech, which at test time is…

音频与语音处理 · 电气工程与系统科学 2021-02-09 Mostafa Sadeghi , Xavier Alameda-Pineda

The Variational Autoencoder (VAE) is a powerful deep generative model that is now extensively used to represent high-dimensional complex data via a low-dimensional latent space learned in an unsupervised manner. In the original VAE model,…

声音 · 计算机科学 2021-06-15 Xiaoyu Bie , Laurent Girin , Simon Leglaive , Thomas Hueber , Xavier Alameda-Pineda

Variational Autoencoders (VAEs) are well-established as a principled approach to probabilistic unsupervised learning with neural networks. Typically, an encoder network defines the parameters of a Gaussian distributed latent space from…

机器学习 · 计算机科学 2025-05-16 Alan Jeffares , Liyuan Liu