中文
相关论文

相关论文: Improving Semantic Control in Discrete Latent Spac…

200 篇论文

State-of-the-art Variational Auto-Encoders (VAEs) for learning disentangled latent representations give impressive results in discovering features like pitch, pause duration, and accent in speech data, leading to highly controllable…

声音 · 计算机科学 2021-05-11 Shakti Kumar , Jithin Pradeep , Hussain Zaidi

Learning compact and meaningful latent space representations has been shown to be very useful in generative modeling tasks for visual data. One particular example is applying Vector Quantization (VQ) in variational autoencoders (VQ-VAEs,…

机器学习 · 计算机科学 2024-09-18 Xin Li , Anand Sarwate

We consider the task of unsupervised extraction of meaningful latent representations of speech by applying autoencoding neural networks to speech waveforms. The goal is to learn a representation able to capture high level semantic content…

机器学习 · 计算机科学 2019-09-12 Jan Chorowski , Ron J. Weiss , Samy Bengio , Aäron van den Oord

Variational autoencoder (VAE) neural networks can be trained to generate power system states that capture both marginal distribution and multivariate dependencies of historical data. The coordinates of the latent space codes of VAEs have…

系统与控制 · 电气工程与系统科学 2023-03-22 Chenguang Wang , Ensieh Sharifnia , Simon H. Tindemans , Peter Palensky

Controllable timbre synthesis has been a subject of research for several decades, and deep neural networks have been the most successful in this area. Deep generative models such as Variational Autoencoders (VAEs) have the ability to…

声音 · 计算机科学 2023-07-21 Anastasia Natsiou , Luca Longo , Sean O'Leary

A major challenge in quantum computing is its application to large real-world datasets due to scarce quantum hardware resources. One approach to enabling tractable quantum models for such datasets involves finding low-dimensional…

量子物理 · 物理学 2025-04-11 Gaoyuan Wang , Jonathan Warrell , Prashant S. Emani , Mark Gerstein

Recent work on generative modeling of text has found that variational auto-encoders (VAE) incorporating LSTM decoders perform worse than simpler LSTM language models (Bowman et al., 2015). This negative result is so far poorly understood,…

神经与进化计算 · 计算机科学 2017-06-20 Zichao Yang , Zhiting Hu , Ruslan Salakhutdinov , Taylor Berg-Kirkpatrick

Variational autoencoders (VAEs) are powerful generative models with the salient ability to perform inference. Here, we introduce a quantum variational autoencoder (QVAE): a VAE whose latent generative process is implemented as a quantum…

Improving controllability or the ability to manipulate one or more attributes of the generated data has become a topic of interest in the context of deep generative models of music. Recent attempts in this direction have relied on learning…

声音 · 计算机科学 2021-08-04 Ashis Pati , Alexander Lerch

Generative autoencoders offer a promising approach for controllable text generation by leveraging their latent sentence representations. However, current models struggle to maintain coherent latent spaces required to perform meaningful text…

机器学习 · 计算机科学 2020-07-08 Tianxiao Shen , Jonas Mueller , Regina Barzilay , Tommi Jaakkola

Recent advancements in learning Discrete Representations as opposed to continuous ones have led to state of art results in tasks that involve Language, Audio and Vision. Some latent factors such as words, phonemes and shapes are better…

机器学习 · 计算机科学 2020-04-14 Iordanis Fostiropoulos

Variational AutoEncoders (VAEs) provide a means to generate representational latent embeddings. Previous research has highlighted the benefits of achieving representations that are disentangled, particularly for downstream tasks. However,…

计算机视觉与模式识别 · 计算机科学 2019-11-18 Matthew J. Vowels , Necati Cihan Camgoz , Richard Bowden

Variational autoencoders (VAEs) are powerful deep generative models widely used to represent high-dimensional complex data through a low-dimensional latent space learned in an unsupervised manner. In the original VAE model, the input data…

机器学习 · 计算机科学 2022-07-05 Laurent Girin , Simon Leglaive , Xiaoyu Bie , Julien Diard , Thomas Hueber , Xavier Alameda-Pineda

Variational Autoencoders (VAEs) have proven to be effective models for producing latent representations of cognitive and semantic value. We assess the degree to which VAEs trained on a prototypical tonal music corpus of 371 Bach's chorales…

声音 · 计算机科学 2023-11-08 Nádia Carvalho , Gilberto Bernardes

This paper introduces the Descriptive Variational Autoencoder (DVAE), an unsupervised and end-to-end trainable neural network for predicting vehicle trajectories that provides partial interpretability. The novel approach is based on the…

机器学习 · 计算机科学 2021-06-25 Marion Neumeier , Andreas Tollkühn , Thomas Berberich , Michael Botsch

The Variational Autoencoder (VAE) is a powerful deep generative model that is now extensively used to represent high-dimensional complex data via a low-dimensional latent space learned in an unsupervised manner. In the original VAE model,…

声音 · 计算机科学 2021-06-15 Xiaoyu Bie , Laurent Girin , Simon Leglaive , Thomas Hueber , Xavier Alameda-Pineda

Bayesian optimisation in the latent space of a Variational AutoEncoder (VAE) is a powerful framework for optimisation tasks over complex structured domains, such as the space of scientifically interesting molecules. However, existing…

机器学习 · 计算机科学 2025-07-08 Henry B. Moss , Sebastian W. Ober , Tom Diethe

Recent progress in scaling up large language models has shown impressive capabilities in performing few-shot learning across a wide range of text-based tasks. However, a key limitation is that these language models fundamentally lack visual…

机器学习 · 计算机科学 2023-02-06 Hao Liu , Wilson Yan , Pieter Abbeel

In recent years, applying Deep Learning (DL) techniques emerged as a common practice in the communication system, demonstrating promising results. The present paper proposes a new Convolutional Neural Network (CNN) based Variational…

信号处理 · 电气工程与系统科学 2020-05-20 Raghu Vamshi Hemadri , Akshay Rayaluru , Rahul Jashvantbhai Pandya

While most frontier models still use deterministic frequency-based tokenization algorithms such as byte-pair encoding (BPE), there has been significant recent work to design learned neural tokenizers. However, these schemes generally add to…

机器学习 · 计算机科学 2025-12-29 Theo Datta , Kayla Huang , Sham Kakade , David Brandfonbrener