中文
相关论文

相关论文: VP-VAE: Rethinking Vector Quantization via Adaptiv…

200 篇论文

We propose to replace vector quantization (VQ) in the latent representation of VQ-VAEs with a simple scheme termed finite scalar quantization (FSQ), where we project the VAE representation down to a few dimensions (typically less than 10).…

计算机视觉与模式识别 · 计算机科学 2023-10-13 Fabian Mentzer , David Minnen , Eirikur Agustsson , Michael Tschannen

Variational autoencoders (VAEs) are fundamental for generative modeling and image reconstruction, yet their performance often struggles to maintain high fidelity in reconstructions. This study introduces a hybrid model, quantum variational…

计算机视觉与模式识别 · 计算机科学 2025-03-10 Farina Riaz , Fakhar Zaman , Hajime Suzuki , Sharif Abuadbba , David Nguyen

Variational autoencoder-based voice conversion (VAE-VC) has the advantage of requiring only pairs of speeches and speaker labels for training. Unlike the majority of the research in VAE-VC which focuses on utilizing auxiliary losses or…

声音 · 计算机科学 2021-12-07 Kei Akuzawa , Kotaro Onishi , Keisuke Takiguchi , Kohki Mametani , Koichiro Mori

As one of the most popular generative models, Variational Autoencoder (VAE) approximates the posterior of latent variables based on amortized variational inference. However, when the decoder network is sufficiently expressive, VAE may lead…

机器学习 · 计算机科学 2021-10-26 Dazhong Shen , Chuan Qin , Chao Wang , Hengshu Zhu , Enhong Chen , Hui Xiong

Disentangled representation learning aims to represent the underlying generative factors of a dataset in a latent representation independently of one another. In our work, we propose a discrete variational autoencoder (VAE) based model…

计算机视觉与模式识别 · 计算机科学 2025-11-06 Gulcin Baykal , Melih Kandemir , Gozde Unal

Vector-quantized variational autoencoders (VQ-VAEs) are central to models that rely on high reconstruction fidelity, from neural compression to generative pipelines. Hierarchical extensions, such as VQ-VAE2, are often credited with superior…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Shirin Reyhanian , Laurenz Wiskott

A major challenge in quantum computing is its application to large real-world datasets due to scarce quantum hardware resources. One approach to enabling tractable quantum models for such datasets involves finding low-dimensional…

量子物理 · 物理学 2025-04-11 Gaoyuan Wang , Jonathan Warrell , Prashant S. Emani , Mark Gerstein

Variational autoencoders (VAEs) provide an effective and simple method for modeling complex distributions. However, training VAEs often requires considerable hyperparameter tuning to determine the optimal amount of information retained by…

机器学习 · 计算机科学 2021-07-13 Oleh Rybkin , Kostas Daniilidis , Sergey Levine

Recent state-of-the-art autoencoder based generative models have an encoder-decoder structure and learn a latent representation with a pre-defined distribution that can be sampled from. Implementing the encoder networks of these models in a…

机器学习 · 计算机科学 2020-05-11 D. T. Braithwaite , M. O'Connor , W. B. Kleijn

Recently, a generative variational autoencoder (VAE) has been proposed for speech enhancement to model speech statistics. However, this approach only uses clean speech in the training phase, making the estimation particularly sensitive to…

音频与语音处理 · 电气工程与系统科学 2021-05-18 Huajian Fang , Guillaume Carbajal , Stefan Wermter , Timo Gerkmann

The surrogate loss of variational autoencoders (VAEs) poses various challenges to their training, inducing the imbalance between task fitting and representation inference. To avert this, the existing strategies for VAEs focus on adjusting…

神经与进化计算 · 计算机科学 2024-04-02 Zhangkai Wu , Longbing Cao , Lei Qi

Semi-supervised learning is attracting increasing attention due to the fact that datasets of many domains lack enough labeled data. Variational Auto-Encoder (VAE), in particular, has demonstrated the benefits of semi-supervised learning.…

机器学习 · 计算机科学 2018-12-04 Yang Li , Quan Pan , Suhang Wang , Haiyun Peng , Tao Yang , Erik Cambria

We propose an algorithm, guided variational autoencoder (Guided-VAE), that is able to learn a controllable generative model by performing latent representation disentanglement learning. The learning objective is achieved by providing…

计算机视觉与模式识别 · 计算机科学 2020-04-06 Zheng Ding , Yifan Xu , Weijian Xu , Gaurav Parmar , Yang Yang , Max Welling , Zhuowen Tu

Variational autoencoders (VAEs), that are built upon deep neural networks have emerged as popular generative models in computer vision. Most of the work towards improving variational autoencoders has focused mainly on making the…

机器学习 · 统计学 2016-11-17 Siddharth Agrawal , Ambedkar Dukkipati

Variational auto-encoder (VAE) is an effective neural network architecture to disentangle a speech utterance into speaker identity and linguistic content latent embeddings, then generate an utterance for a target speaker from that of a…

声音 · 计算机科学 2022-08-23 Ziang Long , Yunling Zheng , Meng Yu , Jack Xin

A variational autoencoder (VAE) is a probabilistic machine learning framework for posterior inference that projects an input set of high-dimensional data to a lower-dimensional, latent space. The latent space learned with a VAE offers…

机器学习 · 计算机科学 2022-11-16 Rafael Pastrana

The variational autoencoder (VAE) is a simple and efficient generative artificial intelligence method for modeling complex probability distributions of various types of data, such as images and texts. However, it suffers some main…

机器学习 · 计算机科学 2025-02-14 Xi Chen , Shaofan Li

This paper addresses the problem of lossy image compression, a fundamental problem in image processing and information theory that is involved in many real-world applications. We start by reviewing the framework of variational autoencoders…

图像与视频处理 · 电气工程与系统科学 2023-12-06 Zhihao Duan , Ming Lu , Jack Ma , Yuning Huang , Zhan Ma , Fengqing Zhu

Vector Quantisation (VQ) is experiencing a comeback in machine learning, where it is increasingly used in representation learning. However, optimizing the codevectors in existing VQ-VAE is not entirely trivial. A problem is codebook…

计算机视觉与模式识别 · 计算机科学 2023-07-31 Chuanxia Zheng , Andrea Vedaldi

Variational auto-encoders (VAEs) are deep generative latent variable models that can be used for learning the distribution of complex data. VAEs have been successfully used to learn a probabilistic prior over speech signals, which is then…

声音 · 计算机科学 2020-12-18 Mostafa Sadeghi , Simon Leglaive , Xavier Alameda-PIneda , Laurent Girin , Radu Horaud