中文
相关论文

相关论文: VP-VAE: Rethinking Vector Quantization via Adaptiv…

200 篇论文

Variational autoencoders (VAE) represent a popular, flexible form of deep generative model that can be stochastically fit to samples from a given random process using an information-theoretic variational bound on the true underlying…

机器学习 · 计算机科学 2019-10-08 Bin Dai , Yu Wang , John Aston , Gang Hua , David Wipf

Vector quantization is a technique in machine learning that discretizes continuous representations into a set of discrete vectors. It is widely employed in tokenizing data representations for large language models, diffusion models, and…

机器学习 · 计算机科学 2026-03-19 Wenhao Zhao , Qiran Zou , Rushi Shah , Yudi Wu , Zhouhan Lin , Dianbo Liu

Variational Autoencoders (VAE) are widely used for dimensionality reduction of large-scale tabular and image datasets, under the assumption of independence between data observations. In practice, however, datasets are often correlated, with…

机器学习 · 统计学 2024-12-25 Giora Simchoni , Saharon Rosset

New system for i-vector speaker recognition based on variational autoencoder (VAE) is investigated. VAE is a promising approach for developing accurate deep nonlinear generative models of complex data. Experiments show that VAE provides…

声音 · 计算机科学 2017-05-26 Timur Pekhovsky , Maxim Korenevsky

Variational autoencoders (VAEs) are widely used deep generative models capable of learning unsupervised latent representations of data. Such representations are often difficult to interpret or control. We consider the problem of…

机器学习 · 计算机科学 2018-12-18 Jack Klys , Jake Snell , Richard Zemel

The variational autoencoder (VAE) framework is a popular option for training unsupervised generative models, featuring ease of training and latent representation of data. The objective function of VAE does not guarantee to achieve the…

机器学习 · 计算机科学 2019-04-25 Jason Chou

The ability to record activities from hundreds of neurons simultaneously in the brain has placed an increasing demand for developing appropriate statistical techniques to analyze such data. Recently, deep generative models have been…

机器学习 · 统计学 2020-11-11 Ding Zhou , Xue-Xin Wei

Variational Quantum Eigensolvers (VQEs) are a powerful class of hybrid quantum-classical algorithms designed to approximate the ground state of a quantum system described by its Hamiltonian. VQEs hold promise for various applications,…

量子物理 · 物理学 2025-02-04 Kim A. Nicoli , Luca J. Wagner , Lena Funcke

Trajectory forecasting is crucial for video surveillance analytics, as it enables the anticipation of future movements for a set of agents, e.g. basketball players engaged in intricate interactions with long-term intentions. Deep generative…

计算机视觉与模式识别 · 计算机科学 2024-08-30 Riccardo Benaglia , Angelo Porrello , Pietro Buzzega , Simone Calderara , Rita Cucchiara

We propose a novel algorithm for quantizing continuous latent representations in trained models. Our approach applies to deep probabilistic models, such as variational autoencoders (VAEs), and enables both data and model compression. Unlike…

图像与视频处理 · 电气工程与系统科学 2020-09-09 Yibo Yang , Robert Bamler , Stephan Mandt

Vector quantization (VQ) is a key component in discrete tokenizers for image generation, but its training is often unstable due to straight-through estimation bias, one-step-behind updates, and sparse codebook gradients, which lead to…

计算机视觉与模式识别 · 计算机科学 2025-09-15 Yifan Chang , Jie Qin , Limeng Qiao , Xiaofeng Wang , Zheng Zhu , Lin Ma , Xingang Wang

Optimal computations under uncertainty require an adequate probabilistic representation about beliefs. Deep generative models, and specifically Variational Autoencoders (VAEs), have the potential to meet this demand by building latent…

Despite progress in training neural networks for lossy image compression, current approaches fail to maintain both perceptual quality and abstract features at very low bitrates. Encouraged by recent success in learning discrete…

机器学习 · 计算机科学 2020-10-19 Will Williams , Sam Ringer , Tom Ash , John Hughes , David MacLeod , Jamie Dougherty

Vector Quantization (VQ) is a method for discretizing latent representations and has become a major part of the deep learning toolkit. It has been theoretically and empirically shown that discretization of representations leads to improved…

机器学习 · 计算机科学 2022-02-04 Dianbo Liu , Alex Lamb , Xu Ji , Pascal Notsawo , Mike Mozer , Yoshua Bengio , Kenji Kawaguchi

The Variational Autoencoder (VAE) is a powerful deep generative model that is now extensively used to represent high-dimensional complex data via a low-dimensional latent space learned in an unsupervised manner. In the original VAE model,…

声音 · 计算机科学 2021-06-15 Xiaoyu Bie , Laurent Girin , Simon Leglaive , Thomas Hueber , Xavier Alameda-Pineda

Encoding videos into discrete tokens could align with text tokens to facilitate concise and unified multi-modal LLMs, yet introducing significant spatiotemporal compression compared to continuous video representation. Previous discrete…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Yupeng Zhou , Zhen Li , Ziheng Ouyang , Yuming Chen , Ruoyi Du , Daquan Zhou , Bin Fu , Yihao Liu , Peng Gao , Ming-Ming Cheng , Qibin Hou

Deep learning (DL) methods where interpretability is intrinsically considered as part of the model are required to better understand the relationship of clinical and imaging-based attributes with DL outcomes, thus facilitating their use in…

图像与视频处理 · 电气工程与系统科学 2022-12-13 Irem Cetin , Maialen Stephens , Oscar Camara , Miguel Angel Gonzalez Ballester

The de novo design of drug molecules is recognized as a time-consuming and costly process, and computational approaches have been applied in each stage of the drug discovery pipeline. Variational autoencoder is one of the computer-aided…

量子物理 · 物理学 2021-12-24 Junde Li , Swaroop Ghosh

As deep Variational Auto-Encoder (VAE) frameworks become more widely used for modeling biomolecular simulation data, we emphasize the capability of the VAE architecture to concurrently maximize the timescale of the latent space while…

化学物理 · 物理学 2021-12-08 Hannah K. Wayment-Steele , Vijay S. Pande

In this letter, we propose a vector quantized-variational autoencoder (VQ-VAE)-based feedback scheme for robust precoder design in multi-user frequency division duplex (FDD) systems. We demonstrate how the VQ-VAE can be tailored to specific…

信息论 · 计算机科学 2024-08-09 Nurettin Turan , Michael Baur , Jianqing Li , Wolfgang Utschick