English
Related papers

Related papers: Vector Quantized Latent Concepts: A Scalable Alter…

200 papers

Obtaining the human-like perception ability of abstracting visual concepts from concrete pixels has always been a fundamental and important target in machine learning research fields such as disentangled representation learning and scene…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Tao Yang , Yuwang Wang , Yan Lu , Nanning Zheng

Recently, the generality of natural language text has been leveraged to develop transferable recommender systems. The basic idea is to employ pre-trained language models~(PLM) to encode item text into item representations. Despite the…

Information Retrieval · Computer Science 2023-02-14 Yupeng Hou , Zhankui He , Julian McAuley , Wayne Xin Zhao

As the field of Large Language Models (LLMs) continues to evolve, the context length in inference is steadily growing. Key-Value Cache (KVCache), the intermediate representations of tokens within LLM inference, has now become the primary…

Computation and Language · Computer Science 2025-04-01 Hailin Zhang , Xiaodong Ji , Yilin Chen , Fangcheng Fu , Xupeng Miao , Xiaonan Nie , Weipeng Chen , Bin Cui

Variational autoencoders (VAEs) are essential tools in end-to-end representation learning. However, the sequential text generation common pitfall with VAEs is that the model tends to ignore latent variables with a strong auto-regressive…

Machine Learning · Computer Science 2021-02-26 Yang Zhao , Ping Yu , Suchismit Mahapatra , Qinliang Su , Changyou Chen

Variational Auto-Encoders (VAEs) are capable of learning latent representations for high dimensional data. However, due to the i.i.d. assumption, VAEs only optimize the singleton variational distributions and fail to account for the…

Machine Learning · Computer Science 2020-04-20 Da Tang , Dawen Liang , Tony Jebara , Nicholas Ruozzi

Successfully training Variational Autoencoders (VAEs) with a hierarchy of discrete latent variables remains an area of active research. Vector-Quantised VAEs are a powerful approach to discrete VAEs, but naive hierarchical extensions can be…

Machine Learning · Statistics 2021-02-05 Matthew Willetts , Xenia Miscouridou , Stephen Roberts , Chris Holmes

Vector quantization is a technique in machine learning that discretizes continuous representations into a set of discrete vectors. It is widely employed in tokenizing data representations for large language models, diffusion models, and…

Machine Learning · Computer Science 2024-11-26 Wenhao Zhao , Qiran Zou , Rushi Shah , Dianbo Liu

Vector quantization is a technique in machine learning that discretizes continuous representations into a set of discrete vectors. It is widely employed in tokenizing data representations for large language models, diffusion models, and…

Machine Learning · Computer Science 2026-03-19 Wenhao Zhao , Qiran Zou , Rushi Shah , Yudi Wu , Zhouhan Lin , Dianbo Liu

The rapid advancement of large language models (LLMs) has intensified the need for effective mechanisms to transform continuous multimodal data into discrete representations suitable for language-based processing. Discrete tokenization,…

Computation and Language · Computer Science 2025-08-01 Jindong Li , Yali Fu , Jiahong Liu , Linxiao Cao , Wei Ji , Menglin Yang , Irwin King , Ming-Hsuan Yang

Despite progress in training neural networks for lossy image compression, current approaches fail to maintain both perceptual quality and abstract features at very low bitrates. Encouraged by recent success in learning discrete…

Machine Learning · Computer Science 2020-10-19 Will Williams , Sam Ringer , Tom Ash , John Hughes , David MacLeod , Jamie Dougherty

Vector-Quantized Variational Autoencoders (VQ-VAE)[1] provide an unsupervised model for learning discrete representations by combining vector quantization and autoencoders. In this paper, we study the use of VQ-VAE for representation…

Image and Video Processing · Electrical Eng. & Systems 2019-03-05 Hanwei Wu , Markus Flierl

Variational Quantum Circuits (VQC) are promising models for quantum machine learning, but standard monolithic architectures face an expressivity--trainability dilemma: small circuits can be under-parameterized, while larger circuits are…

Quantum Physics · Physics 2026-05-12 Howard Su , Chen-Yu Liu , Samuel Yen-Chi Chen , Kuan-Cheng Chen , Huan-Hsin Tseng

Continual learning studies how models can adapt to new tasks while retaining previously acquired knowledge. Although a broad spectrum of methods has been proposed to mitigate catastrophic forgetting, the field remains predominantly…

Machine Learning · Computer Science 2026-05-19 Katarzyna Filus , Kamil Faber , Roberto Corizzo , Christopher Kanan

Recent advancements in learning Discrete Representations as opposed to continuous ones have led to state of art results in tasks that involve Language, Audio and Vision. Some latent factors such as words, phonemes and shapes are better…

Machine Learning · Computer Science 2020-04-14 Iordanis Fostiropoulos

Deep clustering which adopts deep neural networks to obtain optimal representations for clustering has been widely studied recently. In this paper, we propose a novel deep image clustering framework to learn a category-style latent…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Junjie Zhao , Donghuan Lu , Kai Ma , Yu Zhang , Yefeng Zheng

Variational Autoencoders (VAEs) are powerful generative models for learning latent representations. Standard VAEs generate dispersed and unstructured latent spaces by utilizing all dimensions, which limits their interpretability, especially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Farshad Sangari Abiz , Reshad Hosseini , Babak N. Araabi

In disentangled representation learning, a model is asked to tease apart a dataset's underlying sources of variation and represent them independently of one another. Since the model is provided with no ground truth information about these…

Machine Learning · Computer Science 2023-10-24 Kyle Hsu , Will Dorrell , James C. R. Whittington , Jiajun Wu , Chelsea Finn

Clustering is a fundamental task for analyzing unlabeled data based solely on its underlying distribution. Spectral clustering is a clustering method that represents a dataset as a graph and uses the relationships between data points.…

Quantum Physics · Physics 2025-04-01 Hyeong-Gyu Kim , Siheon Park , June-Koo Kevin Rhee

Continual learning requires to overcome catastrophic forgetting when training a single model on a sequence of tasks. Recent top-performing approaches are prompt-based methods that utilize a set of learnable parameters (i.e., prompts) to…

Machine Learning · Computer Science 2025-07-22 Li Jiao , Qiuxia Lai , Yu Li , Qiang Xu

Deep learning-based semantic communication has largely relied on analog or semi-digital transmission, which limits compatibility with modern digital communication infrastructures. Recent studies have employed vector quantization (VQ) to…

Signal Processing · Electrical Eng. & Systems 2025-10-22 Zian Meng , Qiang Li , Wenqian Tang , Mingdie Yan , Xiaohu Ge