English
Related papers

Related papers: Beyond Stationarity: Rethinking Codebook Collapse …

200 papers

Vector Quantization, VQ is a popular image compression technique with a simple decoding architecture and high compression ratio. Codebook designing is the most essential part in Vector Quantization. LindeBuzoGray, LBG is a traditional…

Computer Vision and Pattern Recognition · Computer Science 2017-10-17 Sayan Nag

Recent proposals for quantum generative adversarial networks (GANs) suffer from the issue of mode collapse, analogous to classical GANs, wherein the distribution learnt by the GAN fails to capture the high mode complexities of the target…

Quantum Physics · Physics 2025-05-23 Aaron Mark Thomas , Harry Youel , Sharu Theresa Jose

Large Language Models (LLMs) face significant challenges in edge deployment due to their massive parameter scale. Vector Quantization (VQ), a clustering-based quantization method, serves as a prevalent solution to this issue for its…

Machine Learning · Computer Science 2025-06-27 Yuxuan Yue , Zukang Xu , Zhihang Yuan , Dawei Yang , Jianlong Wu , Liqiang Nie

Variational Quantum Computing (VQC) faces fundamental scalability barriers, primarily due to barren plateaus and sensitivity to quantum noise. To address these challenges, we introduce TensorHyper-VQC, a novel tensor-train (TT)-guided…

Quantum Physics · Physics 2026-02-10 Jun Qi , Chao-Han Huck Yang , Pin-Yu Chen , Min-Hsiu Hsieh

Vector Quantized-Variational AutoEncoders (VQ-VAE) are generative models based on discrete latent representations of the data, where inputs are mapped to a finite set of learned embeddings.To generate new samples, an autoregressive prior…

Machine Learning · Statistics 2022-08-04 Max Cohen , Guillaume Quispe , Sylvain Le Corff , Charles Ollion , Eric Moulines

Mixture of Experts (MoE) models have achieved great success by significantly improving performance while maintaining computational efficiency through sparse expert activation. However, their enormous parameter sizes and memory demands pose…

Machine Learning · Computer Science 2026-02-25 Zukang Xu , Zhixiong Zhao , Xing Hu , Zhixuan Chen , Dawei Yang

Scalable realisation of quantum computing is reliant on the development of fault tolerant devices. Analysis of quantum error correction protocols typically considers incoherent noise models or noise-free syndrome measurements. While this is…

Quantum Physics · Physics 2026-05-29 Ben Harper , Azar C. Nakhl , Martin Sevior , Muhammad Usman

Quantum supervised learning, utilizing variational circuits, stands out as a promising technology for NISQ devices due to its efficiency in hardware resource utilization during the creation of quantum feature maps and the implementation of…

Quantum Physics · Physics 2023-11-15 Anton Simen Albino , Rodrigo Bloot , Otto M. Pires , Erick G. S. Nascimento

Quantum Computing aims to streamline machine learning, making it more effective with fewer trainable parameters. This reduction of parameters can speed up the learning process and reduce the use of computational resources. However, in the…

Quantum Physics · Physics 2024-05-22 Michael Kölle , Timo Witter , Tobias Rohe , Gerhard Stenzel , Philipp Altmann , Thomas Gabor

The reliability of segmentation models in the medical domain depends on the model's robustness to perturbations in the input space. Robustness is a particular challenge in medical imaging exhibiting various sources of image noise,…

Image and Video Processing · Electrical Eng. & Systems 2022-07-06 Ainkaran Santhirasekaram , Avinash Kori , Mathias Winkler , Andrea Rockall , Ben Glocker

Quantum machine learning is at the crossroads of two of the most exciting current areas of research; quantum computing and classical machine learning. It explores the interaction between quantum computing and machine learning, investigating…

Quantum Physics · Physics 2021-12-14 Anekait Kariya , Bikash K. Behera

Quantum computing has been a prominent research area for decades, inspiring transformative fields such as quantum simulation, quantum teleportation, and quantum machine learning (QML), which are undergoing rapid development. Within QML,…

Quantum Physics · Physics 2025-04-01 Shiwen An , Konstantinos Slavakis

Neural Audio Codecs (NACs) have become increasingly adopted in speech processing tasks due to their excellent rate-distortion performance and compatibility with Large Language Models (LLMs) as discrete feature representations for audio…

Sound · Computer Science 2025-09-15 Harry Julian , Rachel Beeson , Lohith Konathala , Johanna Ulin , Jiameng Gao

The field of image generation is currently bifurcated into autoregressive (AR) models operating on discrete tokens and diffusion models utilizing continuous latents. This divide, rooted in the distinction between VQ-VAEs and VAEs, hinders…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Bin Lin , Zongjian Li , Yuwei Niu , Kaixiong Gong , Yunyang Ge , Yunlong Lin , Mingzhe Zheng , JianWei Zhang , Miles Yang , Zhao Zhong , Liefeng Bo , Li Yuan

The importance of quantum error correction in paving the way to build a practical quantum computer is no longer in doubt. This dissertation makes a threefold contribution to the mathematical theory of quantum error-correcting codes.…

Quantum Physics · Physics 2008-10-16 Pradeep Kiran Sarvepalli

Transformer models and end-to-end learning frameworks are rapidly revolutionizing the field of artificial intelligence. In this work, we apply object detection transformers to analyze charge stability diagrams in semiconductor quantum dot…

Scaling quantum computing to practical applications necessitates reliable quantum error correction. Although numerous correction codes have been proposed, the overall correction efficiency critically limited by the decode algorithms. We…

Quantum Physics · Physics 2025-06-04 Gengyuan Hu , Wanli Ouyang , Chao-Yang Lu , Chen Lin , Han-Sen Zhong

Vector quantization-based image semantic communication systems have successfully boosted transmission efficiency, but face challenges with conflicting requirements between codebook design and digital constellation modulation. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yingbin Zhou , Yaping Sun , Guanying Chen , Xiaodong Xu , Hao Chen , Binhong Huang , Shuguang Cui , Ping Zhang

A multi-grid multi-block-size vector quantization (MGBVQ) method is proposed for image coding in this work. The fundamental idea of image coding is to remove correlations among pixels before quantization and entropy coding, e.g., the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Yifan Wang , Zhanxuan Mei , Ioannis Katsavounidis , C. -C. Jay Kuo

Deep Learning models encode rich semantic information in their hidden representations. However, it remains challenging to understand which parts of this information models actually rely on when making predictions. A promising line of…

Machine Learning · Computer Science 2026-02-04 Xuemin Yu , Ankur Garg , Samira Ebrahimi Kahou , Hassan Sajjad