English
Related papers

Related papers: A combination between VQ and covariance matrices f…

200 papers

Neural contextual biasing allows speech recognition models to leverage contextually relevant information, leading to improved transcription accuracy. However, the biasing mechanism is typically based on a cross-attention module between the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-05 Nikolaos Flemotomos , Roger Hsiao , Pawel Swietojanski , Takaaki Hori , Dogan Can , Xiaodan Zhuang

The Key-Value (KV) cache introduces substantial memory overhead during large language model (LLM) inference. Although existing vector quantization (VQ) methods reduce KV cache usage and provide flexible representational capacity across…

Computation and Language · Computer Science 2025-10-08 Dingyu Yao , Chenxu Yang , Zhengyang Tong , Zheng Lin , Wei Liu , Jian Luan , Weiping Wang

Quantum error mitigation (QEM) is crucial for obtaining reliable results on quantum computers by suppressing quantum noise with moderate resources. It is a key factor for successful and practical quantum algorithm implementations in the…

Quantum Physics · Physics 2023-08-28 Shi-Xin Zhang , Zhou-Quan Wan , Chang-Yu Hsieh , Hong Yao , Shengyu Zhang

We present a framework that utilizes quantum algorithms, an architecture aware quantum noise model and an ideal simulator to benchmark quantum computers. The benchmark metrics highlight the difference between the quantum computer evolution…

Quantum Physics · Physics 2021-12-20 Konstantinos Georgopoulos , Clive Emary , Paolo Zuliani

A key component of variational quantum algorithms (VQAs) is the choice of classical optimizer employed to update the parameterization of an ansatz. It is well recognized that quantum algorithms will, for the foreseeable future, necessarily…

Quantum Physics · Physics 2025-05-06 Jeffrey Larson , Matt Menickelly , Jiahao Shi

Vector quantization is a fundamental operation for data compression and vector search. To obtain high accuracy, multi-codebook methods represent each vector using codewords across several codebooks. Residual quantization (RQ) is one such…

Machine Learning · Computer Science 2024-05-22 Iris A. M. Huijben , Matthijs Douze , Matthew Muckley , Ruud J. G. van Sloun , Jakob Verbeek

State-of-the-art language models (LMs) represented by long-short term memory recurrent neural networks (LSTM-RNNs) and Transformers are becoming increasingly complex and expensive for practical applications. Low-bit neural network…

Computation and Language · Computer Science 2021-12-22 Junhao Xu , Jianwei Yu , Shoukang Hu , Xunying Liu , Helen Meng

Vector quantization (VQ) is a key technique in high-resolution and high-fidelity image synthesis, which aims to learn a codebook to encode an image with a sequence of discrete codes and then generate an image in an auto-regression manner.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Guotao Liang , Baoquan Zhang , Yaowei Wang , Xutao Li , Yunming Ye , Huaibin Wang , Chuyao Luo , Kola Ye , linfeng Luo

The quantum perceptron, the variational circuit, and the Grover algorithm have been proposed as promising components for quantum machine learning. This paper presents a new quantum perceptron that combines the quantum variational circuit…

Quantum Physics · Physics 2024-04-16 Nouhaila Innan , Mohamed Bennai

Quantum compiling aims to construct a quantum circuit V by quantum gates drawn from a native gate alphabet, which is functionally equivalent to the target unitary U. It is a crucial stage for the running of quantum algorithms on noisy…

Quantum Physics · Physics 2021-03-23 Zhimin He , Lvzhou Li , Shenggen Zheng , Yongyao Li , Haozhen Situ

Variational quantum circuits (VQCs) are an essential tool in applying noisy intermediate-scale quantum computers to practical problems. VQCs are used as a central component in many algorithms, for example, in quantum machine learning,…

Quantum Physics · Physics 2025-12-18 Joona V. Pankkonen , Lauri Ylinen , Matti Raasakka , Ilkka Tittonen

Variational Quantum Algorithms (VQAs) are relatively robust to noise, but errors are still a significant detriment to VQAs on near-term quantum machines. It is imperative to employ error mitigation techniques to improve VQA fidelity. While…

Perceptual voice quality assessment plays a vital role in diagnosing and monitoring voice disorders. Traditional methods, such as the Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V) and the Grade, Roughness, Breathiness,…

Sound · Computer Science 2025-12-12 Whenty Ariyanti , Kuan-Yu Chen , Sabato Marco Siniscalchi , Hsin-Min Wang , Yu Tsao

We propose Quantum Vision (QV) theory as a new perspective for deep learning-based audio classification, applied to deepfake speech detection. Inspired by particle-wave duality in quantum physics, QV theory is based on the idea that data…

Computation and Language · Computer Science 2026-04-10 Khalid Zaman , Melike Sah , Anuwat Chaiwongyenc , Cem Direkoglu

In this paper, a new speech feature fusion method is proposed for speaker recognition on the basis of the cross gate parallel convolutional neural network (CG-PCNN). The Mel filter bank features (MFBFs) of different frequency resolutions…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-28 Jiacheng Zhang , Wenyi Yan , Ye Zhang

Current neural audio codecs typically use residual vector quantization (RVQ) to discretize speech signals. However, they often experience codebook collapse, which reduces the effective codebook size and leads to suboptimal performance. To…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-12 Rui-Chen Zheng , Hui-Peng Du , Xiao-Hang Jiang , Yang Ai , Zhen-Hua Ling

Large Language Models (LLMs) face significant challenges in edge deployment due to their massive parameter scale. Vector Quantization (VQ), a clustering-based quantization method, serves as a prevalent solution to this issue for its…

Machine Learning · Computer Science 2025-06-27 Yuxuan Yue , Zukang Xu , Zhihang Yuan , Dawei Yang , Jianlong Wu , Liqiang Nie

Vector Quantized Variational AutoEncoders (VQ-VAE) are a powerful representation learning framework that can discover discrete groups of features from a speech signal without supervision. Until now, the VQ-VAE architecture has previously…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Yi Zhao , Haoyu Li , Cheng-I Lai , Jennifer Williams , Erica Cooper , Junichi Yamagishi

Quantum advantage requires overcoming noise-induced degradation of quantum systems. Conventional methods for reducing noise such as error mitigation face scalability issues in deep circuits. Specifically, noise hampers the extraction of…

Quantum Physics · Physics 2023-12-05 Yonglong Ding , Ruyu Yang

With the increased need for multi-center magnetic resonance imaging studies, problems arise related to differences in hardware and software between centers. Namely, current algorithms for brain volume quantification are unreliable for the…

Image and Video Processing · Electrical Eng. & Systems 2019-11-12 Maria Ines Meyer , Ezequiel de la Rosa , Koen Van Leemput , Diana M. Sima