English
Related papers

Related papers: Vector Quantization for Deep-Learning-Based CSI Fe…

200 papers

A receiver with perfect channel state information (CSI) in a point-to-point multiple-input multiple-output (MIMO) channel can compute the transmit beamforming vector that maximizes the transmission rate. For frequency-division duplex, a…

Information Theory · Computer Science 2018-08-22 Kritsada Mamat , Wiroonsak Santipach

In this paper, we propose a data-driven deep learning (DL) approach to jointly design the pilot signals and channel estimator for wideband massive multiple-input multiple-output (MIMO) systems. By exploiting the angular-domain…

Information Theory · Computer Science 2020-03-13 Xisuo Ma , Zhen Gao

Large language models (LLMs) have achieved remarkable success across a wide range of tasks, particularly in natural language processing and computer vision. This success naturally raises an intriguing yet unexplored question: Can LLMs be…

Information Theory · Computer Science 2025-01-22 Yiming Cui , Jiajia Guo , Chao-Kai Wen , Shi Jin , En Tong

Accurate channel state information (CSI) feedback plays a vital role in improving the performance gain of massive multiple-input multiple-output (m-MIMO) systems, where the dilemma is excessive CSI overhead versus limited feedback bandwith.…

Signal Processing · Electrical Eng. & Systems 2020-08-18 Yuyao Sun , Wei Xu , Lisheng Fan , Geoffrey Ye Li , George K. Karagiannidis

Large language models (LLMs) based on Transformer Decoders have become the preferred choice for conversational generative AI. Despite the overall superiority of the Decoder architecture, the gradually increasing Key-Value (KV) cache during…

Computation and Language · Computer Science 2025-07-16 Luohe Shi , Zuchao Li , Lefei Zhang , Guoming Liu , Baoyuan Qi , Hai Zhao

Given a multiple-input multiple-output (MIMO) channel, feedback from the receiver can be used to specify a transmit precoding matrix, which selectively activates the strongest channel modes. Here we analyze the performance of Random Vector…

Information Theory · Computer Science 2010-08-27 Wiroonsak Santipach , Michael L. Honig

Vector quantization (VQ) is a key technique in high-resolution and high-fidelity image synthesis, which aims to learn a codebook to encode an image with a sequence of discrete codes and then generate an image in an auto-regression manner.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Guotao Liang , Baoquan Zhang , Yaowei Wang , Xutao Li , Yunming Ye , Huaibin Wang , Chuyao Luo , Kola Ye , linfeng Luo

In a frequency division duplex (FDD) massive multiple input multiple output (MIMO) system, the channel state information (CSI) feedback causes a significant bandwidth resource occupation. In order to save the uplink bandwidth resources, a…

Signal Processing · Electrical Eng. & Systems 2019-09-04 Chaojin Qing , Qingyao Yang , Bin Cai , Borui Pan , Jiafan Wang

In frequency-division duplexing systems, the downlink channel state information (CSI) acquisition scheme leads to high training and feedback overheads. In this paper, we propose an uplink-aided downlink channel acquisition framework using…

Information Theory · Computer Science 2024-10-28 Jiajia Guo , Chao-Kai Wen , Shi Jin

Channel state information (CSI) feedback in frequency-division duplex (FDD) massive multiple-input multiple-output (MIMO) systems is fundamentally limited by the high dimensionality of wideband channels. In this paper, we model the stacked…

Information Theory · Computer Science 2026-03-17 Bumsu Park , Youngmok Park , Chanho Park , Namyoon Lee

In order to unlock the full advantages of massive multiple input multiple output (MIMO) in the downlink, channel state information (CSI) is required at the base station (BS) to optimize the beamforming matrices. In frequency division duplex…

Information Theory · Computer Science 2021-07-09 Yusha Liu , Osvaldo Simeone

Variable-length feedback coding has the potential to significantly enhance communication reliability in finite block length scenarios by adapting coding strategies based on real-time receiver feedback. Designing such codes, however, is…

Information Theory · Computer Science 2024-11-14 Wenwei Lai , Yulin Shao , Yu Ding , Deniz Gunduz

This paper proposes a novel framework for rate-adaptive semantic communication based on multi-stage vector quantization (VQ), termed \textit{MSVQ-SC}. Unlike conventional single-stage VQ approaches, which require exponentially larger…

Signal Processing · Electrical Eng. & Systems 2025-10-06 Jinsung Park , Junyong Shin , Yongjeong Oh , Jihun Park , Yo-Seb Jeon

We analyze the effect of finite rate feedback on CDMA (code-division multiple access) signature optimization and MIMO (multi-input-multi-output) beamforming vector selection. In CDMA signature optimization, for a particular user, the…

Information Theory · Computer Science 2007-07-13 Wei Dai , Youjian Liu , Brian Rider

Vector quantization is a fundamental operation for data compression and vector search. To obtain high accuracy, multi-codebook methods represent each vector using codewords across several codebooks. Residual quantization (RQ) is one such…

Machine Learning · Computer Science 2024-05-22 Iris A. M. Huijben , Matthijs Douze , Matthew Muckley , Ruud J. G. van Sloun , Jakob Verbeek

In order to fully exploit the advantages of massive multiple-input multiple-output (mMIMO), it is critical for the transmitter to accurately acquire the channel state information (CSI). Deep learning (DL)-based methods have been proposed…

Information Theory · Computer Science 2022-04-26 Ziqing Yin , Wei Xu , Renjie Xie , Shaoqing Zhang , Derrick Wing Kwan Ng , Xiaohu You

Large Language Models (LLMs) have achieved remarkable success but face significant computational and memory challenges, particularly due to their extensive output vocabularies. The final linear projection layer, mapping hidden states to…

Computation and Language · Computer Science 2025-05-16 Jintian Shao , Hongyi Huang , Jiayi Wu , YiMing Cheng , ZhiYu Wu , You Shan , MingKai Zheng

State-of-the-art high-spectral-efficiency communication systems employ high-order modulation formats coupled with high symbol rates to accommodate the ever-growing demand for data rate-hungry applications. However, such systems are more…

Signal Processing · Electrical Eng. & Systems 2023-02-24 Jinxiang Song , Vincent Lauinger , Yibo Wu , Christian Häger , Jochen Schröder , Alexandre Graell i Amat , Laurent Schmalen , Henk Wymeersch

Deep learning-based semantic communication has largely relied on analog or semi-digital transmission, which limits compatibility with modern digital communication infrastructures. Recent studies have employed vector quantization (VQ) to…

Signal Processing · Electrical Eng. & Systems 2025-10-22 Zian Meng , Qiang Li , Wenqian Tang , Mingdie Yan , Xiaohu Ge

The rapid advancement of large language models (LLMs) has intensified the need for effective mechanisms to transform continuous multimodal data into discrete representations suitable for language-based processing. Discrete tokenization,…

Computation and Language · Computer Science 2025-08-01 Jindong Li , Yali Fu , Jiahong Liu , Linxiao Cao , Wei Ji , Menglin Yang , Irwin King , Ming-Hsuan Yang