English
Related papers

Related papers: Vector Quantization for Deep-Learning-Based CSI Fe…

200 papers

Vector Quantized Variational AutoEncoders (VQ-VAEs) are designed to compress a continuous input to a discrete latent space and reconstruct it with minimal distortion. They operate by maintaining a set of vectors -- often referred to as the…

Mixture of Experts (MoE) models have achieved great success by significantly improving performance while maintaining computational efficiency through sparse expert activation. However, their enormous parameter sizes and memory demands pose…

Machine Learning · Computer Science 2026-02-25 Zukang Xu , Zhixiong Zhao , Xing Hu , Zhixuan Chen , Dawei Yang

Uncovering emergent concepts across transformer layers remains a significant challenge because the residual stream linearly mixes and duplicates information, obscuring how features evolve within large language models. Current research…

Machine Learning · Computer Science 2025-07-18 Ankur Garg , Xuemin Yu , Hassan Sajjad , Samira Ebrahimi Kahou

Constant envelope (CE) precoding design is of great interest for massive multiuser multi-input multi-output systems because it can significantly reduce hardware cost and power consumption. However, existing CE precoding algorithms are…

Signal Processing · Electrical Eng. & Systems 2020-06-30 Yunfeng He , Hengtao , He , Chao-Kai Wen , Shi Jin

In frequency-division duplexing (FDD) massive multiple-input multiple-output (MIMO), deep learning (DL)-based superimposed channel state information (CSI) feedback has presented promising performance. However, it is still facing many…

Signal Processing · Electrical Eng. & Systems 2020-03-13 Chaojin Qing , Bin Cai , Qingyao Yang , Jiafan Wang , Chuan Huang

Estimation in few-bit MIMO systems is challenging, since the received signals are nonlinearly distorted by the low-resolution ADCs. In this paper, we propose a deep learning framework for channel estimation, data detection, and pilot signal…

Signal Processing · Electrical Eng. & Systems 2021-07-27 Ly V. Nguyen , Duy H. N. Nguyen , A. Lee Swindlehurst

In multi input multi output antenna systems, beamforming is a technique for guarding against the negative effects of fading. However, this technique requires the transmitter to have perfect knowledge of the channel which is often not…

Other Computer Science · Computer Science 2011-05-03 Najoua Achoura And Ridha Bouallegue

In this paper, we study a quantized feedback scheme to maximize the goodput of a finite blocklength communication scenario over a quasi-static fading channel. It is assumed that the receiver has perfect channel state information (CSI) and…

Information Theory · Computer Science 2022-07-04 Hasan Basri Celebi , Mikael Skoglund

Deep learning has enabled significant advances in feedback-based channel coding, yet existing learned schemes remain fundamentally limited: they employ fixed block lengths, suffer degraded performance at high rates, and cannot fully exploit…

Information Theory · Computer Science 2026-02-10 Yu Ding , Yulin Shao

The availability and accuracy of Channel State Information (CSI) play a crucial role for coherent detection in almost every communication system. Particularly in the recently proposed cell-free massive MIMO system, in which a large number…

Information Theory · Computer Science 2019-02-20 Dick Maryopi , Alister Burr

In this paper, we propose trellis coded quantization (TCQ) based limited feedback techniques for massive multiple-input single-output (MISO) frequency division duplexing (FDD) systems in temporally and spatially correlated channels. We…

Information Theory · Computer Science 2016-11-17 Jawad Mirza , Mansoor Shafi , Peter J. Smith , Pawel A. Dmochowski

In conventional multi-user multiple-input multiple-output (MU-MIMO) systems with frequency division duplexing (FDD), channel acquisition and precoder optimization processes have been designed separately although they are highly coupled.…

Information Theory · Computer Science 2022-09-22 Jeonghyeon Jang , Hoon Lee , Il-Min Kim , Inkyu Lee

This paper focuses on the design of beamforming codebooks that maximize the average normalized beamforming gain for any underlying channel distribution. While the existing techniques use statistical channel models, we utilize a model-free…

Information Theory · Computer Science 2020-05-19 Keerthana Bhogi , Chiranjib Saha , Harpreet S. Dhillon

In this work, we developed and tested 3 techniques for vector quantization (VQ) based model weight compression. To mitigate codebook collapse and enable end-to-end training, we adopted cosine similarity-based assignment. Building on ideas…

Machine Learning · Computer Science 2026-04-28 Terry Gou , Puneet Gupta

This paper studies the problem of linear precoding for multiple-input multiple-output (MIMO) communication channels employing finite-alphabet signaling. Existing solutions typically suffer from high computational complexity due to costly…

Information Theory · Computer Science 2021-11-08 Maksym A. Girnyk

Deep learning-based massive MIMO CSI feedback has received a lot of attention in recent years. Now, there exists a plethora of CSI feedback models mostly based on auto-encoders (AE) architecture with an encoder network at the user equipment…

Information Theory · Computer Science 2022-12-02 Sharan Mourya , SaiDhiraj Amuru , Kiran Kumar Kuchi

In this paper, we propose a post-training quantization framework of large vision-language models (LVLMs) for efficient multi-modal inference. Conventional quantization methods sequentially search the layer-wise rounding functions by…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Changyuan Wang , Ziwei Wang , Xiuwei Xu , Yansong Tang , Jie Zhou , Jiwen Lu

Vectorization is a powerful optimization technique that significantly boosts the performance of high performance computing applications operating on large data arrays. Despite decades of research on auto-vectorization, compilers frequently…

Software Engineering · Computer Science 2024-06-10 Jubi Taneja , Avery Laird , Cong Yan , Madan Musuvathi , Shuvendu K. Lahiri

Multi-antenna or multiple-input multiple-output (MIMO) technique can significantly improve the efficiency of radio frequency (RF) signal enabled wireless energy transfer (WET). To fully exploit the energy beamforming gain at the energy…

Information Theory · Computer Science 2016-05-04 Jie Xu , Rui Zhang

We present Channel-wise Vector Quantization (CVQ), a novel image tokenization paradigm that replaces patch-wise tokens with channel-wise tokens. Unlike conventional vector quantization, which assigns a discrete token to each patch feature…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Wei Song , Tianhang Wang , Yitong Chen , Tong Zhang , Zuxuan Wu , Ming Li , Jiaqi Wang , Kaicheng Yu