English
Related papers

Related papers: A Learnable Optimization and Regularization Approa…

200 papers

Massive MIMO wireless FDD systems are often confronted by the challenge to efficiently obtain downlink channel state information (CSI). Previous works have demonstrated the potential in CSI encoding and recovery by take advantage of…

Information Theory · Computer Science 2021-12-20 Yu-Chien Lin , Zhenyu Liu , Ta-Sung Lee , Zhi Ding

Fine-tuning is the primary methodology for tailoring pre-trained large language models to specific tasks. As the model's scale and the diversity of tasks expand, parameter-efficient fine-tuning methods are of paramount importance. One of…

Machine Learning · Computer Science 2024-01-10 Wenhan Xia , Chengwei Qin , Elad Hazan

Large language models (LLMs) exhibit remarkable capabilities in natural language processing but face catastrophic forgetting when learning new tasks, where adaptation to a new domain leads to a substantial decline in performance on previous…

Computation and Language · Computer Science 2025-03-24 Yuheng Lu , Bingshuo Qian , Caixia Yuan , Huixing Jiang , Xiaojie Wang

In multiple-input multiple-output (MIMO) systems, the high-resolution channel information (CSI) is required at the base station (BS) to ensure optimal performance, especially in the case of multi-user MIMO (MU-MIMO) systems. In the absence…

Information Theory · Computer Science 2022-02-04 Pranav Madadi , Jeongho Jeon , Joonyoung Cho , Caleb Lo , Juho Lee , Jianzhong Zhang

Massive MIMO basestations, operating with frequency-division duplexing (FDD), require the users to feedback their channel state information (CSI) in order to design the precoding matrices. Given the powerful capabilities of deep neural…

Information Theory · Computer Science 2024-01-17 Yu Zhang , Ahmed Alkhateeb

Deep learning (DL)-based channel state information (CSI) feedback has shown promising potential to improve spectrum efficiency in massive MIMO systems. However, practical DL approaches require a sizeable CSI dataset for each scenario, and…

Information Theory · Computer Science 2023-11-07 Zhenyu Liu , Li Wang , Lianming Xu , Zhi Ding

Massive multiple-input multiple-output (mMIMO) regime reaps the benefits of spatial diversity and multiplexing gains, subject to precise channel state information (CSI) acquisition. In the current communication architecture, the downlink…

Information Theory · Computer Science 2022-08-26 Muhammad Karam Shehzad , Luca Rose , Stefan Wesemann , Mohamad Assaad , Syed Ali Hassan

Low-Rank Adaptation (LoRA) is an efficient fine-tuning method that has been extensively applied in areas such as natural language processing and computer vision. Existing LoRA fine-tuning approaches excel in static environments but struggle…

Machine Learning · Computer Science 2025-02-26 Xin Zhang , Liang Bai , Xian Yang , Jiye Liang

In frequency-division duplexing (FDD) massive multiple-input multiple-output (MIMO) systems, downlink channel state information (CSI) needs to be sent back to the base station (BS) by the users, which causes prohibitive feedback overhead.…

Information Theory · Computer Science 2023-06-06 Yifan Ma , Wentao Yu , Xianghao Yu , Jun Zhang , Shenghui Song , Khaled B. Letaief

Large language models (LLMs) have achieved remarkable success across a wide range of tasks, particularly in natural language processing and computer vision. This success naturally raises an intriguing yet unexplored question: Can LLMs be…

Information Theory · Computer Science 2025-01-22 Yiming Cui , Jiajia Guo , Chao-Kai Wen , Shi Jin , En Tong

Channel state information (CSI) feedback is necessary for the frequency division duplexing (FDD) multiple input multiple output (MIMO) systems due to the channel non-reciprocity. With the help of deep learning, many works have succeeded in…

Information Theory · Computer Science 2023-02-07 Zhilin Lu , Xudong Zhang , Rui Zeng , Jintao Wang

In this paper, we introduce a method for fine-tuning Large Language Models (LLMs), inspired by Multi-Task learning in a federated manner. Our approach leverages the structure of each client's model and enables a learning scheme that…

Machine Learning · Computer Science 2024-10-22 Ahmed Elbakary , Chaouki Ben Issaid , Tamer ElBatt , Karim Seddik , Mehdi Bennis

The channel state information (CSI) needs to be fed back from the user equipment (UE) to the base station (BS) in frequency division duplexing (FDD) multiple-input multiple-output (MIMO) system. Recently, neural networks are widely applied…

Information Theory · Computer Science 2022-11-01 Zhilin Lu , Xudong Zhang , Rui Zeng , Jintao Wang

Reinforcement learning (RL) has become a critical paradigm for LLM post-training, yet the rollout phase -- accounting for 50--80% of total step time -- is bottlenecked by skewed generation: long-tailed trajectories indispensable for model…

Channel state information (CSI) feedback is critical for frequency division duplex (FDD) massive multi-input multi-output (MIMO) systems. Most conventional algorithms are based on compressive sensing (CS) and are highly dependent on the…

Signal Processing · Electrical Eng. & Systems 2020-04-17 Hongyuan Ye , Feifei Gao , Jing Qian , Hao Wang , Geoffrey Ye Li

The efficacy of massive multiple-input multiple-output (MIMO) techniques heavily relies on the accuracy of channel state information (CSI) in frequency division duplexing (FDD) systems. Many works focus on CSI compression and quantization…

Signal Processing · Electrical Eng. & Systems 2024-05-31 Xinran Sun , Zhengming Zhang , Luxi Yang

Massive MIMO systems rely on accurate Channel State Information (CSI) feedback to enable high-gain beam-forming. However, the feedback overhead scales linearly with the number of antennas, presenting a major bottleneck. While recent deep…

Systems and Control · Electrical Eng. & Systems 2025-12-17 Maryam Ansarifard , Mostafa Rahmani , Mohit K. Sharma , Kishor C. Joshi , George Exarchakos , Alister Burr

Acquiring and utilizing accurate channel state information (CSI) can significantly improve transmission performance, thereby holding a crucial role in realizing the potential advantages of massive multiple-input multiple-output (MIMO)…

Information Theory · Computer Science 2024-03-21 Haotian Wu , Maojun Zhang , Yulin Shao , Krystian Mikolajczyk , Deniz Gündüz

Low-Rank Adaptation (LoRA) is one of the most widely used techniques for fine-tuning large language models (LLMs). By introducing a small number of trainable low-rank weight matrices, LoRA substantially reduces the number of parameters that…

Machine Learning · Computer Science 2025-07-15 Seokmin Ko

Downlink massive multiple-input multiple-output (MIMO) precoding algorithms in frequency division duplexing (FDD) systems rely on accurate channel state information (CSI) feedback from users. In this paper, we analyze the tradeoff between…

Information Theory · Computer Science 2023-10-25 Fabrizio Carpi , Sivarama Venkatesan , Jinfeng Du , Harish Viswanathan , Siddharth Garg , Elza Erkip