English
Related papers

Related papers: A Learnable Optimization and Regularization Approa…

200 papers

Massive multiple-input multiple-output (MIMO) is a promising technology to increase link capacity and energy efficiency. However, these benefits are based on available channel state information (CSI) at the base station (BS). Therefore,…

Signal Processing · Electrical Eng. & Systems 2024-10-30 Jiajia Guo , Chao-Kai Wen , Shi Jin , Geoffrey Ye Li

In this paper, we consider an extremely large-scale massive multiple-input-multiple-output (XL-MIMO) system. As the scale of antenna arrays increases, the range of near-field communications also expands. In this case, the signals no longer…

Signal Processing · Electrical Eng. & Systems 2024-05-24 Zhangjie Peng , Ruijing Liu , Zhaotian Li , Cunhua Pan , Jiangzhou Wang

Fine-tuning pre-trained large language models in a parameter-efficient manner is widely studied for its effectiveness and efficiency. The popular method of low-rank adaptation (LoRA) offers a notable approach, hypothesizing that the…

Computation and Language · Computer Science 2023-11-21 Ning Ding , Xingtai Lv , Qiaosen Wang , Yulin Chen , Bowen Zhou , Zhiyuan Liu , Maosong Sun

Channel state information (CSI) prediction is a promising strategy for ensuring reliable and efficient operation of massive multiple-input multiple-output (mMIMO) systems by providing timely downlink (DL) CSI. While deep learning-based…

The design of feedback channels in frequency division duplex (FDD) systems is a major challenge because of the limited available feedback bits. We consider non-orthogonal multiple access (NOMA) systems that incorporate reconfigurable…

Information Theory · Computer Science 2023-02-01 Mojtaba Ahmadi Almasi , Hamid Jafarkhani

In this paper, we propose a learning-based detection framework for uplink massive multiple-input and multiple-output (MIMO) systems with one-bit analog-to-digital converters. The learning-based detection only requires counting the…

Signal Processing · Electrical Eng. & Systems 2024-03-25 Yunseong Cho , Jinseok Choi , Brian L. Evans

In multiple-input multiple-output (MIMO) systems, it is crucial of utilizing the available channel state information (CSI) at the transmitter for precoding to improve the performance of frequency division duplex (FDD) networks. One of the…

Signal Processing · Electrical Eng. & Systems 2022-04-28 Xiangyi Li , Huaming Wu

While large language models (LLMs) achieve strong performance in recommendation, they face challenges in continual learning as users, items, and user preferences evolve over time. Existing LoRA-based continual methods primarily focus on…

Machine Learning · Computer Science 2026-03-19 Hyunsik Yoo , Ting-Wei Li , SeongKu Kang , Zhining Liu , Charlie Xu , Qilin Qi , Hanghang Tong

Fine-tuning large language models (LLMs) is computationally expensive, and Low-Rank Adaptation (LoRA) provides a cost-effective solution by approximating weight updates through low-rank matrices. In real-world scenarios, LLMs are fine-tuned…

Machine Learning · Computer Science 2025-06-03 Jinda Liu , Yi Chang , Yuan Wu

Continual learning (CL), which requires the model to learn multiple tasks sequentially, is crucial for large language models (LLMs). Recently, low-rank adaptation~(LoRA), one of the most representative parameter-efficient fine-tuning (PEFT)…

Computation and Language · Computer Science 2025-10-28 Yan-Shuo Liang , Jia-Rui Chen , Wu-Jun Li

Transformer-based large language models (LLMs) have achieved remarkable success across various tasks. Yet, fine-tuning such massive models in federated learning (FL) settings poses significant challenges due to resource constraints and…

Machine Learning · Computer Science 2026-03-25 Bumjun Kim , Wan Choi

To address data locality and privacy restrictions, Federated Learning (FL) has recently been adopted to fine-tune large language models (LLMs), enabling improved performance on various downstream tasks without requiring aggregated data.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-11 Han Liu , Ruoyao Wen , Srijith Nair , Jia Liu , Wenjing Lou , Chongjie Zhang , William Yeoh , Yevgeniy Vorobeychik , Ning Zhang

This work considers the problem of control and resource scheduling in networked systems. We present DIRA, a Deep reinforcement learning based Iterative Resource Allocation algorithm, which is scalable and control-aware. Our algorithm is…

Systems and Control · Computer Science 2019-09-24 Adrian Redder , Arunselvan Ramaswamy , Daniel E. Quevedo

Tuning large language models is essential for optimizing their performance across diverse applications, particularly in scenarios with limited data availability. Tuning large language models in scarce data scenarios is crucial, particularly…

Computation and Language · Computer Science 2025-03-25 Javad SeraJ , Mohammad Mahdi Mohajeri , Mohammad Javad Dousti

In frequency-division duplexing systems, the downlink channel state information (CSI) acquisition scheme leads to high training and feedback overheads. In this paper, we propose an uplink-aided downlink channel acquisition framework using…

Information Theory · Computer Science 2024-10-28 Jiajia Guo , Chao-Kai Wen , Shi Jin

Robust loss minimization is an important strategy for handling robust learning issue on noisy labels. Current robust loss functions, however, inevitably involve hyperparameter(s) to be tuned, manually or heuristically through cross…

Machine Learning · Computer Science 2020-02-18 Jun Shu , Qian Zhao , Keyu Chen , Zongben Xu , Deyu Meng

Current large language models (LLMs), even those explicitly trained for reasoning, often struggle with ambiguous content moderation cases due to misleading "decision shortcuts" embedded in context. Inspired by cognitive psychology insights…

Artificial Intelligence · Computer Science 2026-04-14 Bingzhe Wu , Haotian Lu , Yuchen Mou

Reconfigurable intelligent surface (RIS) can significantly enhance the service coverage of Tera-Hertz massive multiple-input multiple-output (MIMO) communication systems. However, obtaining accurate high-dimensional channel state…

Signal Processing · Electrical Eng. & Systems 2022-12-06 Minghui Wu , Zhen Gao , Yang Huang , Zhenyu Xiao , Derrick Wing Kwan Ng , Zhaoyang Zhang

We present a MUSIC-based Direction of Arrival (DOA) estimation strategy using small antenna arrays, via employing deep learning for reconstructing the signals of a virtual large antenna array. Not only does the proposed strategy deliver…

Signal Processing · Electrical Eng. & Systems 2021-03-08 Aya Mostafa Ahmed , Udaya Sampath K. P. Miriya Thanthrige , Aly El Gamal , Aydin Sezgin

While Multimodal Large Language Models (MLLMs) excel at generalizing across modalities and tasks, effectively adapting them to specific downstream tasks while simultaneously retaining both general and specialized knowledge remains…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Jian Liang , Wenke Huang , Guancheng Wan , Qu Yang , Mang Ye