English
Related papers

Related papers: BICM Performance Improvement via Online LLR Optimi…

200 papers

Large Language Models (LLMs) have become extremely potent instruments with exceptional capacities for comprehending and producing human-like text in a wide range of applications. However, the increasing size and complexity of LLMs present…

Machine Learning · Computer Science 2024-06-18 Yingbing Huang , Lily Jiaxin Wan , Hanchen Ye , Manvi Jha , Jinghua Wang , Yuhong Li , Xiaofan Zhang , Deming Chen

In this paper, we propose a transmission mechanism for a reconfigurable intelligent surface (RIS)-assisted millimeter wave (mmWave) system based on cluster index modulation (CIM), named best-gain optimized cluster selection CIM (BGCS-CIM).…

Signal Processing · Electrical Eng. & Systems 2023-07-11 Mahmoud Raeisi , Asil Koc , Ibrahim Yildirim , Ertugrul Basar , Tho Le-Ngoc

This paper investigates scaling laws for local SGD in LLM training, a distributed optimization algorithm that facilitates training on loosely connected devices. Through extensive experiments, we show that local SGD achieves competitive…

Computation and Language · Computer Science 2024-09-23 Qiaozhi He , Xiaomin Zhuang , Zhihua Wu

This paper presents joint power allocation and interference mitigation techniques for the downlink of spread spectrum systems which employ multiple relays and the amplify and forward cooperation strategy. We propose a joint constrained…

Information Theory · Computer Science 2013-01-29 Rodrigo C. de Lamare

This paper introduces a new maximum likelihood (ML) solution for the code-aided (CA) timing recovery problem in square-QAM transmissions and derives, for the very first time, its CA Cram\'er-Rao lower bounds (CRLBs) in closed-form…

Information Theory · Computer Science 2015-09-15 Faouzi Bellili , Achref Methenni , Souheib Ben Amor , Sofiène Affes , Alex Stéphenne

Pre-trained large language models (LLM) have emerged as a powerful tool for simulating various scenarios and generating output given specific instructions and multimodal input. In this work, we analyze the specific use of LLM to enhance a…

Machine Learning · Computer Science 2024-05-10 Yuhang Wu , Yingfei Wang , Chu Wang , Zeyu Zheng

Coded caching (CC) techniques have been shown to be conveniently applicable in multi-input multi-output (MIMO) systems. In a $K$-user network with spatial multiplexing gains of $L$ at the transmitter and $G$ at every receiver, if each user…

Information Theory · Computer Science 2022-11-03 MohammadJavad Salehi , Mohammad NaseriTehrani , Antti Tölli

Data transmission rate in molecular communication systems can be improved by using multiple transmitters and receivers. In molecular multiple-input multiple-output (MIMO) systems which use only single type of molecules, the performance at…

Information Theory · Computer Science 2019-04-23 Nithin V. Sabu , Neeraj Varshney , Abhishek K. Gupta

Neural network language models (LMs) are confronted with significant challenges in generalization and robustness. Currently, many studies focus on improving either generalization or robustness in isolation, without methods addressing both…

Computation and Language · Computer Science 2025-03-24 Yudao Sun , Juan Yin , Juan Zhao , Fan Zhang , Yongheng Liu , Hongji Chen

While large-scale training data is fundamental for developing capable large language models (LLMs), strategically selecting high-quality data has emerged as a critical approach to enhance training efficiency and reduce computational costs.…

Machine Learning · Computer Science 2025-07-23 Yang Yu , Kai Han , Hang Zhou , Yehui Tang , Kaiqi Huang , Yunhe Wang , Dacheng Tao

The alternating direction method of multipliers (ADMM) has been recognized as a versatile approach for solving modern large-scale machine learning and signal processing problems efficiently. When the data size and/or the problem dimension…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-04 Tsung-Hui Chang , Wei-Cheng Liao , Mingyi Hong , Xiangfeng Wang

Implementation cost and power consumption are two important considerations in modern wireless communications, particularly in large-scale multi-antenna systems where the number of individual radio-frequency (RF) chains may be significantly…

Information Theory · Computer Science 2017-09-21 Zehao Yu , Cong Shen , Pengkai Zhao , Xiliang Luo

Bit-interleaved coded modulation with iterative decoding (BICM-ID) offers very good error performance over additive white Gaussian noise (AWGN) and fading channels if it uses a wisely designed signal mapping. Further, error performance of…

Information Theory · Computer Science 2017-01-06 Hassan M. Navazi , Md. Jahangir Hossain

Quantization is an essential and popular technique for improving the accessibility of large language models (LLMs) by reducing memory usage and computational costs while maintaining performance. In this study, we apply 4-bit Group Scaling…

Computation and Language · Computer Science 2025-08-18 Sahil Sk , Debasish Dhal , Sonal Khosla , Sk Shahid , Sambit Shekhar , Akash Dhaka , Shantipriya Parida , Dilip K. Prasad , Ondřej Bojar

Inter-symbol interference (ISI) limits reliability in diffusion-based molecular communication (MC) channels. We propose RLIM, a family of run-length-limited (RLL) codes that form fixed-size codebooks by minimizing the total number of…

Information Theory · Computer Science 2026-01-29 Melih Şahin , Ozgur B. Akan

Modern biomedical datasets are increasingly high dimensional and exhibit complex correlation structures. Generalized Linear Mixed Models (GLMMs) have long been employed to account for such dependencies. However, proper specification of the…

An approach is established for maximizing the Lower bound on the Mismatch capacity (hereafter abbreviated as LM rate), a key performance bound in mismatched decoding, by optimizing the channel input probability distribution. Under a fixed…

Information Theory · Computer Science 2024-05-02 Lingyi Chen , Shitong Wu , Xinwei Li , Huihui Wu , Hao Wu , Wenyi Zhang

Gradient boosted decision trees (GBDT) is the leading algorithm for many commercial and academic data applications. We give a deep analysis of this algorithm, especially the histogram technique, which is a basis for the regulized…

Machine Learning · Computer Science 2020-01-28 Yingshi Chen

In this paper, a novel framework is proposed to optimize the downlink multi-user communication of a millimeter wave base station, which is assisted by a reconfigurable intelligent reflector (IR). In particular, a channel estimation approach…

Information Theory · Computer Science 2021-08-03 Qianqian Zhang , Walid Saad , Mehdi Bennis

Modern deployment of large language models (LLMs) frequently involves both inference serving and continuous retraining to stay aligned with evolving data and user feedback. Common practices separate these workloads onto distinct servers in…

Artificial Intelligence · Computer Science 2025-07-30 Yufei Li , Zexin Li , Yinglun Zhu , Cong Liu