English
Related papers

Related papers: A Coded Bit-Loading Linear Precoded Discrete Multi…

200 papers

Recent years have witnessed a clear trend towards language models with an ever-increasing number of parameters, as well as the growing training overhead and memory usage. Distributed training, particularly through Sharded Data Parallelism…

Machine Learning · Computer Science 2024-11-26 Jinda Jia , Cong Xie , Hanlin Lu , Daoce Wang , Hao Feng , Chengming Zhang , Baixi Sun , Haibin Lin , Zhi Zhang , Xin Liu , Dingwen Tao

The capacity of the AWGN broadcast channel is achieved by superposition coding, but superposition of individual coded modulations expands the modulation alphabet and distorts its configuration. Coded modulation over a broadcast channel…

Information Theory · Computer Science 2016-10-31 Ahmed Abotabl , Aria Nosratinia

In this paper, we take the advantage of previous pre-trained models (PTMs) and propose a novel Chinese Pre-trained Unbalanced Transformer (CPT). Different from previous Chinese PTMs, CPT is designed to utilize the shared knowledge between…

Computation and Language · Computer Science 2022-07-19 Yunfan Shao , Zhichao Geng , Yitao Liu , Junqi Dai , Hang Yan , Fei Yang , Li Zhe , Hujun Bao , Xipeng Qiu

Deep learning based decoding networks have shown significant improvement in decoding LDPC codes, but the neural decoders are limited by rate-matching operations such as puncturing or extending, thus needing to train multiple decoders with…

Signal Processing · Electrical Eng. & Systems 2023-10-11 Yukun Cheng , Wei Chen , Lun Li , Bo Ai

This paper studies an energy efficient design of precoders for point-to-point multiple-input-multiple-output (MIMO) orthogonal frequency-division multiplexing (OFDM) systems. Differently from traditional approaches, the optimal power…

Information Theory · Computer Science 2015-03-18 Zijian Wang , Ivan Stupia , Luc Vandendorpe

This paper presents a novel method for utilizing fine-tuned Large Language Models (LLMs) to minimize data requirements in load profile analysis, demonstrated through the restoration of missing data in power system load profiles. A two-stage…

Machine Learning · Computer Science 2024-06-05 Yi Hu , Hyeonjin Kim , Kai Ye , Ning Lu

One key feature of ultra-reliable low-latency communications (URLLC) in 5G is to support short packet transmission (SPT). However, the pilot overhead in SPT for channel estimation is relatively high, especially in high Doppler environments.…

Information Theory · Computer Science 2023-09-19 Canjian Zheng , Fu-Chun Zheng , Jingjing Luo , Pengcheng Zhu , Xiaohu You , Daquan Feng

Recent works have shown promising results of prompt tuning in stimulating pre-trained language models (PLMs) for natural language processing (NLP) tasks. However, to the best of our knowledge, existing works focus on prompt-tuning…

Computation and Language · Computer Science 2022-05-24 Yuan Yao , Bowen Dong , Ao Zhang , Zhengyan Zhang , Ruobing Xie , Zhiyuan Liu , Leyu Lin , Maosong Sun , Jianyong Wang

This paper studies the problem of linear precoding for multiple-input multiple-output (MIMO) communication channels employing finite-alphabet signaling. Existing solutions typically suffer from high computational complexity due to costly…

Information Theory · Computer Science 2021-11-08 Maksym A. Girnyk

Coding schemes for discrete memoryless multicast networks (DM-MN) with rate-limited feedback from the receivers and relays to the transmitter are proposed. The schemes improve over the noisy network coding proposed by Lim et al.. For the…

Information Theory · Computer Science 2016-11-17 Youlong Wu

We investigate the performance of coded modulation for multi-hop regenerative optical networks. We analyze options for computing decoder input LLRs, show reach increases by optimized regenerator placement and experimentally compare…

Information Theory · Computer Science 2022-04-13 Laurent Schmalen , Tobias A. Eriksson , Fred Buchali , Roman Dischler , Ulrich Gebhard

Large language models (LLMs) are increasingly being explored as high-level decision modules in closed-loop systems, but their stochastic nature makes safe integration challenging. In this paper, we propose LLM-Steered Power Allocation, a…

Information Theory · Computer Science 2026-04-24 Tadashi Wadayama

Coded modulation is a key technique to increase the spectral efficiency of coherent optical communication systems. Two popular strategies for coded modulation are turbo trellis-coded modulation (TTCM) and bit-interleaved coded modulation…

Information Theory · Computer Science 2017-10-12 Eric Sillekens , Alex Alvarado , Chigo Okonkwo , Benn C. Thomsen

In this paper we estimate the performance of 2*4 MIMO-MC-CDMA system using convolution code in MATLAB which highly reduces BER. MC-CDMA (Multi Carrier Code Division for Multiple Access) is a multiuser and multiple access system which is…

Information Theory · Computer Science 2014-07-24 Atul Singh Kushwah , Priya Rathore , Ramsewak Kumar

Multilevel coding (MLC) is a coded modulation technique which can achieve excellent performance over a range of communication channels. Polar codes have been shown to be quite compatible with communication systems using MLC, as the rate…

Information Theory · Computer Science 2021-04-21 Muhammad Zaeem Hasan , Nemanja Stefan Perović , Mark F. Flanagan

Mixed precision training (MPT) is becoming a practical technique to improve the speed and energy efficiency of training deep neural networks by leveraging the fast hardware support for IEEE half-precision floating point that is available in…

Machine Learning · Computer Science 2019-10-29 Ruizhe Zhao , Brian Vogel , Tanvir Ahmed

A radio frequency (RF) power amplifier (PA) plays an important role to amplify the message signal at higher power to transmit it to a distant receiver. Due to a typical nonlinear behavior of the PA at high power transmission, a digital…

Information Theory · Computer Science 2023-09-12 Ganesh Prasad , Håkan Johansson , Rabul Hussain Laskar

Power line communication (PLC) provides intelligent electrical functions such as power quality measurement, fault surveys, and remote control of electrical network. However, most of research works have been done in low voltage (LV) scenario…

Information Theory · Computer Science 2018-08-29 Mengyuan Cheng , Kai Wan , Fan Wei , Fuyong Zheng , Yongpeng Wu

This paper proposes a novel parallel coding transmission strategy and an iterative detection and decoding receiver signal processing technique for orthogonal delay-Doppler division multiplexing (ODDM) modulation. Specifically, the proposed…

Information Theory · Computer Science 2025-02-04 Qi Li , Jinhong Yuan , Min Qiu

The space limitation and the channel acquisition prevent Massive MIMO from being easily deployed in a practical setup. Motivated by current deployments of LTE-Advanced, the use of multi-polarized antennas can be an efficient solution to…

Information Theory · Computer Science 2015-01-13 Jaehyun Park , Bruno Clerckx