English
Related papers

Related papers: Coded Adaptive Linear Precoded Discrete Multitone …

200 papers

Network-distributed optimization has attracted significant attention in recent years due to its ever-increasing applications. However, the classic decentralized gradient descent (DGD) algorithm is communication-inefficient for large-scale…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-09 Xin Zhang , Jia Liu , Zhengyuan Zhu , Elizabeth S. Bentley

This paper presents low-complexity block-based encoding and decoding algorithms for short block length channels. In terms of the precise use-case, we are primarily concerned with the baseline 3GPP Short block transmissions in which payloads…

Information Theory · Computer Science 2025-02-11 Mody Sy , Raymond Knopp

In this paper, we design a deep learning-based convolutional autoencoder for channel coding and modulation. The objective is to develop an adaptive scheme capable of operating at various signal-to-noise ratios (SNR)s without the need for…

Signal Processing · Electrical Eng. & Systems 2025-07-01 Ahmad Abdel-Qader , Anas Chaaban , Mohamed S. Shehata

Recent works have shown promising results of prompt tuning in stimulating pre-trained language models (PLMs) for natural language processing (NLP) tasks. However, to the best of our knowledge, existing works focus on prompt-tuning…

Computation and Language · Computer Science 2022-05-24 Yuan Yao , Bowen Dong , Ao Zhang , Zhengyan Zhang , Ruobing Xie , Zhiyuan Liu , Leyu Lin , Maosong Sun , Jianyong Wang

Diffusion language models (DLMs) have emerged as a promising alternative to autoregressive language generation due to their potential for parallel decoding and global refinement of the entire sequence. To unlock this potential, DLM…

Machine Learning · Computer Science 2026-04-20 Xiang Xia , Wuyang Zhang , Jiazheng Liu , Cheng Yan , Yanyong Zhang

The increasing deployment of powerful Multimodal Large Language Models (MLLMs), typically hosted on cloud platforms, urgently requires effective compression techniques to efficiently transmit signal inputs (e.g., images, videos) from edge…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Jinming Liu , Zhaoyang Jia , Jiahao Li , Bin Li , Xin Jin , Wenjun Zeng , Yan Lu

How can we effectively handle queries for on-device large language models (LLMs) with varying runtime constraints, such as latency and accuracy? Multi-scale quantization addresses this challenge by enabling memory-efficient runtime model…

Machine Learning · Computer Science 2025-12-09 Sangwoo Kwon , Seong Hoon Seo , Jae W. Lee , Yeonhong Park

Designing motion control and planning algorithms for multilift systems remains challenging due to the complexities of dynamics, collision avoidance, actuator limits, and scalability. Existing methods that use optimization and distributed…

Robotics · Computer Science 2024-10-08 Bingheng Wang , Rui Huang , Lin Zhao

Massive multiple-input multiple-output (MIMO) systems achieve high sum spectral efficiency by offering an order of magnitude increase in multiplexing gains. In time division duplexing systems, however, the reuse of uplink training pilots…

Information Theory · Computer Science 2016-10-14 Ahmed Alkhateeb , Geert Leus , Robert W. Heath

Continual Pre-Training (CPT) on Large Language Models (LLMs) has been widely used to expand the model's fundamental understanding of specific downstream domains (e.g., math and code). For the CPT on domain-specific LLMs, one important…

Computation and Language · Computer Science 2024-06-04 Haoran Que , Jiaheng Liu , Ge Zhang , Chenchen Zhang , Xingwei Qu , Yinghao Ma , Feiyu Duan , Zhiqi Bai , Jiakai Wang , Yuanxing Zhang , Xu Tan , Jie Fu , Wenbo Su , Jiamang Wang , Lin Qu , Bo Zheng

This paper proposes and evaluates a novel architecture for a low-power Time-to-Digital Converter with high resolution, optimized for both integration in multichannel chips and high rate operation (40 Mconversion/s/channel). This converter…

Signal Processing · Electrical Eng. & Systems 2023-06-02 Florent Bouyjou

Linear Programming (LP) is an important decoding technique for binary linear codes. However, the advantages of LP decoding, such as low error floor and strong theoretical guarantee, etc., come at the cost of high computational complexity…

Signal Processing · Electrical Eng. & Systems 2020-06-16 Yi Wei , Ming-Min Zhao , Min-Jian Zhao , Ming Lei

Large language models (LLMs) have achieved remarkable success, yet aligning their generations with human preferences remains a critical challenge. Existing approaches to preference modeling often rely on an explicit or implicit reward…

Computation and Language · Computer Science 2025-05-09 Zhuocheng Gong , Jian Guan , Wei Wu , Huishuai Zhang , Dongyan Zhao

We develop a new approach for asymmetric LDPC-based information reconciliation in order to adapt to the current channel state and achieve better performance and scalability in practical resource-constrained QKD systems. The new scheme…

Quantum Physics · Physics 2023-02-13 Nikolay Borisov , Ivan Petrov , Andrey Tayduganov

Since the data volume of LiDAR point clouds is very huge, efficient compression is necessary to reduce their storage and transmission costs. However, existing learning-based compression methods do not exploit the inherent angular resolution…

Image and Video Processing · Electrical Eng. & Systems 2025-05-27 Chang Sun , Hui Yuan , Shiqi Jiang , Da Ai , Wei Zhang , Raouf Hamzaoui

Manifold learning-based encoders have been playing important roles in nonlinear dimensionality reduction (NLDR) for data exploration. However, existing methods can often fail to preserve geometric, topological and/or distributional…

Machine Learning · Computer Science 2021-05-04 Stan Z. Li , Zelin Zang , Lirong Wu

Over discrete memoryless channels (DMC), linear decoders (maximizing additive metrics) afford several nice properties. In particular, if suitable encoders are employed, the use of decoding algorithm with manageable complexities is…

Information Theory · Computer Science 2008-10-01 Emmanuel Abbe , Lizhong Zheng

Transformer architectures are the backbone of the modern AI revolution. However, they are based on simply stacking the same blocks in dozens of layers and processing information sequentially from one block to another. In this paper, we…

Computation and Language · Computer Science 2024-12-24 Prateek Verma , Mert Pilanci

We analyze two-user single-antenna fading interference channels with perfect receive channel state information (CSI) and no transmit CSI. We compute the diversity-multiplexing tradeoff (DMT) region of a fixed-power-split Han and Kobayashi…

Information Theory · Computer Science 2009-05-07 Cemal Akcaba , Helmut Boelcskei

Decentralized stochastic optimization has emerged as a fundamental paradigm for large-scale machine learning. However, practical implementations often rely on biased gradient estimators arising from communication compression or inexact…

Optimization and Control · Mathematics 2026-04-10 Qing Xu , Yiwei Liao , Wenqi Fan , Xingxing You , Songyi Dian