English
Related papers

Related papers: Enabling Fine-Grain Restricted Coset Coding Throug…

200 papers

In this letter, we propose a two-stage design method to construct memory efficient mutual information-maximizing quantized min-sum (MIM-QMS) decoder for rate-compatible low-density parity-check (LDPC) codes. We first develop a modified…

Information Theory · Computer Science 2022-01-19 Peng Kang , Kui Cai , Xuan He , Jinhong Yuan

Large language model (LLM) decoding is a major inference bottleneck because its low arithmetic intensity makes performance highly sensitive to memory bandwidth. 3D-stacked near-memory processing (NMP) provides substantially higher local…

Hardware Architecture · Computer Science 2026-04-10 Chenyang Ai , Yixing Zhang , Haoran Wu , Yudong Pan , Lechuan Zhao , Wenhui OU

Quantum-accurate computer simulations play a central role in understanding phase-change materials (PCMs) for advanced memory technologies. However, direct quantum-mechanical simulations are necessarily limited to simplified models,…

Materials Science · Physics 2022-09-20 Yuxing Zhou , Wei Zhang , En Ma , Volker L. Deringer

The rapid scaling of language models (LMs) has resulted in unprecedented computational, memory, and energy requirements, making their training and deployment increasingly unsustainable. Quantization has emerged as an essential compression…

Large Language Models (LLMs) have demonstrated exceptional capabilities across diverse natural language processing benchmarks. However, the escalating scale of model parameters imposes prohibitive memory overheads during training,…

Machine Learning · Computer Science 2026-04-28 Ziqing Wen , Ping Luo , Jiahuan Wang , Kun Yuan , Dongsheng Li , Tao Sun

Visible light communication (VLC) could provide short-range optical wireless communication together with illumination using LED lighting. However, conventional forward error correction (FEC) codes for reliable communication do not have the…

Information Theory · Computer Science 2018-10-18 Junbin Fang , Zhen Che , Xiaolong Yu , Zhe Chen , Zoe L. Jiang , Siu-Ming Yiu , Kui Ren , Xiaoqing Tan

This paper presents a novel algorithm that aims at minimizing the required decoding energy by exploiting a general energy model for HEVC-decoder solutions. We incorporate the energy model into the HEVC encoder such that it is capable of…

Image and Video Processing · Electrical Eng. & Systems 2022-03-04 Christian Herglotz , André Kaup

We show in this work that reinforcement learning can be successfully applied to decoding short to moderate length sparse graph-based channel codes. Specifically, we focus on low-density parity check (LDPC) codes, which for example have been…

Information Theory · Computer Science 2020-10-20 Salman Habib , Allison Beemer , Joerg Kliewer

Large Language Models (LLMs) are becoming increasingly data-intensive due to growing model sizes, and they are becoming memory-bound as the context length and, consequently, the key-value (KV) cache size increase. Inference, particularly…

Hardware Architecture · Computer Science 2025-11-18 Khyati Kiyawat , Zhenxing Fan , Yasas Seneviratne , Morteza Baradaran , Akhil Shekar , Zihan Xia , Mingu Kang , Kevin Skadron

Large Language Models (LLMs) have achieved remarkable progress across reasoning, generation, and decision-making tasks, yet deploying them on mobile, embedded, and edge devices remains particularly challenging. On-device LLM inference is…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Sayed Pedram Haeri Boroujeni , Niloufar Mehrabi , Patrick Woods , Gabriel Hillesheim , Abolfazl Razi

Large Language Models (LLMs) have demonstrated exceptional versatility across domains, including applications to electrocardiograms (ECGs). A growing body of work focuses on generating text from multi-channeled ECG signals and corresponding…

Computation and Language · Computer Science 2025-07-31 William Han , Chaojing Duan , Michael A. Rosenberg , Emerson Liu , Ding Zhao

This paper presents novel techniques for improving the error correction performance and reducing the complexity of coarsely quantized 5G-LDPC decoders. The proposed decoder design supports arbitrary message-passing schedules on a…

Information Theory · Computer Science 2025-08-19 Philipp Mohr , Gerhard Bauch

Fine-tuning is a crucial process for adapting large language models (LLMs) to diverse applications. In certain scenarios, such as multi-tenant serving, deploying multiple LLMs becomes necessary to meet complex demands. Recent studies…

Computation and Language · Computer Science 2024-11-27 Bowen Ping , Shuo Wang , Hanqing Wang , Xu Han , Yuzhuang Xu , Yukun Yan , Yun Chen , Baobao Chang , Zhiyuan Liu , Maosong Sun

Voltage underscaling below the nominal level is an effective solution for improving energy efficiency in digital circuits, e.g., Field Programmable Gate Arrays (FPGAs). However, further undervolting below a safe voltage level and without…

Hardware Architecture · Computer Science 2019-04-01 Behzad Salami , Osman S. Unsal , Adrian Cristal Kestelman

Recently, large language models (LLMs) have achieved huge success in the natural language processing (NLP) field, driving a growing demand to extend their deployment from the cloud to edge devices. However, deploying LLMs on…

Hardware Architecture · Computer Science 2025-05-08 Yanbiao Liang , Huihong Shi , Haikuo Shao , Zhongfeng Wang

Language Reasoning Models (LRMs) achieve strong performance by scaling test-time computation but often suffer from ``overthinking'', producing excessively long reasoning traces that increase latency and memory usage. Existing LRMs typically…

Consider an energy-harvesting receiver that uses the same received signal both for decoding information and for harvesting energy, which is employed to power its circuitry. In the scenario where the receiver has limited battery size, a…

Information Theory · Computer Science 2015-06-02 Anshoo Tandon , Mehul Motani , Lav R. Varshney

Standard cells are essential components of modern digital circuit designs. With process technologies advancing toward 2nm, more routability issues have arisen due to the decreasing number of routing tracks, increasing number and complexity…

Hardware Architecture · Computer Science 2024-06-12 Chia-Tung Ho , Haoxing Ren

Compression for machines is an emerging field, where inputs are encoded while optimizing the performance of downstream automated analysis. In scalable coding for humans and machines, the compressed representation used for machines is…

Image and Video Processing · Electrical Eng. & Systems 2023-05-19 Alon Harell , Yalda Foroutan , Ivan V. Bajic

The growing demand for low-latency, energy-efficient inference in large language models (LLMs) has catalyzed interest in heterogeneous architectures. While GPUs remain dominant, they are poorly suited for integration with emerging…

Applied Physics · Physics 2025-09-23 Ryan Tomich , Zhizhen Zhong , Dirk Englund