English
Related papers

Related papers: LightCode: Light Analytical and Neural Codes for C…

200 papers

The protograph low-density parity-check (LDPC) codes possess many attractive properties, such as the low encoding/decoding complexity and better error floor performance, and hence have been successfully applied to different types of…

Information Theory · Computer Science 2019-05-01 Xingwei Zhong , Kui Cai , Pingping Chen , Zhen Mei

Discrete representation has emerged as a powerful tool in task-oriented semantic communication (ToSC), offering compact, interpretable, and efficient representations well-suited for low-power edge intelligence scenarios. Its inherent…

Signal Processing · Electrical Eng. & Systems 2025-08-07 Anbang Zhang , Shuaishuai Guo , Chenyuan Feng , Hongyang Du , Haojin Li , Chen Sun , Haijun Zhang

The safety of large language models (LLMs) has increasingly emerged as a fundamental aspect of their development. Existing safety alignment for LLMs is predominantly achieved through post-training methods, which are computationally…

Artificial Intelligence · Computer Science 2026-02-03 Sicheng Shen , Mingyang Lv , Han Shen , Jialin Wu , Binghao Wang , Zhou Yang , Guobin Shen , Dongcheng Zhao , Feifei Zhao , Yi Zeng

Large language models (LLMs) have recently demonstrated a remarkable ability to generate code from natural language (NL) prompts. However, in the real world, NL is often too ambiguous to capture the true intent behind programming problems,…

Machine Learning · Computer Science 2024-03-18 Yeming Wen , Pengcheng Yin , Kensen Shi , Henryk Michalewski , Swarat Chaudhuri , Alex Polozov

We introduce Noise Recycling, a method that enhances decoding performance of channels subject to correlated noise without joint decoding. The method can be used with any combination of codes, code-rates and decoding techniques. In the…

Information Theory · Computer Science 2020-10-16 Alejandro Cohen , Amit Solomon , Ken R. Duffy , Muriel Médard

While Separate Source-Channel Coding (SSCC) retains the practical benefits of modular system design, its effectiveness in noisy text transmission is fundamentally constrained by the fragility of autoregressive source decoding. In low-SNR…

Information Theory · Computer Science 2026-05-08 Ziqiong Wang , Rongpeng Li

Most existing Low-light Image Enhancement (LLIE) methods either directly map Low-Light (LL) to Normal-Light (NL) images or use semantic or illumination maps as guides. However, the ill-posed nature of LLIE and the difficulty of semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Han Zhou , Wei Dong , Xiaohong Liu , Shuaicheng Liu , Xiongkuo Min , Guangtao Zhai , Jun Chen

A new achievable rate region is given for the Gaussian cognitive many-to-one interference channel. The proposed novel coding scheme is based on the compute-and-forward approach with lattice codes. Using the idea of decoding sums of…

Information Theory · Computer Science 2016-11-18 Jingge Zhu , Michael Gastpar

Predicting program behavior and reasoning about code execution remain significant challenges in software engineering, particularly for large language models (LLMs) designed for code analysis. While these models excel at understanding static…

Software Engineering · Computer Science 2025-02-11 Cuong Chi Le , Hoang-Chau Truong-Vinh , Huy Nhat Phan , Dung Duy Le , Tien N. Nguyen , Nghi D. Q. Bui

In bandwidth-constrained communication such as satellite and underwater channels, speech must often be transmitted at ultra-low bitrates where intelligibility is the primary objective. At such extreme compression levels, codecs trained with…

Sound · Computer Science 2026-04-21 Junyi Wang , Chi Zhang , Jing Qian , Haifeng Luo , Hao Wang , Zengrui Jin , Chao Zhang

Data-driven deep learning based code designs, including low-complexity neural decoders for existing codes, or end-to-end trainable auto-encoders have exhibited impressive results, particularly in scenarios for which we do not have…

Information Theory · Computer Science 2023-06-02 Emre Ozfatura , Chenghong Bian , Deniz Gunduz

This paper investigates the construction of linear network codes for broadcasting a set of data packets to a number of users. The links from the source to the users are modeled as independent erasure channels. Users are allowed to inform…

Information Theory · Computer Science 2013-12-10 Chi Wan Sung , Linyu Huang , Ho Yuet Kwan , Kenneth W. Shum

Reliable communication over noisy channels requires the design of specialized error-correcting codes (ECCs) tailored to specific system requirements. Recently, neural network-based decoders have emerged as promising tools for enhancing ECC…

Information Theory · Computer Science 2025-12-01 Anastasiia Kurmukova , Selim F. Yilmaz , Emre Ozfatura , Deniz Gunduz

High quality data is essential in deep learning to train a robust model. While in other fields data is sparse and costly to collect, in error decoding it is free to query and label thus allowing potential data exploitation. Utilizing this…

Information Theory · Computer Science 2019-11-22 Ishay Be'ery , Nir Raviv , Tomer Raviv , Yair Be'ery

Deep Neural Networks (DNNs) have become the de-facto standard in computer vision, as well as in many other pattern recognition tasks. A key drawback of DNNs is that the training phase can be very computationally expensive. Organizations or…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Debesh Jha , Anis Yazidi , Michael A. Riegler , Dag Johansen , Håvard D. Johansen , Pål Halvorsen

Learning effective netlist representations is fundamentally constrained by the scarcity of labeled datasets, as real designs are protected by Intellectual Property (IP) and costly to annotate. Existing work therefore focuses on small-scale…

Machine Learning · Computer Science 2026-03-11 Siyang Cai , Cangyuan Li , Yinhe Han , Ying Wang

Deep learning has largely improved the performance of various natural language processing (NLP) tasks. However, most deep learning models are black-box machinery, and lack explicit interpretation. In this chapter, we will introduce our…

Computation and Language · Computer Science 2023-09-26 Xianggen Liu , Zhengdong Lu , Lili Mou

Error correction codes are a crucial part of the physical communication layer, ensuring the reliable transfer of data over noisy channels. The design of optimal linear block codes capable of being efficiently decoded is of major concern,…

Information Theory · Computer Science 2024-05-08 Yoni Choukroun , Lior Wolf

Deep neural network (DNN)-assisted channel coding designs, such as low-complexity neural decoders for existing codes, or end-to-end neural-network-based auto-encoder designs are gaining interest recently due to their improved performance…

Information Theory · Computer Science 2022-11-04 Emre Ozfatura , Yulin Shao , Amin Ghazanfari , Alberto Perotti , Branislav Popovic , Deniz Gunduz

Machine learning algorithms are typically run on large scale, distributed compute infrastructure that routinely face a number of unavailabilities such as failures and temporary slowdowns. Adding redundant computations using coding-theoretic…

Machine Learning · Computer Science 2018-06-05 Jack Kosaian , K. V. Rashmi , Shivaram Venkataraman