English
Related papers

Related papers: DALC: Distributed Arithmetic Coding Aided by Linea…

200 papers

Reliability is an important requirement for both communication and storage systems. Due to continuous scale down of technology multiple adjacent bits error probability increases. The data may be corrupted due soft errors. Error correction…

Hardware Architecture · Computer Science 2020-02-19 Sayan Tripathi , Jhilam Jana , Jaydeb Bhaumik

Predictive coding (PC) is a biologically inspired algorithm for training neural networks that relies only on local updates, allowing parallel learning across layers. However, practical implementations face two key limitations: error signals…

Machine Learning · Computer Science 2026-03-10 Davide Casnici , Martin Lefebvre , Justin Dauwels , Charlotte Frenkel

Coded distributed computing (CDC) is a new technique proposed with the purpose of decreasing the intense data exchange required for parallelizing distributed computing systems. Under the famous MapReduce paradigm, this coded approach has…

Information Theory · Computer Science 2022-06-28 Federico Brunero , Petros Elia

Consider a distributed coding for computing problem with constant decoding locality, i.e., with a vanishing error probability, any single sample of the function can be approximately recovered by probing only constant number of compressed…

Information Theory · Computer Science 2024-03-01 Deheng Yuan , Tao Guo , Zhongyi Huang , Shi Jin

In this paper, we propose a linear representation of BCJR maximum a posteriori probability (MAP) decoding of a rate 1/2 convolutional code (CC), referred to as the linear MAP decoding (LMAP). We discover that the MAP forward and backward…

Information Theory · Computer Science 2025-04-22 Yonghui Li , Chentao Yue , Branka Vucetic

The design of optimal linear block codes capable of being efficiently decoded is of major concern, especially for short block lengths. As near capacity-approaching codes, Low-Density Parity-Check (LDPC) codes possess several advantages over…

Information Theory · Computer Science 2024-10-11 Yoni Choukroun , Lior Wolf

Distributed source coding (DSC) is the task of encoding an input in the absence of correlated side information that is only available to the decoder. Remarkably, Slepian and Wolf showed in 1973 that an encoder without access to the side…

Information Theory · Computer Science 2024-07-02 Jay Whang , Alliot Nagle , Anish Acharya , Hyeji Kim , Alexandros G. Dimakis

In streaming applications, doping improves the performance of spatially-coupled low-density parity-check (SC-LDPC) codes by creating reduced-degree check nodes in the coupled chain. We formulate a scaling law to predict the bit and block…

Information Theory · Computer Science 2021-04-23 Roman Sokolovskii , Alexandre Graell i Amat , Fredrik Brännström

This paper proposes a novel Coordinate-Descent Augmented-Lagrangian (CDAL) solver for linear, possibly parameter-varying, model predictive control (MPC) problems. At each iteration, an augmented Lagrangian (AL) subproblem is solved by…

Optimization and Control · Mathematics 2022-09-28 Liang Wu , Alberto Bemporad

Large language models (LLMs) have demonstrated strong reasoning capabilities through step-by-step chain-of-thought (CoT) reasoning. Nevertheless, at the limits of model capability, CoT often proves insufficient, and its strictly sequential…

Computation and Language · Computer Science 2026-02-03 Xiao Liang , Zhong-Zhi Li , Zhenghao Lin , Eric Hancheng Jiang , Hengyuan Zhang , Yelong Shen , Kai-Wei Chang , Ying Nian Wu , Yeyun Gong , Weizhu Chen

Recently, a novel variation of polar codes known as polarization-adjusted convolutional (PAC) codes has been introduced by Ar{\i}kan. These codes significantly outperform conventional polar and convolutional codes, particularly for short…

Information Theory · Computer Science 2025-08-15 Mohsen Moradi , Hessam Mahdavifar

In the Shannon lecture at the 2019 International Symposium on Information Theory (ISIT), Ar{\i}kan proposed to employ a one-to-one convolutional transform as a pre-coding step before the polar transform. The resulting codes of this…

Information Theory · Computer Science 2024-01-19 Mohammad Rowshan , Andreas Burg , Emanuele Viterbo

Artificial intelligence (AI) provides an alternative way to design channel coding with affordable complexity. However, most existing studies can only learn codes for a given size and rate, typically defined by a fixed network architecture…

Signal Processing · Electrical Eng. & Systems 2024-11-28 Yukun Cheng , Wei Chen , Tianwei Hou , Geoffrey Ye Li , Bo Ai

We present a hardware-based implementation of Linear Program (LP) decoding for binary linear codes. LP decoding frames error-correction as an optimization problem. In contrast, variants of Belief Propagation (BP) decoding frame…

Information Theory · Computer Science 2016-11-21 Mitchell Wasson , Mario Milicevic , Stark C. Draper , Glenn Gulak

Distributed computing is known as an emerging and efficient technique to support various intelligent services, such as large-scale machine learning. However, privacy leakage and random delays from straggling servers pose significant…

Information Theory · Computer Science 2023-10-31 Qicheng Zeng , Zhaojun Nan , Sheng Zhou

Data encoding is a fundamental step in emerging computing paradigms, particularly in stochastic computing (SC) and hyperdimensional computing (HDC), where it plays a crucial role in determining the overall system performance and hardware…

Emerging Technologies · Computer Science 2025-01-07 Mehran Shoushtari Moghadam , Sercan Aygun , M. Hassan Najafi

This paper explores the use of Answer Set Programming (ASP) in solving Distributed Constraint Optimization Problems (DCOPs). The paper provides the following novel contributions: (1) It shows how one can formulate DCOPs as logic programs;…

Multiagent Systems · Computer Science 2017-05-12 Tiep Le , Tran Cao Son , Enrico Pontelli , William Yeoh

In this work, we consider a distributed source coding problem with a joint distortion criterion depending on the sources and the reconstruction. This includes as a special case the problem of computing a function of the sources to within…

Information Theory · Computer Science 2008-08-21 Dinesh Krithivasan , S. Sandeep Pradhan

This article proposes a novel iterative algorithm based on Low Density Parity Check (LDPC) codes for compression of correlated sources at rates approaching the Slepian-Wolf bound. The setup considered in the article looks at the problem of…

Information Theory · Computer Science 2007-10-31 F. Daneshgaran , Massimiliano Laddomada , M. Mondin

In distributed multilevel diversity coding, $K$ correlated sources (each with $K$ components) are encoded in a distributed manner such that, given the outputs from any $\alpha$ encoders, the decoder can reconstruct the first $\alpha$…

Information Theory · Computer Science 2015-05-04 Zhiqing Xiao , Jun Chen , Yunzhou Li , Jing Wang