English
Related papers

Related papers: On the Encoding Process in Decentralized Systems

200 papers

We consider the problem of computing a binary linear transformation using unreliable components when all circuit components are unreliable. Two noise models of unreliable components are considered: probabilistic errors and permanent errors.…

Information Theory · Computer Science 2017-05-16 Yaoqing Yang , Pulkit Grover , Soummya Kar

Distributed multi-task learning (DMTL) effectively improves model generalization performance through the collaborative training of multiple related models. However, in large-scale learning scenarios, communication bottlenecks severely limit…

Information Theory · Computer Science 2025-07-25 Minquan Cheng , Yongkang Wang , Lingyu Zhang , Youlong Wu

This paper examines the theory pertaining to lossless compression of correlated sources located at the edge of a network. Importantly, communication between nodes is prohibited. In particular, a method that combines correlated source coding…

Information Theory · Computer Science 2020-03-25 Benjamin Rosen , Shane House , Shamin Achari , Ling Cheng

We study the following semi-deterministic setting of the joint source-channel coding problem: a deterministic source sequence (a.k.a. individual sequence) is transmitted via a memoryless channel, using delay-limited encoder and decoder,…

Information Theory · Computer Science 2021-09-29 Neri Merhav

We consider a communication system in which the outputs of a Markov source are encoded and decoded in \emph{real-time} by a finite memory receiver, and the distortion measure does not tolerate delays. The objective is to choose designs,…

Information Theory · Computer Science 2007-07-13 Aditya Mahajan , Demosthenis Teneketzis

We present a new lossy compressor for discrete sources. For coding a source sequence $x^n$, the encoder starts by assigning a certain cost to each reconstruction sequence. It then finds the reconstruction that minimizes this cost and…

Information Theory · Computer Science 2009-01-19 Shirin Jalali , Andrea Montanari , Tsachy Weissman

We examine an error-correcting coding framework in which each coded symbol is constrained to be a function of a fixed subset of the message symbols. With an eye toward distributed storage applications, we seek to design systematic codes…

Information Theory · Computer Science 2015-02-23 Wael Halbawi , Matthew Thill , Babak Hassibi

Linear regression is a fundamental and primitive problem in supervised machine learning, with applications ranging from epidemiology to finance. In this work, we propose methods for speeding up distributed linear regression. We do so by…

Information Theory · Computer Science 2024-04-02 Neophytos Charalambides , Hessam Mahdavifar , Mert Pilanci , Alfred O. Hero

In this paper we consider a Metzner-Kapturowski-like decoding algorithm for high-order interleaved sum-rank-metric codes, offering a novel perspective on the decoding process through the concept of an error code. The error code, defined as…

Information Theory · Computer Science 2024-09-30 Thomas Jerkovits , Felicitas Hörmann , Hannes Bartz

This paper investigates the construction of linear network codes for broadcasting a set of data packets to a number of users. The links from the source to the users are modeled as independent erasure channels. Users are allowed to inform…

Information Theory · Computer Science 2013-12-10 Chi Wan Sung , Linyu Huang , Ho Yuet Kwan , Kenneth W. Shum

One of the main weakness of the family of centralizer codes is that its length is always $n^2$. Thus we have taken a new matrix equation code called intertwining code. Specialty of this code is the length of it, which is of the form $nk$.…

Information Theory · Computer Science 2018-01-09 Shyambhu Mukherjee , Joydeb Pal , Satya Bagchi

A real-time communication system with two encoders communicating with a single receiver over separate noisy channels is considered. The two encoders make distinct partial observations of a Markov source. Each encoder must encode its…

Information Theory · Computer Science 2009-10-27 Ashutosh Nayyar , Demosthenis Teneketzis

Characterization of the delay profile of systems employing random linear network coding is important for the reliable provision of broadcast services. Previous studies focused on network coding over large finite fields or developed Markov…

Information Theory · Computer Science 2022-03-08 Ioannis Chatzigeorgiou , Andrea Tassi

We devise achievable encoding schemes for distributed source compression for computing inner products, symmetric matrix products, and more generally, square matrix products, which are a class of nonlinear transformations. To that end, our…

Information Theory · Computer Science 2024-05-21 Derya Malak

Quantum error correction, which utilizes logical qubits that are encoded as redundant multiple physical qubits to find and correct errors in physical qubits, is indispensable for practical quantum computing. Surface code is considered to be…

Machine Learning · Computer Science 2025-09-15 Hoshitaro Ohnishi , Hideo Mukai

In this paper, we study the data gathering problem in the context of power grids by using a network of sensors, where the sensed data have inter-node redundancy. Specifically, we propose a new transmission method, calledquantized network…

Information Theory · Computer Science 2012-10-29 Mahdy Nabaee , Fabrice Labeau

Consider two remote nodes (encoder and decoder), each with a binary sequence. The encoder's sequence $X$ differs from the decoder's sequence $Y$ by a small number of edits (deletions and insertions). The goal is to construct a message $M$,…

Information Theory · Computer Science 2020-10-28 Mahed Abroshan , Ramji Venkataramanan , Albert Guillen i Fabregas

A recently developed theory for eliminating decoherence and design constraints in quantum computers, ``encoded recoupling and decoupling'', is shown to be fully compatible with a promising proposal for an architecture enabling scalable…

Quantum Physics · Physics 2016-09-08 D. A. Lidar , L. -A Wu

In this paper we consider an interacting two-agent sequential decision-making problem consisting of a Markov source process, a causal encoder with feedback, and a causal decoder. Motivated by a desire to foster links between control and…

Information Theory · Computer Science 2015-03-18 Siva Gorantla , Todd Coleman

We propose and evaluate a novel procedure for training multiple Transformers with tied parameters which compresses multiple models into one enabling the dynamic choice of the number of encoder and decoder layers during decoding. In…

Computation and Language · Computer Science 2020-02-21 Raj Dabre , Raphael Rubino , Atsushi Fujita