English
Related papers

Related papers: Probabilistic Design of Multi-Dimensional Spatiall…

200 papers

Designing good error correcting codes whose generator matrix has a support constraint, i.e., one for which only certain entries of the generator matrix are allowed to be non-zero, has found many recent applications, including in distributed…

Information Theory · Computer Science 2018-01-25 Hikmet Yildiz , Babak Hassibi

The design of optimal linear block codes capable of being efficiently decoded is of major concern, especially for short block lengths. As near capacity-approaching codes, Low-Density Parity-Check (LDPC) codes possess several advantages over…

Information Theory · Computer Science 2024-10-11 Yoni Choukroun , Lior Wolf

Low-density parity-check (LDPC) codes with the parity-based approach for distributed joint source channel coding (DJSCC) with decoder side information is described in this paper. The parity-based approach is theoretical limit achievable.…

Information Theory · Computer Science 2014-04-10 Feng Cen

In this paper, we study a new class of high-rate spatially coupled LDPC (SC-LDPC) codes based on the convolutional self-orthogonal codes (CSOCs) first introduced by Massey. The SC-LDPC codes are constructed by treating the irregular graph…

Information Theory · Computer Science 2025-02-18 Daniel J. Costello, , Min Zhu , David G. M. Mitchell , Michael Lentmaier

We study linear codes that maximize minimum distance subject to arbitrary support constraints on the parity-check matrix. Such constraints arise naturally in the design of LDPC codes, locally repairable codes, and hardware-constrained…

Information Theory · Computer Science 2026-05-12 Barron Han , Hikmet Yildiz , Babak Hassibi

We propose a systematic design of protograph-based quasi-cyclic (QC) low-density parity-check (LDPC) codes with low error floor. We first characterize the trapping sets of such codes and demonstrate that the QC structure of the code…

Information Theory · Computer Science 2019-06-18 Bashirreza Karimi , Amir. H Banihashemi

Constellation shaping is an energy-efficient strategy involving the transmission of lower-energy signals more frequently than higher-energy signals. Previous work has shown that shaping is particularly effective when used with coded…

Information Theory · Computer Science 2012-10-18 Xingyu Xiang , Matthew C. Valenti

This paper considers the problem of implementing large-scale gradient descent algorithms in a distributed computing setting in the presence of {\em straggling} processors. To mitigate the effect of the stragglers, it has been previously…

Machine Learning · Statistics 2019-01-04 Raj Kumar Maity , Ankit Singh Rawat , Arya Mazumdar

Reliability is an important requirement for both communication and storage systems. Due to continuous scale down of technology multiple adjacent bits error probability increases. The data may be corrupted due soft errors. Error correction…

Hardware Architecture · Computer Science 2020-02-19 Sayan Tripathi , Jhilam Jana , Jaydeb Bhaumik

We present and analyze a stochastic distributed method (S-NEAR-DGD) that can tolerate inexact computation and inaccurate information exchange to alleviate the problems of costly gradient evaluations and bandwidth-limited communication in…

Optimization and Control · Mathematics 2021-02-02 Charikleia Iakovidou , Ermin Wei

This paper presents a new supervised representation learning framework, namely structured probabilistic coding (SPC), to learn compact and informative representations from input related to the target task. SPC is an encoder-only…

Computation and Language · Computer Science 2024-05-03 Dou Hu , Lingwei Wei , Yaxin Liu , Wei Zhou , Songlin Hu

Sparse superimposed coding (SSC) has emerged as a promising technique for short-packet transmission in ultra-reliable low-latency communication scenarios. However, conventional SSC schemes often suffer from high encoding and decoding…

Signal Processing · Electrical Eng. & Systems 2026-01-23 Yanfeng Zhang , Xi'an Fan , Xu Zhu , Jinkai Zheng , Hui Liang , Weiwei Yang , Tom H. Luan

In this dissertation we propose alternative analysis of distributed stochastic gradient descent (SGD) algorithms that rely on spectral properties of the data covariance. As a consequence we can relate questions pertaining to speedups and…

Optimization and Control · Mathematics 2016-09-03 Avleen S. Bijral

The Chance-Constrained Parallel Machine Scheduling Problem (CC-PMSP) assigns jobs with uncertain processing times to machines, ensuring that each machine's availability constraints are met with a certain probability. We present a…

Optimization and Control · Mathematics 2025-04-30 Nicolás Casassus , Margarita Castro , Gustavo Angulo

Symbol-pair codes are block codes with symbol-pair metrics designed to protect against pair-errors that may occur in high-density data storage systems. MDS symbol-pair codes are optimal in the sense that it can attain the highest pair-error…

Information Theory · Computer Science 2021-11-29 Xilin Tang , Weixian Li , Wei Zhao

Coded distributed computing (CDC) was introduced to greatly reduce the communication load for MapReduce computing systems. Such a system has $K$ nodes, $N$ input files, and $Q$ Reduce functions. Each input file is mapped by $r$ nodes and…

Information Theory · Computer Science 2023-07-11 Yingjie Cheng , Gaojun Luo , Xiwang Cao , Martianus Frederic Ezerman , San Ling

Scalable spatial GPs for massive datasets can be built via sparse Directed Acyclic Graphs (DAGs) where a small number of directed edges is sufficient to flexibly characterize spatial dependence. The DAG can be used to devise fast algorithms…

Methodology · Statistics 2025-03-31 Michele Peruzzi , Sudipto Banerjee , David B. Dunson , Andrew O. Finley

Maximum distance separable (MDS) codes are optimal where the minimum distance cannot be improved for a given length and code size. Twisted Reed-Solomon codes over finite fields were introduced in 2017, which are generalization of…

Information Theory · Computer Science 2020-08-11 Hongwei Liu , Shengwei Liu

This paper analyzes general spatially-coupled (SC) systems with multi-dimensional coupling. A continuum approximation is used to derive potential functions that characterize the performance of the SC systems. For any dimension of coupling,…

Information Theory · Computer Science 2013-04-19 Keigo Takeuchi , Toshiyuki Tanaka , Kenta Kasai

Distributed Orthogonal Space-Time Block Codes (DOSTBCs) achieving full diversity order and single-symbol ML decodability have been introduced recently by Yi and Kim for cooperative networks and an upperbound on the maximal rate of such…

Information Theory · Computer Science 2007-09-04 Harshan J. , B. Sundar Rajan