English
Related papers

Related papers: Training-Embedded, Single-Symbol ML-Decodable, Dis…

200 papers

Currently, progressively larger deep neural networks are trained on ever growing data corpora. As this trend is only going to increase in the future, distributed training schemes are becoming increasingly relevant. A major issue in…

Machine Learning · Computer Science 2018-05-23 Felix Sattler , Simon Wiedemann , Klaus-Robert Müller , Wojciech Samek

We consider the distributed computing problem of multiplying a set of vectors with a matrix. For this scenario, Li et al. recently presented a unified coding framework and showed a fundamental tradeoff between computational delay and…

Information Theory · Computer Science 2017-09-19 Albin Severinson , Alexandre Graell i Amat , Eirik Rosnes

Although Federated Learning has been widely studied in recent years, there are still high overhead expenses in each communication round for large-scale models such as Vision Transformer. To lower the communication complexity, we propose a…

Machine Learning · Computer Science 2026-04-21 Junkang Liu , Fanhua Shang , Yuanyuan Liu , Hongying Liu , Yuangang Li , YunXiang Gong

The convergence speed of machine learning models trained with Federated Learning is significantly affected by heterogeneous data partitions, even more so in a fully decentralized setting without a central server. In this paper, we show that…

Machine Learning · Computer Science 2021-11-05 Aurélien Bellet , Anne-Marie Kermarrec , Erick Lavoie

In this paper, we investigate the joint design of channel and network coding in bi-directional relaying systems and propose a combined low complexity physical network coding and LDPC decoding scheme. For the same LDPC codes employed at both…

Information Theory · Computer Science 2013-02-21 Kui Xu , Zhenxing Lv , Youyun Xu , Dongmei Zhang , Xinyi Zhong , Wenwen Liang

With the increase in the amount of data and the expansion of model scale, distributed parallel training becomes an important and successful technique to address the optimization challenges. Nevertheless, although distributed stochastic…

Machine Learning · Computer Science 2019-09-23 Shuheng Shen , Linli Xu , Jingchang Liu , Xianfeng Liang , Yifei Cheng

In this paper, Space-Time Block Codes (STBCs) with reduced Sphere Decoding Complexity (SDC) are constructed for two-user Multiple-Input Multiple-Output (MIMO) fading multiple access channels. In this set-up, both the users employ identical…

Information Theory · Computer Science 2009-08-11 J. Harshan , B. Sundar Rajan

As a typical example of bandwidth-efficient techniques, bit-interleaved coded modulation with iterative decoding (BICM-ID) provides desirable spectral efficiencies in various wireless communication scenarios. In this paper, we carry out a…

Information Theory · Computer Science 2019-11-07 Zhaojie Yang , Yi Fang , Guohua Zhang , Francis C. M. Lau , Shahid Mumtaz , Daniel B. da Costa

It has been shown recently that the maximum rate of a 2-real-symbol (single-complex-symbol) maximum likelihood (ML) decodable, square space-time block codes (STBCs) with unitary weight matrices is $\frac{2a}{2^a}$ complex symbols per…

Information Theory · Computer Science 2011-05-10 Teja Damodaram Bavirisetti , B. Sundar Rajan

This work considers optimizing LDPC codes in the physical-layer network coded two-way relay channel using noncoherent FSK modulation. The error-rate performance of channel decoding at the relay node during the multiple-access phase was…

Information Theory · Computer Science 2015-02-23 Terry Ferrett , Matthew C. Valenti

Full-rate space-time block codes (STBCs) achieve high spectral-efficiency by transmitting linear combinations of information symbols through every transmit antenna. However, the coefficients used for the linear combinations, if not chosen…

Information Theory · Computer Science 2013-03-18 J. Harshan , Emanuele Viterbo

Spatially-Coupled (SC)-LDPC codes are known to have outstanding error-correction performance and low decoding latency. Whereas previous works on LDPC and SC-LDPC codes mostly take either an asymptotic or a finite-length design approach, in…

Information Theory · Computer Science 2022-09-02 Homa Esfahanizadeh , Eshed Ram , Yuval Cassuto , Lara Dolecek

Deep Joint Source-Channel Coding (Deep-JSCC) has emerged as a promising semantic communication approach for wireless image transmission by jointly optimizing source and channel coding using deep learning techniques. However, traditional…

Networking and Internet Architecture · Computer Science 2025-07-29 Avi Deb Raha , Apurba Adhikary , Mrityunjoy Gain , Yumin Park , Walid Saad , Choong Seon Hong

Compute-and-forward relaying is effective to increase bandwidth efficiency of wireless two-way relay channels. In a compute-and-forward scheme, a relay tries to decode a linear combination composed of transmitted messages from other…

Information Theory · Computer Science 2018-01-22 Satoshi Takabe , Yuta Ishimatsu , Tadashi Wadayama , Masahito Hayashi

Operating reserve requirements in security-constrained economic dispatch (SCED) depend strongly on the assumed correlation structure of renewable forecast errors, yet that structure is usually specified exogenously rather than learned for…

Optimization and Control · Mathematics 2026-04-08 Owen Shen , Hung-po Chao , Haihao Lu , Patrick Jaillet

Federated Learning (FL) is an innovative distributed machine learning paradigm that enables multiple parties to collaboratively train a model without sharing their raw data, thereby preserving data privacy. Communication efficiency concerns…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-03 Peishen Yan , Jun Li , Hao Wang , Tao Song , Yang Hua , Lu Peng , Haihui Zhou , Haibing Guan

In this paper, we give an overview of spatially coupled turbo codes (SC-TCs), the spatial coupling of parallel and serially concatenated convolutional codes, recently introduced by the authors. For presentation purposes, we focus on…

Information Theory · Computer Science 2014-07-03 Alexandre Graell i Amat , Saeedeh Moloudi , Michael Lentmaier

An adaptive randomized distributed space-time coding (DSTC) scheme and algorithms are proposed for two-hop cooperative MIMO networks. Linear minimum mean square error (MMSE) receivers and an amplify-and-forward (AF) cooperation strategy are…

Information Theory · Computer Science 2013-03-19 T. Peng , R. C. de Lamare , A. Schmeink

Recently, Martinez-Penas and Kschischang (IEEE Trans. Inf. Theory, 2019) showed that lifted linearized Reed-Solomon codes are suitable codes for error control in multishot network coding. We show how to construct and decode lifted…

Information Theory · Computer Science 2021-05-28 Hannes Bartz , Sven Puchinger

In this paper, a proposal to improve the reliability of a downlink multiuser (MU) MIMO transmission scheme is investigated with the use of a new approach in orthogonal space-time block codes (OSTBC) and network coding with a superposition…

Information Theory · Computer Science 2020-01-22 Nora Boulaioune , Nandana Rajatheva , Matti Latva-aho