English
Related papers

Related papers: Asymptotically Optimal Coded Distributed Computing…

200 papers

Large-scale distributed training is increasingly becoming communication bound. Many gradient compression algorithms have been proposed to reduce the communication overhead and improve scalability. However, it has been observed that in some…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-30 Zhuang Wang , Xinyu Wu , T. S. Eugene Ng

Coded caching scheme originally proposed by Maddah-Ali and Niesen (MN) achieves an optimal transmission rate $R$ under uncoded placement but requires a subpacketization level $F$ which increases exponentially with the number of users $K$…

Information Theory · Computer Science 2024-02-27 Rashid Ummer N. T. , B. Sundar Rajan

Deep learning based semantic communication (DeepSC) system has emerged as a promising paradigm for efficient wireless transmission. However, existing image DeepSC methods, frequently encounter challenges in balancing rate-distortion…

Image and Video Processing · Electrical Eng. & Systems 2025-12-08 Yinhuan Huang , Zhijin Qin

Content delivery networks store information distributed across multiple servers, so as to balance the load and avoid unrecoverable losses in case of node or disk failures. Coded caching has been shown to be a useful technique which can…

Information Theory · Computer Science 2016-11-22 Tianqiong Luo , Vaneet Aggarwal , Borja Peleato

In this paper, channel optimized distributed multiple description vector quantization (CDMD) schemes are presented for distributed source coding in symmetric and asymmetric settings. The CDMD encoder is designed using a deterministic…

Information Theory · Computer Science 2015-05-20 Mehrdad Valipour , Farshad Lahouti

Distributed optimization concerns the optimization of a common function in a distributed network, which finds a wide range of applications ranging from machine learning to vehicle platooning. Its key operation is to aggregate all local…

Information Theory · Computer Science 2022-04-15 Zhenyi Lin , Yi Gong , Kaibin Huang

In the emerging field of Fault Tolerant Quantum Computation (FTQC), resource estimation is an important tool for quantitatively comparing prospective architectures, identifying hardware bottlenecks and informing which research paths are…

Quantum Physics · Physics 2026-04-24 Dmitry Filippov , Peter Yang , Prakash Murali

Ordered statistics decoding has been instrumental in addressing decoding failures that persist after normalized min-sum decoding in short low-density parity-check codes. Despite its benefits, the high computational complexity of effective…

Information Theory · Computer Science 2025-06-23 Guangwen Li , Xiao Yu

We consider the estimation distortion of a distributed sensing system with finite number of sensor nodes, in which the nodes observe a common phenomenon and transmit their observations to a fusion center over orthogonal channels. In…

Information Theory · Computer Science 2020-04-22 Yunquan Dong

Adaptive model predictive control (MPC) robustly ensures safety while reducing uncertainty during operation. In this paper, a distributed version is proposed to deal with network systems featuring multiple agents and limited communication.…

Systems and Control · Electrical Eng. & Systems 2024-04-17 Anilkumar Parsi , Ahmed Aboudonia , Andrea Iannelli , John Lygeros , Roy S. Smith

Coded caching is a promising technique to create coded multicast opportunities for cache-aided networks. By splitting each file into $F$ equal packets (i.e., the subpacketization level $F$) and letting each user cache a set of packets, the…

Information Theory · Computer Science 2025-10-28 Minquan Cheng , Yifei Huang , Youlong Wu , Jinyan Wang

Data shuffling between distributed cluster of nodes is one of the critical steps in implementing large-scale learning algorithms. Randomly shuffling the data-set among a cluster of workers allows different nodes to obtain fresh data…

Information Theory · Computer Science 2018-01-08 Mohamed A. Attia , Ravi Tandon

We propose a novel approach for channel state information (CSI) compression in multiple-input multiple-output orthogonal frequency division multiplexing (MIMO-OFDM) systems, where the frequency-domain channel matrix is treated as a…

Signal Processing · Electrical Eng. & Systems 2025-02-28 Bumsu Park , Heedong Do , Namyoon Lee

This paper describes the adaptation of a well-scaling parallel algorithm for computing Morse-Smale segmentations based on path compression to a distributed computational setting. Additionally, we extend the algorithm to efficiently compute…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-09 Michael Will , Jonas Lukasczyk , Julien Tierny , Christoph Garth

A key challenge in deriving unified neural solvers for combinatorial optimization (CO) is efficient generalization of models between a given set of tasks to new tasks not used during the initial training process. To address it, we first…

Machine Learning · Computer Science 2026-03-04 Semih Cantürk , Thomas Sabourin , Frederik Wenkel , Michael Perlmutter , Guy Wolf

In this paper, we propose to study and optimize a very general class of LDPC codes whose variable nodes belong to finite sets with different orders. We named this class of codes Hybrid LDPC codes. Although efficient optimization techniques…

Information Theory · Computer Science 2007-07-16 Lucile Sassatelli , David Declercq

Distributed source coding schemes are typically based on the use of channels codes as source codes. In this paper we propose a new paradigm, termed "distributed arithmetic coding", which exploits the fact that arithmetic codes are good…

Information Theory · Computer Science 2008-11-11 M. Grangetto , E. Magli , G. Olmo

Conventional coded computing frameworks are predominantly tailored for structured computations, such as matrix multiplication and polynomial evaluation. Such tasks allow the reuse of tools and techniques from algebraic coding theory to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-13 Parsa Moradi , Hanzaleh Akbarinodehi , Mohammad Ali Maddah-Ali

While performing distributed computations in today's cloud-based platforms, execution speed variations among compute nodes can significantly reduce the performance and create bottlenecks like stragglers. Coded computation techniques…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-04 Krishna Giri Narra , Zhifeng Lin , Mehrdad Kiamari , Salman Avestimehr , Murali Annavaram

The explosion in the volumes of data being stored online has resulted in distributed storage systems transitioning to erasure coding based schemes. Yet, the codes being deployed in practice are fairly short. In this work, we address what we…

Information Theory · Computer Science 2016-09-22 Parikshit Gopalan , Guangda Hu , Swastik Kopparty , Shubhangi Saraf , Carol Wang , Sergey Yekhanin
‹ Prev 1 8 9 10 Next ›