English
Related papers

Related papers: A Storage-Computation-Communication Tradeoff for D…

200 papers

One of the design objectives in distributed storage system is the minimization of the data traffic during the repair of failed storage nodes. By repairing multiple failures simultaneously and cooperatively, further reduction of repair…

Information Theory · Computer Science 2015-03-20 Kenneth W. Shum , Yuchong Hu

Distributed Video Coding (DVC) is a new coding paradigm for video compression, based on Slepian- Wolf (lossless coding) and Wyner-Ziv (lossy coding) information theoretic results. DVC is useful for emerging applications such as wireless…

Multimedia · Computer Science 2011-03-25 Vijay Kumar Kodavalla , Dr. P. G. Krishna Mohan

Retrieving data from large-scale source code archives is vital for AI training, neural-based software analysis, and information retrieval, to cite a few. This paper studies and experiments with the design of a compressed key-value store for…

Data Structures and Algorithms · Computer Science 2026-01-21 Paolo Ferragina , Francesco Tosoni

We consider the problem of storing data in a distributed manner over $T$ servers. We require the data (i) to be recoverable from the $T$ servers, and (ii) to remain private from any $T-1$ colluding servers, where privacy is quantified in…

Information Theory · Computer Science 2020-06-01 Remi A. Chou , Joerg Kliewer

Elasticity plays an important role in modern cloud computing systems. Elastic computing allows virtual machines (i.e., computing nodes) to be preempted when high-priority jobs arise, and also allows new virtual machines to participate in…

Information Theory · Computer Science 2024-03-04 Wenbo Huang , Xudong You , Kai Wan , Robert Caiming Qiu , Mingyue Ji

Electric vehicles (EVs) are an eco-friendly alternative to vehicles with internal combustion engines. Despite their environmental benefits, the massive electricity demand imposed by the anticipated proliferation of EVs could jeopardize the…

Systems and Control · Electrical Eng. & Systems 2019-11-18 Nanduni I. Nimalsiri , Chathurika P. Mediwaththe , Elizabeth L. Ratnam , Marnie Shaw , David B. Smith , Saman K. Halgamuge

This paper considers the communication and storage costs of emulating atomic (linearizable) multi-writer multi-reader shared memory in distributed message-passing systems. The paper contains three main contributions: (1) We present a atomic…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-07-17 Viveck R. Cadambe , Nancy Lynch , Muriel Médard , Peter Musial

This paper develops coding techniques to reduce the running time of distributed learning tasks. It characterizes the fundamental tradeoff to compute gradients (and more generally vector summations) in terms of three parameters: computation…

Machine Learning · Statistics 2018-02-13 Min Ye , Emmanuel Abbe

In this paper, we propose a new coding scheme and establish new bounds on the capacity region for the multi-sender unicast index-coding problem. We revisit existing partitioned Distributed Composite Coding (DCC) proposed by Sadeghi et al.…

Information Theory · Computer Science 2018-09-07 Min Li , Lawrence Ong , Sarah J. Johnson

Gradient descent (GD) methods are commonly employed in machine learning problems to optimize the parameters of the model in an iterative fashion. For problems with massive datasets, computations are distributed to many parallel computing…

Information Theory · Computer Science 2019-03-06 Emre Ozfatura , Deniz Gunduz , Sennur Ulukus

The distributed linearly separable computation problem finds extensive applications across domains such as distributed gradient coding, distributed linear transform, real-time rendering, etc. In this paper, we investigate this problem in a…

Information Theory · Computer Science 2024-01-30 Haoning Chen , Minquan Cheng , Zhenhao Huang , Youlong Wu

Coded caching is an emerging technique to reduce the data transmission load during the peak-traffic times. In such a scheme, each file in the data center or library is usually divided into a number of packets to pursue a low broadcasting…

Information Theory · Computer Science 2022-01-06 Xianzhang Wu , Minquan Cheng , Congduan Li , Li Chen

Data shuffling is one of the fundamental building blocks for distributed learning algorithms, that increases the statistical gain for each step of the learning process. In each iteration, different shuffled data points are assigned by a…

Information Theory · Computer Science 2016-09-19 Mohamed Attia , Ravi Tandon

In recent years, there is an emerging trend that some computing services are moving from cloud to the edge of the networks. Compared to cloud computing, edge computing can provide services with faster response, lower expense, and more…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-30 Jinyue Song , Tianbo Gu , Yunjie Ge , Prasant Mohapatra

Resource allocation is a fundamental problem in Industrial Internet of Things (IIoT) systems, in which devices work together under limited communication bandwidth to complete diverse tasks. This paper proposes a communication-efficient…

Optimization and Control · Mathematics 2026-05-26 Yuzhu Duan , Ziwen Yang , Xiaoming Duan , Shanying Zhu

We propose a flexible gradient tracking approach with adjustable computation and communication steps for solving distributed stochastic optimization problem over networks. The proposed method allows each node to perform multiple local…

Optimization and Control · Mathematics 2023-06-13 Yan Huang , Jinming Xu

Cache-aided coded multicast leverages side information at wireless edge caches to efficiently serve multiple groupcast demands via common multicast transmissions, leading to load reductions that are proportional to the aggregate cache size.…

Information Theory · Computer Science 2016-11-17 Parisa Hassanzadeh , Antonia Tulino , Jaime Llorca , Elza Erkip

Designing a rate limiter that is simultaneously accurate, available, and scalable presents a fundamental challenge in distributed systems, primarily due to the trade-offs between algorithmic precision, availability, consistency, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-13 Bo Guan

Cooperative computation is a promising approach for localized data processing at the edge, e.g. for Internet of Things (IoT). Cooperative computation advocates that computationally intensive tasks in a device could be divided into…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-24 Yasaman Keshtkarjahromi , Yuxuan Xing , Hulya Seferoglu

Modern large-scale systems such as recommender system and online advertising system are built upon computation-intensive infrastructure. The typical objective in these applications is to maximize the total revenue, e.g. GMV~(Gross…

Networking and Internet Architecture · Computer Science 2020-06-18 Biye Jiang , Pengye Zhang , Rihan Chen , Binding Dai , Xinchen Luo , Yin Yang , Guan Wang , Guorui Zhou , Xiaoqiang Zhu , Kun Gai