English
Related papers

Related papers: Coded Data Rebalancing: Fundamental Limits and Con…

200 papers

Data shuffling of training data among different computing nodes (workers) has been identified as a core element to improve the statistical performance of modern large-scale machine learning algorithms. Data shuffling is often considered as…

Information Theory · Computer Science 2020-01-15 Kai Wan , Daniela Tuninetti , Mingyue Ji , Giuseppe Caire , Pablo Piantanida

A new system model reflecting the clustered structure of distributed storage is suggested to investigate bandwidth requirements for repairing failed storage nodes. Large data centers with multiple racks/disks or local networks of storage…

Information Theory · Computer Science 2017-02-14 Jy-yong Sohn , Beongjun Choi , Sung Whan Yoon , Jaekyun Moon

Data load balancing is a challenging task in the P2P systems. Distributed hash table (DHT) abstraction, heterogeneous nodes, and non uniform distribution of objects are the reasons to cause load imbalance in structured P2P overlay networks.…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-16 Seyed Iman Mirrezaei , Javad Shahparian

In cloud storage systems with a large number of servers, files are typically not stored in single servers. Instead, they are split, replicated (to ensure reliability in case of server malfunction) and stored in different servers. We analyze…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-09 Avishek Ghosh , Kannan Ramchandran

Coded computing has emerged as a promising framework for tackling significant challenges in large-scale distributed computing, including the presence of slow, faulty, or compromised servers. In this approach, each worker node processes a…

Machine Learning · Computer Science 2026-03-26 Parsa Moradi , Behrooz Tahmasebi , Mohammad Ali Maddah-Ali

Erasure codes are an efficient means of storing data across a network in comparison to data replication, as they tend to reduce the amount of data stored in the network and offer increased resilience in the presence of node failures. The…

Information Theory · Computer Science 2016-11-17 K. V. Rashmi , Nihar B. Shah , P. Vijay Kumar

Heterogeneous Distributed Storage Systems (DSSs) are close to the real world applications for data storage. Each node of the considered DSS, may store different number of packets and each having different repair bandwidth with uniform…

Information Theory · Computer Science 2016-07-22 Krishna Gopal Benerjee , Manish K. Gupta

This paper mainly focuses on the problem of lossy compression storage from the perspective of message importance when the reconstructed data pursues the least distortion within limited total storage size. For this purpose, we transform this…

Information Theory · Computer Science 2020-06-24 Shanyun Liu , Rui She , Zheqi Zhu , Pingyi Fan

Class imbalance, where certain classes have insufficient data, poses a critical challenge for robust classification, often biasing models toward majority classes. Distribution calibration offers a promising avenue to address this by…

Machine Learning · Computer Science 2025-10-23 Priyobrata Mondal , Faizanuddin Ansari , Swagatam Das

Data shuffling is one of the fundamental building blocks for distributed learning algorithms, that increases the statistical gain for each step of the learning process. In each iteration, different shuffled data points are assigned by a…

Information Theory · Computer Science 2016-09-19 Mohamed Attia , Ravi Tandon

This work studies distributed compression for the uplink of a cloud radio access network where multiple multi-antenna base stations (BSs) are connected to a central unit, also referred to as cloud decoder, via capacity-constrained backhaul…

Information Theory · Computer Science 2012-06-19 Seok-Hwan Park , Osvaldo Simeone , Onur Sahin , Shlomo Shamai

The deployment of databases across geographically distributed regions has become increasingly critical for ensuring data reliability and scalability. Recent studies indicate that distributed databases exhibit significantly higher latency…

Databases · Computer Science 2025-12-19 Duling Xu , Tong Li , Zegang Sun , Zheng Chen , Weixing Zhou , Yanfeng Zhang , Wei Lu , Xiaoyong Du

The performance of distributed storage systems deployed on wide-area networks can be improved using weighted (majority) quorum systems instead of their regular variants due to the heterogeneous performance of the nodes. A significant…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-26 Hasan Heydari , Guthemberg Silvestre , Alysson Bessani

Distributed storage architectures are foundational to modern cloud-native infrastructure, yet a critical operational bottleneck persists within disaster recovery (DR) workflows: the dependence on content-based cryptographic hashing for data…

Cryptography and Security · Computer Science 2026-02-27 Prasanna Kumar , Nishank Soni , Gaurang Munje

In a distributed storage system, the storage costs of different storage nodes, in general, can be different. How to store a file in a given set of storage nodes so as to minimize the total storage cost is investigated. By analyzing the…

Information Theory · Computer Science 2011-07-29 Quan Yu , Kenneth W. Shum , Chi Wan Sung

In a modern distributed storage system, storage nodes are organized in racks, and the cross-rack communication dominates the system bandwidth. In We study the rack-aware storage system where all storage nodes are organized in racks and…

Information Theory · Computer Science 2022-07-18 Liyang Zhou , Zhifang Zhang

Various computing and data resources on the Web are being enhanced with machine-interpretable semantic descriptions to facilitate better search, discovery and integration. This interconnected metadata constitutes the Semantic Web, whose…

Databases · Computer Science 2016-11-18 Craig Franke , Samuel Morin , Artem Chebotko , John Abraham , Pearl Brazier

Large scale clusters leveraging distributed computing frameworks such as MapReduce routinely process data that are on the orders of petabytes or more. The sheer size of the data precludes the processing of the data on a single computer. The…

Information Theory · Computer Science 2018-02-12 Konstantinos Konstantinidis , Aditya Ramamoorthy

Placement delivery arrays for distributed computing (Comp-PDAs) have recently been proposed as a framework to construct universal computing schemes for MapReduce-like systems. In this work, we extend this concept to systems with straggling…

Information Theory · Computer Science 2020-04-28 Qifa Yan , Michèle Wigger , Sheng Yang , Xiaohu Tang

Digital contents in large scale distributed storage systems may have different reliability and access delay requirements, and for this reason, erasure codes with different strengths need to be utilized to achieve the best storage…

Information Theory · Computer Science 2016-04-29 Chao Tian , Tie Liu