English
Related papers

Related papers: Coded Data Rebalancing: Fundamental Limits and Con…

200 papers

We study the problem of storing a data object in a set of data nodes that fail independently with given probabilities. Our problem is a natural generalization of a homogenous storage allocation problem where all the nodes had the same…

Information Theory · Computer Science 2012-02-09 Vasileios Ntranos , Giuseppe Caire , Alexandros G. Dimakis

Due to the pervasive diffusion of personal mobile and IoT devices, many ``smart environments'' (e.g., smart cities and smart factories) will be, among others, generators of huge amounts of data. Currently, this is typically achieved through…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-28 Lorenzo Valerio , Andrea Passarella , Marco Conti

The increasing use of statistical data analysis in enterprise applications has created an arms race among database vendors to offer ever more sophisticated in-database analytics. One challenge in this race is that each new statistical…

Databases · Computer Science 2015-03-20 Xixuan Feng , Arun Kumar , Ben Recht , Christopher Ré

Regenerating codes are a class of codes proposed for providing reliability of data and efficient repair of failed nodes in distributed storage systems. In this paper, we address the fundamental problem of handling errors and erasures during…

Information Theory · Computer Science 2015-03-20 K. V. Rashmi , Nihar B. Shah , Kannan Ramchandran , P. Vijay Kumar

With the expansion of data availability, machine learning (ML) has achieved remarkable breakthroughs in both academia and industry. However, imbalanced data distributions are prevalent in various types of raw data and severely hinder the…

Machine Learning · Computer Science 2025-09-15 Xinyi Gao , Dongting Xie , Yihang Zhang , Zhengren Wang , Chong Chen , Conghui He , Hongzhi Yin , Wentao Zhang

Performance of distributed optimization and learning systems is bottlenecked by "straggler" nodes and slow communication links, which significantly delay computation. We propose a distributed optimization framework where the dataset is…

Machine Learning · Statistics 2018-03-15 Can Karakus , Yifan Sun , Suhas Diggavi , Wotao Yin

This paper studies the fundamental limits of the shared-link coded caching problem with correlated files, where a server with a library of $N$ files communicates with $K$ users who can locally cache $M$ files. Given an integer $r \in [N]$,…

Information Theory · Computer Science 2021-06-15 Kai Wan , Daniela Tuninetti , Mingyue Ji , Giuseppe Caire

In a realistic distributed storage environment, storage nodes are usually placed in racks, a metallic support designed to accommodate electronic equipment. It is known that the communication (bandwidth) cost between nodes within a rack is…

Information Theory · Computer Science 2013-01-09 Bernat Gastón , Jaume Pujol , Mercè Villanueva

Distributed databases, as the core infrastructure software for internet applications, play a critical role in modern cloud services. However, existing distributed databases frequently experience system failures and performance degradation,…

Databases · Computer Science 2025-05-06 Lingzhe Zhang , Tong Jia , Mengxi Jia , Ying Li

Distributed computing, in which a resource-intensive task is divided into subtasks and distributed among different machines, plays a key role in solving large-scale problems. Coded computing is a recently emerging paradigm where redundancy…

Information Theory · Computer Science 2023-03-15 Hoang Dau , Ryan Gabrys , Yu-Chih Huang , Chen Feng , Quang-Hung Luu , Eidah Alzahrani , Zahir Tari

This work explores a distributed computing setting where $K$ nodes are assigned fractions (subtasks) of a computational task in order to perform the computation in parallel. In this setting, a well-known main bottleneck has been the…

Information Theory · Computer Science 2018-02-13 Emanuele Parrinello , Eleftherios Lampiris , Petros Elia

Distributed databases are fundamental infrastructures of today's large-scale software systems such as cloud systems. Detecting anomalies in distributed databases is essential for maintaining software availability. Existing approaches,…

Software Engineering · Computer Science 2024-06-13 Lingzhe Zhang , Tong Jia , Mengxi Jia , Ying Li , Yong Yang , Zhonghai Wu

Distributed software-defined networks (SDN), consisting of multiple inter-connected network domains, each managed by one SDN controller, is an emerging networking architecture that offers balanced centralized control and distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-13 Ziyao Zhang , Liang Ma , Kin K. Leung , Franck Le , Sastry Kompella , Leandros Tassiulas

We consider the recently proposed Coded Distributed Computing (CDC) framework that leverages carefully designed redundant computations to enable coding opportunities that substantially reduce the communication load of distributed computing.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-04 Mehrdad Kiamari , Chenwei Wang , A. Salman Avestimehr

Heterogeneous Distributed Storage Systems (DSS) are close to real world applications for data storage. Internet caching system and peer-to-peer storage clouds are the examples of such DSS. In this work, we calculate the capacity formula for…

Information Theory · Computer Science 2014-02-18 Krishna Gopal Benerjee , Manish Kumar Gupta

Efficient resource allocation and scheduling algorithms are essential for various distributed applications, ranging from wireless networks and cloud computing platforms to autonomous multi-agent systems and swarm robotic networks. However,…

Systems and Control · Electrical Eng. & Systems 2023-12-01 Mohammadreza Doostmohammadian , Alireza Aghasi

We consider a distributed storage system with $n$ nodes, where a user can recover the stored file from any $k$ nodes, and study the problem of repairing $r$ partially failed nodes. We consider \textit{broadcast repair}, that is, $d$…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-16 Nitish Mital , Katina Kralevska , Cong Ling , Deniz Gunduz

Class distribution skews in imbalanced datasets may lead to models with prediction bias towards majority classes, making fair assessment of classifiers a challenging task. Metrics such as Balanced Accuracy are commonly used to evaluate a…

This paper introduces a declarative framework to specify and reason about distributions of data over computing nodes in a distributed setting. More specifically, it proposes distribution constraints which are tuple and equality generating…

Databases · Computer Science 2020-03-03 Gaetano Geck , Frank Neven , Thomas Schwentick

Heterogeneity is becoming increasingly ubiquitous in modern large-scale computer systems. Developing good load balancing policies for systems whose resources have varying speeds is crucial in achieving low response times. Indeed, how best…

Performance · Computer Science 2020-06-26 Kristen Gardner , Jazeem Abdul Jaleel , Alexander Wickeham , Sherwin Doroudi