中文
相关论文

相关论文: Hierarchical Coding to Enable Scalability and Flex…

200 篇论文

Regenerating codes and codes with locality are two schemes that have recently been proposed to ensure data collection and reliability in a distributed storage network. In a situation where one is attempting to repair a failed node,…

信息论 · 计算机科学 2013-02-05 Govinda M. Kamath , N. Prakash , V. Lalitha , P. Vijay Kumar

Most cloud services and distributed applications rely on hashing algorithms that allow dynamic scaling of a robust and efficient hash table. Examples include AWS, Google Cloud and BitTorrent. Consistent and rendezvous hashing are algorithms…

数据结构与算法 · 计算机科学 2022-05-17 Mike Heddes , Igor Nunes , Tony Givargis , Alexandru Nicolau , Alex Veidenbaum

In cloud storage, the digital data is stored in logical storage pools, backed by heterogeneous physical storage media and computing infrastructure that are managed by a Cloud Service Provider (CSP). To balance the tradeoff between service…

网络与互联网体系结构 · 计算机科学 2017-11-03 Yang Zhang , Arnob Ghosh , Vaneet Aggarwal , Tian Lan

Modern distributed storage systems offer large capacity to satisfy the exponentially increasing need of storage space. They often use erasure codes to protect against disk and node failures to increase reliability, while trying to meet the…

分布式、并行与集群计算 · 计算机科学 2017-08-04 Yu Xiang , Tian Lan , Vaneet Aggarwal , Yih-Farn R Chen

Peer-to-peer distributed storage systems provide reliable access to data through redundancy spread over nodes across the Internet. A key goal is to minimize the amount of bandwidth used to maintain that redundancy. Storing a file using an…

Hierarchical data storage is crucial for cloud-edge-end time-series database. Efficient hierarchical storage will directly reduce the storage space of local databases at each side and improve the access hit rate of data. However, no…

数据库 · 计算机科学 2023-02-28 Shuangshuang Cui , Hongzhi Wang , Xianglong Liu , Zeyu Tian , Xiaoou Ding

Distributed data storage systems are essential to deal with the need to store massive volumes of data. In order to make such a system fault-tolerant, some form of redundancy becomes crucial, incurring various overheads - most prominently in…

分布式、并行与集群计算 · 计算机科学 2011-12-25 Frederique Oggier , Anwitaman Datta

Recent literature including our past work provide analysis and solutions for using (i) erasure coding, (ii) parallelism, or (iii) variable slicing/chunking (i.e., dividing an object of a specific size into a variable number of smaller…

网络与互联网体系结构 · 计算机科学 2014-03-21 Guanfeng Liang , Ulas C. Kozat

This paper presents flexible storage codes, a class of error-correcting codes that can recover information from a flexible number of storage nodes. As a result, one can make a better use of the available storage nodes in the presence of…

信息论 · 计算机科学 2021-06-23 Weiqi Li , Zhiying Wang , Taiting Lu , Hamid Jafarkhani

SC-LDPC codes with sub-block locality can be decoded locally at the level of sub-blocks that are much smaller than the full code block, thus providing fast access to the coded information. The same code can also be decoded globally using…

信息论 · 计算机科学 2020-05-28 Homa Esfahanizadeh , Eshed Ram , Yuval Cassuto , Lara Dolecek

Large disk arrays are organized into storage nodes -- SNs or bricks with their own cashed RAID controller for multiple disks. Erasure coding at SN level is attained via parity or Reed-Solomon codes. Hierarchical RAID -- HRAID -- provides an…

分布式、并行与集群计算 · 计算机科学 2022-05-16 Alexander Thomasian

Cache-aided content delivery is studied in a multi-server system with $P$ servers and $K$ users, each equipped with a local cache memory. In the delivery phase, each user connects randomly to any $\rho$ out of $P$ servers. Thanks to the…

信息论 · 计算机科学 2018-04-16 Nitish Mital , Deniz Gunduz , Cong Ling

This paper reviews and highlights how coding schemes have been used to solve various problems in blockchain systems. Specifically, these problems relate to scaling blockchains in terms of their data storage, computation and communication…

分布式、并行与集群计算 · 计算机科学 2022-08-22 Changlin Yang , Kwan-Wu Chin , Jiguang Wang , Xiaodong Wang , Ying Liu , Zibin Zheng

A major concern in cloud/edge storage systems is serving a large number of users simultaneously. The service rate region is introduced recently as an important performance metric for coded distributed systems, which is defined as the set of…

信息论 · 计算机科学 2020-10-27 Fatemeh Kazemi , Sascha Kurz , Emina Soljanin , Alex Sprintson

The in-memory cache system is an important component in a cloud for the data access performance. As the tenants may have different performance goals for data access depending on the nature of their tasks, effectively managing the memory…

分布式、并行与集群计算 · 计算机科学 2019-06-05 Taejoon Kim , Yu Gu , Jinoh Kim

This paper addresses the problem of exponentially increasing sub-packetization with the number of users in a centralized coded caching system by introducing a new coded caching scheme inspired by the symmetric neighboring consecutive side…

信息论 · 计算机科学 2020-09-24 Anjana A. Mahesh , B. Sundar Rajan

In this paper, we consider a hierarchical distributed multi-task learning (MTL) system where distributed users wish to jointly learn different models orchestrated by a central server with the help of a layer of multiple relays. Since the…

信息论 · 计算机科学 2022-12-19 Haoyang Hu , Songze Li , Minquan Cheng , Youlong Wu

We describe a novel extension of subspace codes for noncoherent networks, suitable for use when the network is viewed as a communication system that introduces both dimension and symbol errors. We show that when symbol erasures occur in a…

信息论 · 计算机科学 2012-09-25 Vitaly Skachek , Olgica Milenkovic , Angelia Nedic

Coded computation is a method to mitigate "stragglers" in distributed computing systems through the use of error correction coding that has lately received significant attention. First used in vector-matrix multiplication, the range of…

信息论 · 计算机科学 2018-06-28 Nuwan Ferdinand , Stark Draper

This paper presents a new alphabet-dependent bound for codes with hierarchical locality. Then, the complete list of possible localities is derived for a class of codes obtained by deleting specific columns from a Simplex code. This list is…

信息论 · 计算机科学 2019-07-04 Matthias Grezet , Camilla Hollanti