English
Related papers

Related papers: Storage Allocation for Multi-Class Distributed Dat…

200 papers

Load balancing is critical for distributed storage to meet strict service-level objectives (SLOs). It has been shown that a fast cache can guarantee load balancing for a clustered storage system. However, when the system scales out to…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-18 Zaoxing Liu , Zhihao Bai , Zhenming Liu , Xiaozhou Li , Changhoon Kim , Vladimir Braverman , Xin Jin , Ion Stoica

To facilitate load balancing, distributed systems store data redundantly. We evaluate the load balancing performance of storage schemes in which each object is stored at $d$ different nodes, and each node stores the same number of objects.…

Performance · Computer Science 2021-01-26 Mehmet Fatih Aktas , Amir Behrouzi-Far , Emina Soljanin , Philip Whiting

In large-scale distributed storage systems (DSS), reliability is provided by redundancy spread over storage servers across the Internet. Network coding (NC) has been widely studied in DSS because it can improve the reliability with low…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-17 Chengjin Jia , Jin Wang , Yanqin Zhu , Xin Wang , Kejie Lu , Xiumin Wang , Zhengqing Wen

In wireless cloud storage systems, the recovery failure probability depends on not only wireless channel conditions but also storage size of each distributed storage node. For an efficient utilization of limited storage capacity and the…

Information Theory · Computer Science 2016-11-17 Bi Hong , Wan Choi

In this paper, we consider heterogeneous distributed storage systems (DSSs) having flexible reconstruction degree, where each node in the system has dynamic repair bandwidth and dynamic storage capacity. In particular, a data collector can…

Information Theory · Computer Science 2015-03-10 Krishna Gopal Benerjee , Manish K. Gupta

For large scale distributed storage systems, flash memories are an excellent choice because flash memories consume less power, take lesser floor space for a target throughput and provide faster access to data. In a traditional distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-02-26 Srimugunthan , K. Gopinath

In distributed machine learning, data is dispatched to multiple machines for processing. Motivated by the fact that similar data points often belong to the same or similar classes, and more generally, classification rules of high accuracy…

Machine Learning · Computer Science 2016-12-16 Travis Dick , Mu Li , Venkata Krishna Pillutla , Colin White , Maria Florina Balcan , Alex Smola

This paper considers the security issue of practical distributed storage systems (DSSs) which consist of multiple clusters of storage nodes. Noticing that actual storage nodes constituting a DSS are distributed in multiple clusters, two…

Information Theory · Computer Science 2017-02-27 Beongjun Choi , Jy-yong Sohn , Sung Whan Yoon , Jaekyun Moon

The optimal tradeoff between node storage and repair bandwidth is an important issue for distributed storage systems (DSSs). As for realistic DSSs with clusters, when repairing a failed node, it is more efficient to download more data from…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-08 Jingzhao Wang , Tinghan Wang , Yuan Luo

Data distribution across different facilities offers benefits such as enhanced resource utilization, increased resilience through replication, and improved performance by processing data near its source. However, managing such data is…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-02 Dante D. Sanchez-Gallegos , J. L. Gonzalez-Compean , Maxime Gonthier , Valerie Hayot-Sasson , J. Gregory Pauloski , Haochen Pan , Kyle Chard , Jesus Carretero , Ian Foster

The distributed edge storage system can store data collected at the edge of the network in a decentralised manner, with low latency, high security, and flexibility. Traditional edge-distributed storage systems only consider one single…

Networking and Internet Architecture · Computer Science 2023-10-10 Yejin Yang , Miao Ye , Qiuxiang Jiang , Peng Wen

Big data storage management is one of the most challenging issues for Grid computing environments, since large amount of data intensive applications frequently involve a high degree of data access locality. Grid applications typically deal…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-07-13 Ajay Kumar , Seema Bawa

The heterogeneous edge-cloud computing paradigm can provide a more optimal direction to deploy scientific workflows than traditional distributed computing or cloud computing environments. Due to the different sizes of scientific datasets…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-14 Xin Du , Songtao Tang , Zhihui Lu , Keke Gai , Jie Wu , Patrick C. K. Hung

In this paper we propose distributed flooding-based storage algorithms for large-scale wireless sensor networks. Assume a wireless sensor network with $n$ nodes that have limited power, memory, and bandwidth. Each node is capable of both…

Information Theory · Computer Science 2009-09-01 Salah A. Aly , Hager S. Darwish , Moustafa Youssef , Mahmoud Zidan

In a distributed storage system, the storage costs of different storage nodes, in general, can be different. How to store a file in a given set of storage nodes so as to minimize the total storage cost is investigated. By analyzing the…

Information Theory · Computer Science 2011-07-29 Quan Yu , Kenneth W. Shum , Chi Wan Sung

In this paper, we study distributed storage problems over unidirectional ring networks, whose storage nodes form a directed ring and data is transmitted along the same direction. The original data is distributed to store on these nodes.…

Information Theory · Computer Science 2014-04-15 Jiyong Lu , Xuan Guang , Fang-Wei Fu

The paper is devoted to the problem of erasure coding in distributed storage. We consider a model of storage that assumes that nodes are organized into equally sized groups, called racks, that within each group the nodes can communicate…

Information Theory · Computer Science 2019-01-15 Zitan Chen , Alexander Barg

This paper mainly focuses on the problem of lossy compression storage from the perspective of message importance when the reconstructed data pursues the least distortion within limited total storage size. For this purpose, we transform this…

Information Theory · Computer Science 2020-06-24 Shanyun Liu , Rui She , Zheqi Zhu , Pingyi Fan

A distributed data collection algorithm to accurately store and forward information obtained by wireless sensor networks is proposed. The proposed algorithm does not depend on the sensor network topology, routing tables, or geographic…

Networking and Internet Architecture · Computer Science 2010-11-15 Salah A. Aly , Ahmed Ali-Eldin , H. Vincent Poor

Maximum-distance-separable (MDS) codes are a class of erasure codes that are widely adopted to enhance the reliability of distributed storage systems (DSS). In (n, k) MDS coded DSS, the original data are stored into n distributed nodes in…

Information Theory · Computer Science 2017-06-16 Sheng Guan , Haibin Kan , Xin Wang