English
Related papers

Related papers: D-Rex: Heterogeneity-Aware Reliability Framework a…

200 papers

In the past few years, we have envisioned an increasing number of businesses start driving by big data analytics, such as Amazon recommendations and Google Advertisements. At the back-end side, the businesses are powered by big data…

Performance · Computer Science 2021-10-26 Ying Mao , Victoria Green , Jiayin Wang , Haoyi Xiong , Zhishan Guo

The tremendous increase in the size and heterogeneity of supercomputers makes it very difficult to predict the performance of a scheduling algorithm. Therefore, dynamic solutions, where scheduling decisions are made at runtime have…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-04-16 Olivier Beaumont , Loris Marchal

Optimizing edge caching is crucial for the advancement of next-generation (nextG) wireless networks, ensuring high-speed and low-latency services for mobile users. Existing data-driven optimization approaches often lack awareness of the…

Networking and Internet Architecture · Computer Science 2024-07-02 Zifan Zhang , Yuchen Liu , Zhiyuan Peng , Mingzhe Chen , Dongkuan Xu , Shuguang Cui

Distributed storage systems introduce redundancy to protect data from node failures. After a storage node fails, the lost data should be regenerated at a replacement storage node as soon as possible to maintain the same level of redundancy.…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-19 Qingyuan Gong , Jiaqi Wang , Yan Wang , Dongsheng Wei , Jin Wang , Xin Wang

In order to accommodate the ever-growing data from various, possibly independent, sources and the dynamic nature of data usage rates in practical applications, modern cloud data storage systems are required to be scalable, flexible, and…

Information Theory · Computer Science 2019-05-08 Siyi Yang , Ahmed Hareedy , Robert Calderbank , Lara Dolecek

Index structures are important for efficient data access, which have been widely used to improve the performance in many in-memory systems. Due to high in-memory overheads, traditional index structures become difficult to process the…

Databases · Computer Science 2019-05-16 Pengfei Li , Yu Hua , Pengfei Zuo , Jingnan Jia

Cloud computing facilitates the access of applications and data from any location by a distributed storage system. Erasure codes offer better data replication technique with reduced storage costs for more reliability. This paper considers…

Information Theory · Computer Science 2021-02-04 Srujan Teja Thomdapu , Ketan Rajawat

Distributionally Robust Optimization (DRO), which aims to find an optimal decision that minimizes the worst case cost over the ambiguity set of probability distribution, has been widely applied in diverse applications, e.g., network…

Machine Learning · Computer Science 2022-12-20 Yang Jiao , Kai Yang , Dongjin Song

Repair operations in distributed storage systems potentially expose the data to malicious acts of passive eavesdroppers or active adversaries, which can be detrimental to the security of the system. This paper presents erasure codes and…

Information Theory · Computer Science 2015-08-18 Nihar B. Shah , K. V. Rashmi , Kannan Ramchandran , P. Vijay Kumar

Distributed storage infrastructures require the use of data redundancy to achieve high data reliability. Unfortunately, the use of redundancy introduces storage and communication overheads, which can either reduce the overall storage…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-03-19 Lluis Pamies-Juarez , Ernst Biersack

We consider the problem of managing a dynamic heterogeneous storage system in a distributed way so that the amount of data assigned to a host in that system is related to its capacity. Two central problems have to be solved for this: (1)…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-07-26 Sebastian Kniesburges , Andreas Koutsopoulos , Christian Scheideler

Deep neural networks (DNNs) exploit many layers and a large number of parameters to achieve excellent performance. The training process of DNN models generally handles large-scale input data with many sparse features, which incurs high…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-08 Ji Liu , Zhihua Wu , Dianhai Yu , Yanjun Ma , Danlei Feng , Minxu Zhang , Xinxuan Wu , Xuefeng Yao , Dejing Dou

Distributed storage systems for large-scale applications typically use replication for reliability. Recently, erasure codes were used to reduce the large storage overhead, while increasing data reliability. A main limitation of…

Information Theory · Computer Science 2014-05-06 Dimitris S. Papailiopoulos , Alexandros G. Dimakis

This paper proposes an algorithm to minimize weighted service latency for different classes of tenants (or service classes) in a data center network where erasure-coded files are stored on distributed disks/racks and access requests are…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-03 Yu Xiang , Vaneet Aggarwal , Yih-Farn R. Chen , Tian Lan

Erasure coding is widely used for massive storage in data centers to achieve high fault tolerance and low storage redundancy. Since the cross-rack communication cost is often high, it is critical to design erasure codes that minimize the…

Information Theory · Computer Science 2019-02-26 Hanxu Hou , Patrick P. C. Lee , Kenneth W. Shum , Yuchong Hu

Data availability is one of the most important features in distributed storage systems, made possible by data replication. Nowadays data are generated rapidly and the goal to develop efficient, scalable and reliable storage systems has…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-01 Chryssis Georgiou , Nicolas Nicolaou , Andria Trigeorgi

Data storage systems are more reliable than their individual components. In order to build highly reliable systems out of less reliable parts, systems introduce redundancy. In replicated systems, objects are simply copied several times with…

Information Theory · Computer Science 2013-08-13 John Cook , Robert Primmer , Ab de Kwant

In large-scale distributed storage systems (DSS), reliability is provided by redundancy spread over storage servers across the Internet. Network coding (NC) has been widely studied in DSS because it can improve the reliability with low…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-17 Chengjin Jia , Jin Wang , Yanqin Zhu , Xin Wang , Kejie Lu , Xiumin Wang , Zhengqing Wen

Directory-based protocols have been the de facto solution for maintaining cache coherence in shared-memory parallel systems comprising multi/many cores, where each store instruction is eagerly made globally visible by invalidating the…

Hardware Architecture · Computer Science 2012-10-09 Daofu Liu , Yunji Chen , Qi Guo , Tianshi Chen , Ling Li , Qunfeng Dong , Weiwu Hu

Hardware compute power has been growing at an unprecedented rate in recent years. The utilization of such advancements plays a key role in producing better results in less time -- both in academia and industry. However, merging the existing…

Machine Learning · Computer Science 2021-10-19 Vineeth S
‹ Prev 1 3 4 5 6 7 10 Next ›