English
Related papers

Related papers: Studying Scientific Data Lifecycle in On-demand Di…

200 papers

Wireless information-centric networks consider storage as one of the network primitives, and propose to cache data within the network in order to improve latency and reduce bandwidth consumption. We study the throughput capacity and delay…

Networking and Internet Architecture · Computer Science 2015-05-01 Bita Azimdoost , Cedric Westphal , Hamid R. Sadjadpour

Wireless edge networks in smart industrial environments increasingly operate using advanced sensors and autonomous machines interacting with each other and generating huge amounts of data. Those huge amounts of data are bound to make data…

Networking and Internet Architecture · Computer Science 2025-03-03 Theofanis P. Raptis , Andrea Passarella , Marco Conti

The rapid increase in data traffic demand has overloaded existing cellular networks. Planned upgrades in the communication architecture (e.g. LTE), while helpful, are not expected to suffice to keep up with demand. As a result, extensive…

Networking and Internet Architecture · Computer Science 2015-03-03 Pavlos Sermpezis , Luigi Vigneri , Thrasyvoulos Spyropoulos

We consider a wireless device-to-device (D2D) network where $n$ nodes are uniformly distributed at random over the network area. We let each node with storage capacity $M$ cache files from a library of size $m \geq M$. Each node in the…

Information Theory · Computer Science 2016-11-17 Sang-Woon Jeon , Song-Nam Hong , Mingyue Ji , Giuseppe Caire , Andreas F. Molisch

One of the primary objectives of a distributed storage system is to reliably store large amounts of source data for long durations using a large number $N$ of unreliable storage nodes, each with $c$ bits of storage capacity. Storage nodes…

Information Theory · Computer Science 2018-04-13 Michael Luby

Over the last three decades, innovations in the memory subsystem were primarily targeted at overcoming the data movement bottleneck. In this paper, we focus on a specific market trend in memory technology: 3D-stacked memory and caches. We…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-17 Jens Domke , Emil Vatai , Balazs Gerofi , Yuetsu Kodama , Mohamed Wahib , Artur Podobas , Sparsh Mittal , Miquel Pericàs , Lingqi Zhang , Peng Chen , Aleksandr Drozd , Satoshi Matsuoka

One utilisation of multidimensional databases is the field of On-line Analytical Processing (OLAP). The applications in this area are designed to make the analysis of shared multidimensional information fast [9]. On one hand, speed can be…

Databases · Computer Science 2011-05-04 István Szépkúti

Unique scientific instruments designed and operated by large global collaborations are expected to produce Exabyte-scale data volumes per year by 2030. These collaborations depend on globally distributed storage and compute to turn raw data…

Networking and Internet Architecture · Computer Science 2023-02-24 Frank Würthwein , Jonathan Guiang , Aashay Arora , Diego Davila , John Graham , Dima Mishin , Thomas Hutton , Igor Sfiligoi , Harvey Newman , Justas Balcas , Tom Lehman , Xi Yang , Chin Guok

Various performance characteristics of distributed file systems have been well studied. However, the performance efficiency of distributed file systems on small-file problems with complex machine learning algorithms scenarios is not well…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-01 Thanh Duong , Quoc Luu , Hung Nguyen

Wireless information-centric networks consider storage as one of the network primitives, and propose to cache data within the network in order to improve latency and reduce bandwidth consumption. We study the throughput capacity and latency…

Networking and Internet Architecture · Computer Science 2016-11-17 Bita Azimdoost , Cedric Westphal , Hamid R. Sadjadpour

Storage allocation affects important performance measures of distributed storage systems. Most previous studies on the storage allocation consider its effect separately either on the success of the data recovery or on the service rate…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Moslem Noori , Emina Soljanin , Masoud Ardakani

Multicore processors have proved to be the right choice for both desktop and server systems because it can support high performance with an acceptable budget expenditure. In this work, we have compared several works in cache contention and…

Operating Systems · Computer Science 2019-06-04 Maruthi Rohit Ayyagari

The recent proliferation of Data Grids and the increasingly common practice of using resources as distributed data stores provide a convenient environment for communities of researchers to share, replicate, and manage access to copies of…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Sudharshan Vazhkudai , Jennifer M. Schopf

A new system model reflecting the clustered structure of distributed storage is suggested to investigate interplay between storage overhead and repair bandwidth as storage node failures occur. Large data centers with multiple racks/disks or…

Information Theory · Computer Science 2018-05-02 Jy-yong Sohn , Beongjun Choi , Sung Whan Yoon , Jaekyun Moon

A new system model reflecting the clustered structure of distributed storage is suggested to investigate bandwidth requirements for repairing failed storage nodes. Large data centers with multiple racks/disks or local networks of storage…

Information Theory · Computer Science 2017-02-14 Jy-yong Sohn , Beongjun Choi , Sung Whan Yoon , Jaekyun Moon

Allocation of (redundant) file chunks throughout a distributed storage system affects important performance metrics such as the probability of file recovery, data download time, or the service rate of the system under a given data access…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-24 Pei Peng , Emina Soljanin

Data-intensive platforms such as Hadoop and Spark are routinely used to process massive amounts of data residing on distributed file systems like HDFS. Increasing memory sizes and new hardware technologies (e.g., NVRAM, SSDs) have recently…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-22 Herodotos Herodotou , Elena Kakoulli

Due to the increased demand of network traffic expected during the HL-LHC era, the T2 sites in the USA will be required to have 400Gbps of available bandwidth to their storage solution. With the above in mind we are pursuing a scale test of…

Networking and Internet Architecture · Computer Science 2025-06-06 Aashay Arora , Jonathan Guiang , Diego Davila , Frank Würthwein , Justas Balcas , Harvey Newman

This paper proposes round-hashing, which is suitable for data storage on distributed servers and for implementing external-memory tables in which each lookup retrieves at most a single block of external memory, using a stash. For data…

Data Structures and Algorithms · Computer Science 2018-05-09 Roberto Grossi , Luca Versari

In this work, we focus on distributed cache systems with non-uniform storage capacity across caches. We compare the performance of our system with the performance of a system with the same cumulative storage distributed evenly across the…

Information Theory · Computer Science 2018-09-27 Kota Srinivas Reddy , Sharayu Moharir , Nikhil Karamchandani