English
Related papers

Related papers: Studying Scientific Data Lifecycle in On-demand Di…

200 papers

Storing big data directly on a blockchain poses a substantial burden due to the need to maintain a consistent ledger across all nodes. Numerous studies in decentralized storage systems have been conducted to tackle this particular…

Cryptography and Security · Computer Science 2024-10-01 Narges Dadkhah , Xuyang Ma , Katinka Wolter , Gerhard Wunder

Exploratory data analysis tools must respond quickly to a user's questions, so that the answer to one question (e.g. a visualized histogram or fit) can influence the next. In some SQL-based query systems used in industry, even very large…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-09 Jim Pivarski , David Lange , Thanat Jatuphattharachat

Caching at the wireless edge can be used to keep up with the increasing demand for high-definition wireless video streaming. By prefetching popular content into memory at wireless access points or end-user devices, requests can be served…

Information Theory · Computer Science 2019-12-03 Parisa Hassanzadeh , Antonia M. Tulino , Jaime Llorca , Elza Erkip

Modern distributed storage systems often use erasure codes to protect against disk and node failures to increase reliability, while trying to meet the latency requirements of the applications and clients. Storage systems may have caches at…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-24 Vaneet Aggarwal , Yih-Farn R. Chen , Tian Lan , Yu Xiang

This paper considers the secretive coded caching problem with shared caches in which no user must have access to the files that it did not demand. In a shared cache network, the users are served by a smaller number of helper caches and each…

Information Theory · Computer Science 2021-10-22 Elizabath Peter , K. K. Krishnan Namboodiri , B. Sundar Rajan

We present an approach to the distributed storage of data across a swarm of mobile robots that forms a shared global memory. We assume that external storage infrastructure is absent, and that each robot is capable of devoting a quota of…

Robotics · Computer Science 2019-09-12 Nathalie Majcherczyk , Carlo Pinciroli

Network based on distributed caching of content is a new architecture to alleviate the ongoing explosive demands for rate of multi-media traffic. In caching networks, coded caching is a recently proposed technique that achieves significant…

Information Theory · Computer Science 2017-10-16 Qifa Yan , Xiaohu Tang , Qingchun Chen

Caching at mobile devices and leveraging device-to-device (D2D) communication are two promising approaches to support massive content delivery over wireless networks. The analysis of such D2D caching networks based on a physical…

Signal Processing · Electrical Eng. & Systems 2018-10-15 Ramy Amer , Hesham Elsawy , M. Majid Butt , Eduard A. Jorswieck , Mehdi Bennis , Nicola Marchetti

Caches in Content-Centric Networks (CCN) are increasingly adopting flash memory based storage. The current flash cache technology stores all files with the largest possible expiry date, i.e. the files are written in the memory so that they…

Networking and Internet Architecture · Computer Science 2016-06-24 Samta Shukla , Alhussein A. Abouzeid

Next-generation communication networks are envisioned to extensively utilize storage-enabled caching units to alleviate unfavorable surges of data traffic by pro-actively storing anticipated highly popular contents across geographically…

Networking and Internet Architecture · Computer Science 2019-02-20 Alireza Sadeghi , Antonio G. Marques , Georgios B. Giannakis

Coded-caching is a promising technique to reduce the peak rate requirement of backhaul links during high traffic periods. In this letter, we study the effect of adaptive transmission on the performance of coded-caching based networks.…

Information Theory · Computer Science 2021-03-15 Behrooz Makki , Mohamed-Slim Alouini

Response time requirements for big data processing systems are shrinking. To meet this strict response time requirement, many big data systems store all or most of their data in main memory to reduce the access latency. Main memory…

Hardware Architecture · Computer Science 2016-08-29 Jason Lowe-Power , Mark D. Hill , David A. Wood

In cache-aided networks, the server populates the cache memories at the users during low-traffic periods, in order to reduce the delivery load during peak-traffic hours. In turn, there exists a fundamental trade-off between the delivery…

Information Theory · Computer Science 2019-03-15 Abdelrahman M. Ibrahim , Ahmed A. Zewail , Aylin Yener

In recent years, high interest in using Virtual Machines (VMs) in data centers and Cloud computing has significantly increased the demand for high-performance data storage systems. Recent studies suggest using SSDs as a caching layer for…

Hardware Architecture · Computer Science 2018-05-04 Saba Ahmadian , Onur Mutlu , Hossein Asadi

Automating the theory-experiment cycle requires effective distributed workflows that utilize a computing continuum spanning lab instruments, edge sensors, computing resources at multiple facilities, data sets distributed across multiple…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-22 Nathan Tallent , Jan Strube , Luanzheng Guo , Hyungro Lee , Jesun Firoz , Sayan Ghosh , Bo Fang , Oceane Bel , Steven Spurgeon , Sarah Akers , Christina Doty , Erol Cromwell

One of the primary objectives of a distributed storage system is to reliably store a large amount $dsize$ of source data for a long duration using a large number $N$ of unreliable storage nodes, each with capacity $nsize$. The storage…

Information Theory · Computer Science 2020-02-20 Michael Luby

The demand for distributed applications has significantly increased over the past decade, with improvements in machine learning techniques fueling this growth. These applications predominantly utilize Cloud data centers for high-performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-02 Narges Mehran , Dragi Kimovski , Hermann Hellwagner , Dumitru Roman , Ahmet Soylu , Radu Prodan

Content storage at the network edge is a promising solution to mitigate the excessive traffic load due to on-demand streaming applications as well as to reduce the streaming delay. To this end, cache-enabled cellular architectures can be…

Networking and Internet Architecture · Computer Science 2019-02-26 Mehdi Salehi Heydar Abad , Emre Ozfatura , Ozgur Ercetin , Deniz Gunduz

Nowadays, Linux file systems have to manage millions of tiny files for different applications, and face with higher metadata operations. So how to provide such high metadata performance with such enormous number of files and large scale…

Systems and Control · Computer Science 2014-09-30 Tanmay Agrawal , Ashay Shirwadkar , Pratik Gaikar , Kushagra Verma

Dynamic load balancing lies at the heart of distributed caching. Here, the goal is to assign objects (load) to servers (computing nodes) in a way that provides load balancing while at the same time dynamically adjusts to the addition or…

Data Structures and Algorithms · Computer Science 2020-06-17 John Chen , Ben Coleman , Anshumali Shrivastava