English
Related papers

Related papers: Saving Storage Space Using Files on the Web

200 papers

Distributed storage systems often employ erasure codes to achieve high data reliability while attaining space efficiency. Such storage systems are known to be susceptible to long tails in response time. It has been shown that in modern…

Information Theory · Computer Science 2017-08-04 Vaneet Aggarwal , Tian Lan

Content delivery networks store information distributed across multiple servers, so as to balance the load and avoid unrecoverable losses in case of node or disk failures. Coded caching has been shown to be a useful technique which can…

Information Theory · Computer Science 2016-11-22 Tianqiong Luo , Vaneet Aggarwal , Borja Peleato

The {\em repair locality} of a distributed storage code is the maximum number of nodes that ever needs to be contacted during the repair of a failed node. Having small repair locality is desirable, since it is proportional to the number of…

Information Theory · Computer Science 2013-01-21 Henk D. L. Hollmann

Energy storage in data centers has mainly been used as devices to backup generators during power outages. Recently, there has been a growing interest in using energy storage devices to actively shape power consumption in data centers to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-07 Yuanyuan Shi , Bolun Xu , Baosen Zhang , Di Wang

Previous studies have shown that many users do not use effective data deletion techniques upon sale or surrender of storage devices. A logical assumption is that many users are still confused concerning proper sanitization techniques of…

Cryptography and Security · Computer Science 2015-12-31 Sarah Diesburg , C. Adam Feldhaus , Mojtaba Al Fardan , Jonathan Schlicht , Nigel Ploof

Caching is emerging as a vital tool for alleviating the severe capacity crunch in modern content-centric wireless networks. The main idea behind caching is to store parts of popular content in end-users' memory and leverage the locally…

Information Theory · Computer Science 2014-12-12 Avik Sengupta , Ravi Tandon , T. Charles Clancy

Content-rich websites typically house their images as individual files or as more costly binary database objects. Both methods place high demands on storage resources with commensurate high monetary cost. Inexpensive shared service accounts…

Databases · Computer Science 2023-03-09 Don Krieger

Cloud computing is recognized as one of the most promising solutions to information technology, e.g., for storing and sharing data in the web service which is sustained by a company or third party instead of storing data in a hard drive or…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-14 A. Roy , A. P. Misra , S. Banerjee

Several solutions exist for file storage, sharing, and synchronization. Many of them involve a central server, or a collection of servers, that either store the files, or act as a gateway for them to be shared. Some systems take a…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Zulqarnain Mehdi , Hani Ragab-Hassen

Regenerating codes allow distributed storage systems to recover from the loss of a storage node while transmitting the minimum possible amount of data across the network. We present a systematic computer search for optimal systematic…

Information Theory · Computer Science 2009-10-14 Daniel Cullina , Alexandros G. Dimakis , Tracey Ho

Caching appears to be an efficient way to reduce peak hour network traffic congestion by storing some content at the user's cache without knowledge of later demands. Recently, Maddah-Ali and Niesen proposed a two-phase, placement and…

Information Theory · Computer Science 2016-01-28 Kai Wan , Daniela Tuninetti , Pablo Piantanida

Recent advances of preservation technologies have led to an increasing number of Web archive systems and collections. These collections are valuable to explore the past of the Web, but their value can only be uncovered with effective access…

Information Retrieval · Computer Science 2017-01-17 Khoi Duy Vo , Tuan Tran , Tu Ngoc Nguyen , Xiaofei Zhu , Wolfgang Nejdl

We present measurements showing that the top one million most popular Web domains are reachable within 13ms (in the median) from a collective of just 12 cloud data centers. We explore the consequences of this Web "consolidation", focusing…

Networking and Internet Architecture · Computer Science 2019-06-13 Debopam Bhattacherjee , Muhammad Tirmazi , Ankit Singla

Content management systems use various strategies to store and manage information. One of the most usual methods encountered in commercial products is to make use of the file system to store the raw content information, while the associated…

Other Computer Science · Computer Science 2009-11-03 Rares Vasilescu

We consider a network consisting of a file server connected through a shared link to a number of users, each equipped with a cache. Knowing the popularity distribution of the files, the goal is to optimally populate the caches such as to…

Information Theory · Computer Science 2017-06-23 Urs Niesen , Mohammad Ali Maddah-Ali

Online collaboration platforms such as GitHub have provided software developers with the ability to easily reuse and share code between repositories. With clone-and-own and forking becoming prevalent, maintaining these shared files is…

Software Engineering · Computer Science 2021-02-15 Hideaki Hata , Raula Gaikovina Kula , Takashi Ishio , Christoph Treude

Distributed storage systems such as Hadoop File System or Google File System (GFS) ensure data availability and durability using replication. This paper is focused on the analysis of the efficiency of replication mechanism that determines…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-28 Wen Sun , Véronique Simon , Sébastien Monnet , Philippe Robert , Pierre Sens

Web archives are typically very broad in scope and extremely large in scale. This makes data analysis appear daunting, especially for non-computer scientists. These collections constitute an increasingly important source for researchers in…

Digital Libraries · Computer Science 2017-07-31 Gerhard Gossen , Elena Demidova , Thomas Risse

We study the problem of optimizing data storage and access costs on the cloud while ensuring that the desired performance or latency is unaffected. We first propose an optimizer that optimizes the data placement tier (on the cloud) and the…

Retrieving data from large-scale source code archives is vital for AI training, neural-based software analysis, and information retrieval, to cite a few. This paper studies and experiments with the design of a compressed key-value store for…

Data Structures and Algorithms · Computer Science 2026-01-21 Paolo Ferragina , Francesco Tosoni