English
Related papers

Related papers: Saving Storage Space Using Files on the Web

200 papers

Our goal in this paper is to investigate the fluid picture associated with an open large scale storage network of non-reliable file servers with finite capacity. In this storage system, new files can be added and a file with only one copy…

Probability · Mathematics 2025-07-16 Ahmed El Kharroubi , Soukaina El Masmari

The volume of data moving through a network increases with new scientific experiments and simulations. Network bandwidth requirements also increase proportionally to deliver data within a certain time frame. We observe that a significant…

Networking and Internet Architecture · Computer Science 2021-10-26 Elizabeth Copps , Huiyi Zhang , Alex Sim , Kesheng Wu , Inder Monga , Chin Guok , Frank Würthwein , Diego Davila , Edgar Fajardo

We consider a distributed storage system which stores several hot (popular) and cold (less popular) data files across multiple nodes or servers. Hot files are stored using repetition codes while cold files are stored using erasure codes.…

Performance · Computer Science 2021-05-10 Tim Hellemans , Arti Yardi , Tejas Bodas

Semiconductor NAND Flash based memory technology dominates the electronic Non-Volatile storage media market. Though NAND Flash offers superior performance and reliability over conventional magnetic HDDs, yet it suffers from certain…

Cryptography and Security · Computer Science 2020-01-22 Abhilash Garg , Supriya Chakraborty , Manoj Malik , Devesh Kumar , Satyajeet Singh , Manan Suri

Cloud computing is a term coined to a network that offers incredible processing power, a wide array of storage space and unbelievable speed of computation. Social media channels, corporate structures and individual consumers are all…

Cryptography and Security · Computer Science 2013-03-29 Debajyoti Mukhopadhyay , Gitesh Sonawane , Parth Sarthi Gupta , Sagar Bhavsar , Vibha Mittal

We examine the problem of allocating a given total storage budget in a distributed storage system for maximum reliability. A source has a single data object that is to be coded and stored over a set of storage nodes; it is allowed to store…

Information Theory · Computer Science 2016-11-15 Derek Leong , Alexandros G. Dimakis , Tracey Ho

The increasing adoption of econometric and machine-learning approaches by empirical researchers has led to a widespread use of one data collection method: web scraping. Web scraping refers to the use of automated computer programs to access…

General Economics · Economics 2023-08-07 Jens Foerderer

Data center networks are an important infrastructure in various applications of modern information technologies. Note that each data center always has a finite lifetime, thus once a data center fails, then it will lose all its storage files…

Performance · Computer Science 2018-08-06 Quan-Lin Li , Fan-Qi Ma , Jing-Yu Ma

Modern distributed storage systems often use erasure codes to protect against disk and node failures to increase reliability, while trying to meet the latency requirements of the applications and clients. Storage systems may have caches at…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-24 Vaneet Aggarwal , Yih-Farn R. Chen , Tian Lan , Yu Xiang

Redundant transfer of resources is a critical issue for compromising the performance of mobile Web applications (a.k.a., apps) in terms of data traffic, load time, and even energy consumption. Evidence shows that the current cache…

Software Engineering · Computer Science 2016-12-12 Xuanzhe Liu , Yun Ma , Shuailiang Dong , Yunxin Liu , Tao Xie , Gang Huang , Hong Mei

A drive by download is a download that occurs without users action or knowledge. It usually triggers an exploit of vulnerability in a browser to downloads an unknown file. The malicious program in the downloaded file installs itself on the…

Cryptography and Security · Computer Science 2020-04-10 Saeed Ibrahim , Nawwaf Al Herami , Ebrahim Al Naqbi , Monther Aldwairi

A log structured store uses a single write I/O for a number of diverse and non-contiguous pages within a large buffer instead of using a write I/O for each page separately. This requires that pages be relocated on every write, because pages…

Databases · Computer Science 2020-05-04 David Lomet , Chen Luo

World Wide Web is a huge repository of web pages and links. It provides abundance of information for the Internet users. The growth of web is tremendous as approximately one million pages are added daily. Users' accesses are recorded in web…

Information Retrieval · Computer Science 2010-04-09 V. Chitraa , Dr. Antony Selvdoss Davamani

Caching popular content at base stations is a powerful supplement to existing limited backhaul links for accommodating the exponentially increasing mobile data traffic. Given the limited cache budget, we investigate the cache size…

Information Theory · Computer Science 2016-03-01 Xi Peng , Jun Zhang , S. H. Song , Khaled B. Letaief

Fragmentation leads to unpredictable and degraded application performance. While these problems have been studied in detail for desktop filesystem workloads, this study examines newer systems such as scalable object stores and multimedia…

Databases · Computer Science 2009-08-21 Russell Sears , Catharine van Ingen

The vastness of the web imposes a prohibitive cost on building large-scale search engines with limited resources. Crawl frontiers thus need to be optimized to improve the coverage and freshness of crawled content. In this paper, we propose…

Distributed storage systems are mainly justified due to the limited amount of storage capacity and improving the reliability through distributing data over multiple storage nodes. On the other hand, it may happen the data is stored in…

Information Theory · Computer Science 2010-04-15 Soroush Akhlaghi , Abbas Kiani , Mohammad Reza Ghanavati

Nowadays computer networks use different kind of memory whose speeds and capacities vary widely. There exist methods of a so-called caching which are intended to use the different kinds of memory in such a way that the frequently used data…

Information Theory · Computer Science 2013-10-15 Boris Ryabko

The historical, cultural, and intellectual importance of archiving the web has been widely recognized. Today, all countries with high Internet penetration rate have established high-profile archiving initiatives to crawl and archive the…

Digital Libraries · Computer Science 2013-08-13 Zhiwu Xie , Herbert Van de Sompel , Jinyang Liu , Johann van Reenen , Ramiro Jordan

We study the problem of caching optimization in heterogeneous networks with mutual interference and per-file rate constraints from an energy efficiency perspective. A setup is considered in which two cache-enabled transmitter nodes and a…

Information Theory · Computer Science 2018-10-16 Estefanía Recayte , Giuseppe Cocco