English
Related papers

Related papers: File System in Data-Centric Computing

200 papers

Several solutions exist for file storage, sharing, and synchronization. Many of them involve a central server, or a collection of servers, that either store the files, or act as a gateway for them to be shared. Some systems take a…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Zulqarnain Mehdi , Hani Ragab-Hassen

Computer systems have evolved over the years starting from sizable, single-user, slow, and expensive machines to multi-user, fast, cheaper, and small-sized machines. The use of multi-user computer networks has given rise to a new paradigm…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-09 Aneesh Khole , Atharva Thakar , Avadhoot Kulkarni , Hrithik Jadhav , Shreyas Shende , Varad Karajkhede

Emerging high performance non-volatile memories recall the importance of efficient file system design. To avoid the virtual file system (VFS) and syscall overhead as in these kernel-based file systems, recent works deploy file systems…

Operating Systems · Computer Science 2019-08-29 Youmin Chen , Youyou Lu , Bohong Zhu , Jiwu Shu

Nowadays simulations can produce petabytes of data to be stored in parallel filesystems or large-scale databases. This data is accessed over the course of decades often by thousands of analysts and scientists. However, storing these volumes…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-11 Salvatore Di Girolamo , Pirmin Schmid , Thomas Schulthess , Torsten Hoefler

Many cloud-based applications employ a data centre as a central server to process data that is generated by edge devices, such as smartphones, tablets and wearables. This model places ever increasing demands on communication and…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-09-08 Blesson Varghese , Nan Wang , Sakil Barbhuiya , Peter Kilpatrick , Dimitrios S. Nikolopoulos

We live in a data-centric world where we are heading to generate close to 200 Zettabytes of data by the year 2025. Our data processing requirements have also increased as we push to build data processing frameworks that can process large…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-21 Corne Lukken , Animesh Trivedi

The goal of the present HTTPFS project is to enable access to remote files, directories, and other containers through an HTTP pipe. HTTPFS system permits retrieval, creation and modification of these resources as if they were regular files…

Operating Systems · Computer Science 2007-05-23 Oleg Kiselyov

We posit that striving for distributed systems that provide "single system image" semantics is fundamentally flawed and at odds with how systems operate in the physical world. We realize the database as an optimization of this system: a…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-09 Christopher S. Meiklejohn

This paper discusses recent research that aims to enable computation close to data, an approach we broadly call processing-in-memory (PIM). PIM places computation mechanisms in or near where the data is stored (i.e., inside memory chips or…

Hardware Architecture · Computer Science 2025-02-07 Onur Mutlu , Saugata Ghose , Juan Gómez-Luna , Rachata Ausavarungnirun , Mohammad Sadrosadati , Geraldo F. Oliveira

A centralized coded caching system, consisting of a server delivering N popular files, each of size F bits, to K users through an error-free shared link, is considered. It is assumed that each user is equipped with a local cache memory with…

Information Theory · Computer Science 2016-12-15 Mohammad Mohammadi Amiri , Deniz Gunduz

Data centers have become center of big data processing. Most programs running in a data center processes big data. The storage requirements of such programs cannot be fulfilled by a single node in the data center, and hence a distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-28 Sandeep Kumar

The cost of moving data between the memory units and the compute units is a major contributor to the execution time and energy consumption of modern workloads in computing systems. At the same time, we are witnessing an enormous amount of…

Hardware Architecture · Computer Science 2022-08-19 Gagandeep Singh

Many astronomy data centres still work on filesystems. Industry has moved on; current practice in computing infrastructure is to achieve Big Data scalability using object stores rather than POSIX file systems. This presents us with…

Instrumentation and Methods for Astrophysics · Physics 2019-08-01 William O'Mullane , Niall Gaffney , Frossie Economou , Arfon M. Smith , J. Ross Thomson , Tim Jenness

The present von Neumann computing paradigm involves a significant amount of information transfer between a central processing unit (CPU) and memory, with concomitant limitations in the actual execution speed. However, it has been recently…

Emerging Technologies · Computer Science 2014-07-03 Fabio Lorenzo Traversa , Fabrizio Bonani , Yuriy V. Pershin , Massimiliano Di Ventra

Virtual file systems are a tool to centralize and mobilize a file system that could otherwise be complex and consist of multiple hierarchies, hard disks, and more. In this paper, we discuss the design of Unix-based file systems and how this…

Operating Systems · Computer Science 2023-12-27 Qin Sun , Grace McKenzie , Guanqun Song , Ting Zhu

File systems must allocate space for files without knowing what will be added or removed in the future. Over the life of a file system, this may cause suboptimal file placement decisions that eventually lead to slower performance, or aging.…

File-sharing networks are distributed systems used to disseminate files among nodes of a communication network. The general simple principle of these systems is that once a node has retrieved a file, it may become a server for this file. In…

Probability · Mathematics 2010-05-12 L. Leskelä , Philippe Robert , Florian Simatos

The exponential growth in smart sensors and rapid progress in 5G networks is creating a world awash with data streams. However, a key barrier to building performant multi-sensor, distributed stream processing applications is high…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-10 Giuseppe Coviello , Kunal Rao , Murugan Sankaradas , Srimat Chakradhar

Modern distributed storage systems often use erasure codes to protect against disk and node failures to increase reliability, while trying to meet the latency requirements of the applications and clients. Storage systems may have caches at…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-24 Vaneet Aggarwal , Yih-Farn R. Chen , Tian Lan , Yu Xiang

Fog computing serves as a computing layer that sits between the edge devices and the cloud in the network topology. They have more compute capacity than the edge but much less so than cloud data centers. They typically have high uptime and…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-13 Yogesh Simmhan