English
Related papers

Related papers: CFS: A Distributed File System for Large Scale Con…

200 papers

Nowadays, Linux file systems have to manage millions of tiny files for different applications, and face with higher metadata operations. So how to provide such high metadata performance with such enormous number of files and large scale…

Systems and Control · Computer Science 2014-09-30 Tanmay Agrawal , Ashay Shirwadkar , Pratik Gaikar , Kushagra Verma

Nowadays simulations can produce petabytes of data to be stored in parallel filesystems or large-scale databases. This data is accessed over the course of decades often by thousands of analysts and scientists. However, storing these volumes…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-11 Salvatore Di Girolamo , Pirmin Schmid , Thomas Schulthess , Torsten Hoefler

There is a great interest in many approaches towards blockchain in providing a solution to record transactions in a decentralized way. However, there are some limitations when storing large files or documents on the blockchain. In order to…

Cryptography and Security · Computer Science 2022-05-05 Hsiao-Shan Huang , Tian-Sheuan Chang , Jhih-Yi Wu

Modern distributed storage systems come with aplethora of configurable parameters that controlmodule behavior and affect system performance. Default settings provided by developers are often suboptimal for specific user cases. Tuning…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-08 Wenhao Lyu , Youyou Lu , Jiwu Shu , Wei Zhao

In large-scale distributed file systems, efficient meta- data operations are critical since most file operations have to interact with metadata servers first. In existing distributed hash table (DHT) based metadata management systems, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-11 Peng Sun , Yonggang Wen , Ta Nguyen Binh Duong , Haiyong Xie

The InterPlanetary File System (IPFS) is an hyper-media distribution protocol, addressed by content and identities. It aims to make the web faster, safer, and more open. The JavaScript implementation of IPFS runs on the browser, benefiting…

Networking and Internet Architecture · Computer Science 2022-07-14 João Tiago , David Dias , Luís Veiga

Recent improvements in both the performance and scalability of shared-nothing, transactional, in-memory NewSQL databases have reopened the research question of whether distributed metadata for hierarchical file systems can be managed using…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-23 Salman Niazi , Mahmoud Ismail , Steffen Grohsschmiedt , Mikael Ronström , Seif Haridi , Jim Dowling

Cloud platforms host thousands of tenants that demand POSIX semantics, high throughput, and rapid evolution from their storage layer. Kernel-native distributed file systems supply raw speed, but their privileged code base couples every…

Operating Systems · Computer Science 2025-10-23 Haoyu Li , Jingkai Fu , Qing Li , Windsor Hsu , Asaf Cidon

Federated learning (FL) is a machine learning paradigm that targets model training without gathering the local data dispersed over various data sources. Standard FL, which employs a single server, can only support a limited number of users,…

Machine Learning · Computer Science 2024-02-29 Bin Wang , Jun Fang , Hongbin Li , Yonina C. Eldar

Emerging high performance non-volatile memories recall the importance of efficient file system design. To avoid the virtual file system (VFS) and syscall overhead as in these kernel-based file systems, recent works deploy file systems…

Operating Systems · Computer Science 2019-08-29 Youmin Chen , Youyou Lu , Bohong Zhu , Jiwu Shu

In this paper, we consider a multi-access coded caching system with decentralized prefetching, where a server hosts $N$ files, each of size $F$ bits, and is connected to $K$ users through a shared link. There are $c$ caches distributed…

Information Theory · Computer Science 2024-06-25 Monolina Dutta , Anoop Thomas , B. Sundar Rajan

Distributed storage systems such as Hadoop File System or Google File System (GFS) ensure data availability and durability using replication. This paper is focused on the analysis of the efficiency of replication mechanism that determines…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-28 Wen Sun , Véronique Simon , Sébastien Monnet , Philippe Robert , Pierre Sens

Recent developments in the industry of personal computing led to a greater number of the so-called edge devices. Such devices typically do not collaborate or foresee the possibility of collaboration to offer aggregated storage and computing…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-17 R. Copstein , F. Dotti

Hyper-converged cloud refers to an architecture that an operator runs compute and storage services on the same set of physical servers. Although the hyper-converged design comes with a number of benefits, it makes crucial operational tasks,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-23 Moo-Ryong Ra

We present ROSfs, a novel user-level file system for the Robot Operating System (ROS). ROSfs interprets a robot file as a group of sub-files, with each having a distinct label. ROSfs applies a time index structure to enhance the flexible…

Robotics · Computer Science 2024-06-18 Zijun Xu , Xuanjun Wen , Yanjie Song , Shu Yin

Delivering a reproducible environment along with complex and up-to-date software stacks on thousands of distributed and heterogeneous worker nodes is a critical task. The CernVM-File System (CVMFS) has been designed to help various…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-30 Alexandre F Boyer , Christophe Haen , Federico Stagni , David R C Hill

In the present-day, distributed applications are commonly spread across multiple datacenters, reaching out to edge and fog computing locations. The transition away from single datacenter hosting is driven by capacity constraints in…

Networking and Internet Architecture · Computer Science 2024-06-19 Berta Serracanta , Alberto Rodriguez-Natal , Fabio Maino , Albert Cabellos

This work examines strategies to handle large shared data objects in distributed storage systems (DSS), while boosting the number of concurrent accesses, maintaining strong consistency guarantees, and ensuring good operation performance. To…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-09 Antonio Fernandez Anta , Chryssis Georgiou , Theophanis Hadjistasi , Nicolas Nicolaou , Efstathios Stavrakis , Andria Trigeorgi

To address memory and computation resource limitations for hardware-oriented acceleration of deep convolutional neural networks (CNNs), we present a computation flow, stacked filters stationary flow (SFS), and a corresponding data encoding…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Yuechao Gao , Nianhong Liu , Sheng Zhang

For large scale distributed storage systems, flash memories are an excellent choice because flash memories consume less power, take lesser floor space for a target throughput and provide faster access to data. In a traditional distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-02-26 Srimugunthan , K. Gopinath