English
Related papers

Related papers: The Lustre Storage Architecture

200 papers

Today's era is the digitized era. Managing such generated big data is an important factor for data scientists. Day by day, it increases the demand for big data storage systems. Different organizations are involved in providing…

Increasing amounts of data from varied sources, particularly in the fields of machine learning and graph analytics, are causing storage requirements to grow rapidly. A variety of technologies exist for storing and sharing these data,…

A log structured store uses a single write I/O for a number of diverse and non-contiguous pages within a large buffer instead of using a write I/O for each page separately. This requires that pages be relocated on every write, because pages…

Databases · Computer Science 2020-05-04 David Lomet , Chen Luo

The growth in Internet usage has contributed to a large volume of continuously available data, and has created the need for automatic and efficient organization of the data. In this context, text clustering techniques are significant…

Machine Learning · Computer Science 2023-12-14 Fernando Simeone , Maik Olher Chaves , Ahmed Esmin

A liquid system provides durable object storage based on spreading redundantly generated data across a network of hundreds to thousands of potentially unreliable storage nodes. A liquid system uses a combination of a large code, lazy…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-24 Michael G. Luby , Roberto Padovani , Thomas J. Richardson , Lorenz Minder , Pooja Aggarwal

In this work, we propose a library that enables on a cloud the creation and management of tree data structures from a cloud client. As a proof of concept, we implement a new cloud service CloudTree. With CloudTree, users are able to…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-04 Yun Tian , Bojian Xu , Yanqing Ji , Jesse Scholer

Modern databases typically makes use of the Log Structured Merge-Tree for organizing data in indexes, which is a kind of disk-based data structure. It was proposed to efficiently handle frequent update queries (also called update intensive…

Databases · Computer Science 2024-02-28 Supriya Mishra

This paper tries to throw light in the usage of data structures in the field of information retrieval. Information retrieval is an area of study which is gaining momentum as the need and urge for sharing and exploring information is growing…

Information Retrieval · Computer Science 2016-02-26 V. R. Kanagavalli , G. Maheeja

Many emerging Web services, such as email, photo sharing, and web site archives, need to preserve large amounts of quickly-accessible data indefinitely into the future. In this paper, we make the case that these applications' demands on…

Digital Libraries · Computer Science 2007-05-23 Mary Baker , Mehul Shah , David S. H. Rosenthal , Mema Roussopoulos , Petros Maniatis , TJ Giuli , Prashanth Bungale

In the last decade, key-value data storage systems have gained significantly more interest from academia and industry. These systems face numerous challenges concerning storage space- and read optimization. There exists a large potential…

Databases · Computer Science 2020-04-07 Martin Weise

Log-Structured Merge (LSM) Trees provide a tiered data storage and retrieval paradigm that is attractive for write-optimized data systems. Maintaining an efficient buffer in memory and deferring updates past their initial write-time, the…

Databases · Computer Science 2018-09-11 Aron Szanto

Proposed in 1993 the Scalable Distributed Data Structures (SDDSs) became a profile of basis for the data management on Multi computer. In this paper we propose an organization of a LH* bucket based on the trie hashing in order to improve…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-12-16 Aridj Mohamed

Spreadsheet technology is a cornerstone of IT systems in most organisations. It is often the glue that binds more structured transaction-based systems together. Financial operations are a case in point where spreadsheets fill the gaps left…

Software Engineering · Computer Science 2011-11-30 Kevin McDaid , Ronan MacRuairi , Neil Clynch , Kevin Logue , Cian Clancy , Shane Hayes

Most establishments including academic institutions under goes the lengthy process of study-based document handling such as direct mailing, indexing and tracking. This daily task is time consuming and resource-intensive. Using a private…

Signal Processing · Electrical Eng. & Systems 2022-02-09 Omar Ali Athab , Ahmed Mohammed Saheb

Virtual file systems are a tool to centralize and mobilize a file system that could otherwise be complex and consist of multiple hierarchies, hard disks, and more. In this paper, we discuss the design of Unix-based file systems and how this…

Operating Systems · Computer Science 2023-12-27 Qin Sun , Grace McKenzie , Guanqun Song , Ting Zhu

This paper analyzes various distributed storage systems that use data fragmentation and dispersal as a way of protection.Existing solutions have been organized into two categories: bitwise and structurewise. Systems from the bitwise…

Cryptography and Security · Computer Science 2017-06-20 Katarzyna Kapusta , Gerard Memmi

With the ever-increasing amount of data generate in the world, estimated to reach over 200 Zettabytes by 2025, pressure on efficient data storage systems is intensifying. The shift from HDD to flash-based SSD provides one of the most…

Operating Systems · Computer Science 2023-07-25 Nick Tehrany , Krijn Doekemeijer , Animesh Trivedi

This paper presents a systematic study on the security of modern file systems, following a vulnerability-centric perspective. Specifically, we collected 377 file system vulnerabilities committed to the CVE database in the past 20 years. We…

Cryptography and Security · Computer Science 2022-04-28 Jinghan Sun , Shaobo Li , Jun Xu , Jian Huang

The tremendous expanse of search engines, dictionary and thesaurus storage, and other text mining applications, combined with the popularity of readily available scanning devices and optical character recognition tools, has necessitated…

Databases · Computer Science 2012-07-04 Sourav Dutta , Arnab Bhattacharya

Storing digital information, ensuring the accuracy, steady and uninterrupted access to the data are considered as fundamental challenges in enterprise-class organizations and companies. In recent years, new types of storage systems such as…

Other Computer Science · Computer Science 2014-05-12 Arash Batni , Farshad Safaei