English
Related papers

Related papers: Demystifying Object-based Big Data Storage Systems

200 papers

Many astronomy data centres still work on filesystems. Industry has moved on; current practice in computing infrastructure is to achieve Big Data scalability using object stores rather than POSIX file systems. This presents us with…

Instrumentation and Methods for Astrophysics · Physics 2019-08-01 William O'Mullane , Niall Gaffney , Frossie Economou , Arfon M. Smith , J. Ross Thomson , Tim Jenness

This paper explores the essential areas of cybersecurity management for big data systems. Big data platform stems its complexity from being a collection of interrelated non-standardized systems that interact with each other to process large…

Cryptography and Security · Computer Science 2019-12-18 Shakir A. Almasaari

Nowadays medium-large size astronomical projects have to face the management of a large amount of information and data. Dedicated data centres manage the collection of raw and processed data and consequently make them accessible, typically…

Astrophysics · Physics 2007-05-23 Luciano Nicastro , Giorgio Calderone

The amount of data in the world is expanding rapidly. Every day, huge amounts of data are created by scientific experiments, companies, and end users' activities. These large data sets have been labeled as "Big Data", and their storage,…

Databases · Computer Science 2020-04-29 Mahdi Bohlouli , Frank Schulz , Lefteris Angelis , David Pahor , Ivona Brandic , David Atlan , Rosemary Tate

Fragmentation leads to unpredictable and degraded application performance. While these problems have been studied in detail for desktop filesystem workloads, this study examines newer systems such as scalable object stores and multimedia…

Databases · Computer Science 2009-08-21 Russell Sears , Catharine van Ingen

Owing to the massive growth in the storage demands of big data, Cloud Storage Systems (CSSs) have been put forward to improve the storage capacity. Compared with traditional storage systems, CSSs have lots of advantages, such as higher…

Logic in Computer Science · Computer Science 2019-11-12 Zhao Jin , Hanpin Wang , Lei Zhang , Bowen Zhang , Kun Gao , Yongzhi Cao

The InterPlanetary File System (IPFS) is a novel decentralised storage architecture, which attempts to provide decentralised cloud storage by building on founding principles of P2P networking and content addressing. IPFS is used by more…

Networking and Internet Architecture · Computer Science 2022-04-05 Trinh Viet Doan , Yiannis Psaras , Jörg Ott , Vaibhav Bajpai

A distributed storage system (DSS) needs to be efficiently accessible and repairable. Recently, considerable effort has been made towards the latter, while the former is usually not considered, since a trivial solution exists in the form of…

Information Theory · Computer Science 2020-01-16 Lukas Holzbaur , Stanislav Kruglik , Alexey Frolov , Antonia Wachter-Zeh

Modern applications demand high performance and cost efficient database management systems (DBMSs). Their workloads may be diverse, ranging from online transaction processing to analytics and decision support. The cloud infrastructure…

From home appliances to industrial enterprises, the Information and Communication Technology (ICT) industry is revolutionizing the world. We are witnessing the emergence of new technologies (e.g, Cloud computing, Fog computing, Internet of…

Networking and Internet Architecture · Computer Science 2020-07-14 Anwar Ghani , Afzal Badshah , Saeedullah Jan , Abdulrahman A. Alshdadi , Ali Daud

The collection of time series data increases as more monitoring and automation are being deployed. These deployments range in scale from an Internet of things (IoT) device located in a household to enormous distributed Cyber-Physical…

Databases · Computer Science 2017-10-10 Søren Kejser Jensen , Torben Bach Pedersen , Christian Thomsen

The paper presents a comparative overview of decentralized data storages of various types. It is shown that although they have a number of common properties that are typical of all peer-to-peer (P2P) networks, the problems to be solved and,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-16 Alexander Kryukov , Andrey Demichev

Distributed data aggregation is an important task, allowing the decentralized determination of meaningful global properties, that can then be used to direct the execution of other applications. The resulting values result from the…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-10-05 Paulo Jesus , Carlos Baquero , Paulo Sérgio Almeida

With the increased use of Internet, governments and large companies store and share massive amounts of personal data in such a way that leaves no space for transparency. When a user needs to achieve a simple task like applying for college…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-31 Sinica Alboaie , Doina Cosovan

Protecting data from malicious computer users continues to grow in importance. Whether preventing unauthorized access to personal photographs, ensuring compliance with federal regulations, or ensuring the integrity of corporate secrets, all…

Operating Systems · Computer Science 2007-05-23 Paul Stanton

Databases, collections of related data, are as old as the written word. A database can be anything from a homemaker's metal recipe file to a sophisticated data warehouse. Yet today, when we think of a database we invariably think of…

Databases · Computer Science 2007-05-23 Nancy Hartline Bercich

The article deals with the problem which led to Big Data. Big Data information technology is the set of methods and means of processing different types of structured and unstructured dynamic large amounts of data for their analysis and use…

Databases · Computer Science 2019-05-07 Nataliya Shakhovska , Uyrii Bolubash , Oleh Veres

While the Internet was conceived as a decentralized network, the most widely used web applications today tend toward centralization. Control increasingly rests with centralized service providers who, as a consequence, have also amassed…

Computers and Society · Computer Science 2012-02-22 Arvind Narayanan , Vincent Toubiana , Solon Barocas , Helen Nissenbaum , Dan Boneh

In the current paradigm of digital personalized services, the centralized management of personal data raises significant privacy concerns, security vulnerabilities, and diminished individual autonomy over sensitive information. Despite…

Cryptography and Security · Computer Science 2025-09-12 Osama Zafar , Mina Namazi , Yuqiao Xu , Youngjin Yoo , Erman Ayday

With the explosive growth of big data, workloads tend to get more complex and computationally demanding. Such applications are processed on distributed interconnected resources that are becoming larger in scale and computational capacity.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-30 Georgios L. Stavrinides , Helen D. Karatza