English
Related papers

Related papers: Any Data, Any Time, Anywhere: Global Data Access f…

200 papers

We make a case for "planetary computing" -- infrastructure to handle the ingestion, transformation, analysis and publication of global data products for furthering environmental science and enabling better informed policy-making. We draw on…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-04 Patrick Ferris , Michael Dales , Sadiq Jaffer , Amelia Holcomb , Eleanor Toye Scott , Thomas Swinfield , Alison Eyres , Andrew Balmford , David Coomes , Srinivasan Keshav , Anil Madhavapeddy

Exascale I/O initiatives will require new and fully integrated I/O models which are capable of providing straightforward functionality, fault tolerance and efficiency. One solution is the Distributed Asynchronous Object Storage (DAOS)…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-04 M. Scot Breitenfeld , Neil Fortner , Jordan Henderson , Jerome Soumagne , Mohamad Chaarawi , Johann Lombardi , Quincey Koziol

Geo-distributed data analytics are increasingly common to derive useful information in large organisations. Naive extension of existing cluster-scale data analytics systems to the scale of geo-distributed data centers faces unique…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-08 Xiaoda Zhang , Zhuzhong Qian , Sheng Zhang , Yize Li , Xiangbo Li , Xiaoliang Wang , Sanglu Lu

We present an approach to the distributed storage of data across a swarm of mobile robots that forms a shared global memory. We assume that external storage infrastructure is absent, and that each robot is capable of devoting a quota of…

Robotics · Computer Science 2019-09-12 Nathalie Majcherczyk , Carlo Pinciroli

Cloud computing provides ubiquitous and on-demand access to vast reconfigurable resources that can meet any computational need. Many service models are available, but the Infrastructure as a Service (IaaS) model is particularly suited to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-29 Gianluca Longoni , Ryan LaMothe , Jeremy Teuton , Mark Greaves , Nicole Nichols , William Smith

This paper represents an approach to creating global knowledge systems, using new philosophy and infrastructure of global distributed semantic network (frame knowledge representation system) based on the space-time database construction.…

Information Theory · Computer Science 2007-07-16 A. A. Prikhod'ko , N. A. Prikhod'ko

Artificial intelligence (AI) technology and systems have been advancing rapidly. However, ensuring the reliability of these systems is crucial for fostering public confidence in their use. This necessitates the modeling and analysis of…

Data fabric is an automated and AI-driven data fusion approach to accomplish data management unification without moving data to a centralized location for solving complex data problems. In a Federated learning architecture, the global model…

With the growing number and increasing availability of shared-use instruments and observatories, observational data is becoming an essential part of application workflows and contributor to scientific discoveries in a range of disciplines.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-01 Yubo Qin , Ivan Rodero , Anthony Simonet , Charles Meertens , Daniel Reiner , James Riley , Manish Parashar

The advancement of artificial intelligence (AI) hinges on the quality and accessibility of data, yet the current fragmentation and variability of data sources hinder efficient data utilization. The dispersion of data sources and diversity…

Digital Libraries · Computer Science 2024-07-22 Conghui He , Wei Li , Zhenjiang Jin , Chao Xu , Bin Wang , Dahua Lin

The Architecture, Engineering, and Construction (AEC) industry is undergoing rapid digital transformation, producing diverse digital assets such as datasets, computational models, use cases, and educational materials across the built…

Computers and Society · Computer Science 2026-03-23 Ruoxin Xiong , Yanyu Wang , Jiannan Cai , Kaijian Liu , Yuansheng Zhu , Pingbo Tang , Nora El-Gohary , George Edward Gibson

Modern tools for biological research, especially microscopy, have rapidly advanced in recent years, which has led to the generation of increasingly large amounts of data on a regular basis. The result is that scientists desperately need…

Other Quantitative Biology · Quantitative Biology 2021-08-18 Andrey Andreev , Tom Morrell , Kristin Briney , Sandra Gesing , Uri Manor

Cloud platforms allow users to execute tasks directly from their web browser and are a key enabling technology not only for commerce but also for computational science. Research software is often developed by scientists with limited…

In this paper, a technology for massive data storage and computing named Hadoop is surveyed. Hadoop consists of heterogeneous computing devices like regular PCs abstracting away the details of parallel processing and developers can just…

Networking and Internet Architecture · Computer Science 2022-03-01 Ameneh Zarei , Shahla Safari , Mahmood Ahmadi , Farhad Mardukhi

Objective: The objective was to develop a cloud-based, federated system to serve as a single point of search, discovery and analysis for data generated under the NIH Helping to End Addiction Long-term (HEAL) Initiative. Materials and…

The powerful discovery capabilities available in the ADS bibliographic services are possible thanks to the design of a flexible search and retrieval system based on a relational database model. Bibliographic records are stored as a corpus…

Astrophysics · Physics 2009-10-31 A. Accomazzi , G. Eichhorn , M. J. Kurtz , C. S. Grant , S. S. Murray

Information technology organizations and companies are seeking greener alternatives to traditional terrestrial data centers to mitigate global warming and reduce carbon emissions. Currently, terrestrial data centers consume a significant…

Systems and Control · Electrical Eng. & Systems 2023-09-19 Wiem Abderrahim , Osama Amin , Basem Shihada

Spatial data are central to applications such as environmental monitoring and urban planning, but are often distributed across devices where privacy and communication constraints limit direct sharing. Federated modeling offers a practical…

Methodology · Statistics 2025-10-03 Jianwei Shi , Sameh Abdulah , Ying Sun , Marc G. Genton

In era of ever-expanding data and knowledge, we lack a centralized system that maps all the faculties to their research works. This problem has not been addressed in the past and it becomes challenging for students to connect with the right…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-27 Noopur Gupta , Rakesh K. Lenka , Rabindra K. Barik , Harishchandra Dubey

We describe the design and implementation of a high performance cloud that we have used to archive, analyze and mine large distributed data sets. By a cloud, we mean an infrastructure that provides resources and/or services over the…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-08-25 Robert L Grossman , Yunhong Gu