English
Related papers

Related papers: Any Data, Any Time, Anywhere: Global Data Access f…

200 papers

Remote memory access (RMA) is an emerging high-performance programming model that uses RDMA hardware directly. Yet, accessing remote memories cannot invoke activities at the target which complicates implementation and limits performance of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-20 Maciej Besta , Torsten Hoefler

Science gateways are user-centric, end-to-end cyberinfrastructure for managing scientific data and executions of computational software on distributed resources. In order to simplify the creation and management of science gateways, we have…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-09 Dimuthu Wannipurage , Isuru Ranawaka , Eroma Abeysinghe , Marcus Christie , Suresh Marru , Marlon Pierce

Access to astronomical data through archives and VO is essential but does not solve all problems. Availability of appropriate software for analyzing the data is often equally important for the efficiency with which a researcher can publish…

Instrumentation and Methods for Astrophysics · Physics 2010-04-27 P. Grosbol , D. Tody

Currently, the processing of scientific data in astroparticle physics is based on various distributed technologies, the most common of which are Grid and cloud computing. The most frequently discussed approaches are focused on large and…

Instrumentation and Methods for Astrophysics · Physics 2020-10-13 Alexander Kryukov , Igor Bychkov , Elena Korosteleva , Andrey Mikhailov , Minh-Duc Nguyen

Data preservation is a mandatory specification for any present and future experimental facility and it is a cost-effective way of doing fundamental research by exploiting unique data sets in the light of the continuously increasing…

Contemporary Distributed Computing Systems (DCS) such as Cloud Data Centres are large scale, complex, heterogeneous, and distributed across multiple networks and geographical boundaries. On the other hand, the Internet of Things…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-10 Shashikant Ilager , Rajeev Muralidhar , Rajkumar Buyya

Exponential increases in scientific experimental data are outstripping the rate of progress in silicon technology. As a result, heterogeneous combinations of architectures and process or device technologies are increasingly important to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-02 Wilkie Olin-Ammentorp , Xingfu Wu , Andrew A. Chien

Scientific data management is at a critical juncture, driven by exponential data growth, increasing cross-domain dependencies, and a severe reproducibility crisis in modern research. Traditional centralized data management approaches are…

Databases · Computer Science 2025-04-30 Sebastian Beyvers , Jannis Hochmuth , Lukas Brehm , Maria Hansen , Alexander Goesmann , Frank Förster

We show that distributed Infrastructure-as-a-Service (IaaS) compute clouds can be effectively used for the analysis of high energy physics data. We have designed a distributed cloud system that works with any application using large input…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-01-04 R. J. Sobie , A. Agarwal , M. Anderson , P. Armstrong , K. Fransham , I. Gable , D. Harris , C. Leavett-Brown , M. Paterson , D. Penfold-Brown , M. Vliet , A. Charbonneau , R. Impey , W. Podaima

Grid based systems require a database access mechanism that can provide seamless homogeneous access to the requested data through a virtual data access system, i.e. a system which can take care of tracking the data that is stored in…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Arshad Ali , Ashiq Anjum , Tahir Azim , Julian Bunn , Saima Iqbal , Richard McClatchey , Harvey Newman , S. Yousaf Shah , Tony Solomonides , Conrad Steenberg , Michael Thomas , Frank van Lingen , Ian Willers

Applications that fuse machine learning and simulation can benefit from the use of multiple computing resources, with, for example, simulation codes running on highly parallel supercomputers and AI training and inference tasks on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-04 Logan Ward , J. Gregory Pauloski , Valerie Hayot-Sasson , Ryan Chard , Yadu Babuji , Ganesh Sivaraman , Sutanay Choudhury , Kyle Chard , Rajeev Thakur , Ian Foster

The data is an important asset of an organization and it is essential to keep this asset secure. It requires security in whatever state is it i.e. data at rest, data in use, and data in transit. There is a need to pay more attention to it…

Cryptography and Security · Computer Science 2022-02-25 Ishu Gupta , Ashutosh Kumar Singh

Recent advancements in Earth system science have been marked by the exponential increase in the availability of diverse, multivariate datasets characterised by moderate to high spatio-temporal resolutions. Earth System Data Cubes (ESDCs)…

Scientific applications in HPC environment are more com-plex and more data-intensive nowadays. Scientists usually rely on workflow system to manage the complexity: simply define multiple processing steps into a single script and let the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-17 Dong Dai , Robert Ross , Dounia Khaldi , Yonghong Yan , Matthieu Dorier , Neda Tavakoli , Yong Chen

Scientific computing is rapidly entering a data-intensive era. However, existing general-purpose network protocol stacks face limitations in eliminating data silos and improving data accessibility and interoperability, making it difficult…

Networking and Internet Architecture · Computer Science 2026-05-06 Zhihong Shen , Xiaojie Zhu , Zhenjing Cheng , Hao Ren , Zhaoji Liang , Changfa Lu

Data analysis in space sciences has been performed exclusively visually for years, despite the fact that the largest amount of data belongs to non-visible portions of the electromagnetic spectrum. This, on the one hand, limits the study of…

Instrumentation and Methods for Astrophysics · Physics 2023-05-10 Johanna Casado , Beatriz García

The challenges expected for the next era of the Large Hadron Collider (LHC), both in terms of storage and computing resources, provide LHC experiments with a strong motivation for evaluating ways of rethinking their computing models at many…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-25 Tommaso Tedeschi , Vincenzo Eduardo Padulano , Daniele Spiga , Diego Ciangottini , Mirco Tracolli , Enric Tejedor Saavedra , Enrico Guiraud , Massimo Biasotto

Particle physics has an ambitious and broad global experimental programme for the coming decades. Large investments in building new facilities are already underway or under consideration. Scaling the present processing power and data…

Heliophysics image data largely relies on a forty-year-old ecosystem built on the venerable Flexible Image Transport System (FITS) data standard. While many in situ measurements use newer standards, they are difficult to integrate with…

The term Data Space, understood as the secure exchange of data in distributed systems, ensuring openness, transparency, decentralization, sovereignty, and interoperability of information, has gained importance during the last years.…

Databases · Computer Science 2024-02-13 Javier Conde , Alejandro Pozo , Andrés Munoz-Arcentales , Johnny Choque , Álvaro Alonso