English
Related papers

Related papers: DataFed: Towards Reproducible Research via Federat…

200 papers

Machine learning has proved to be a useful tool for extracting knowledge from scientific data in numerous research fields, including astrophysics, genomics, and molecular dynamics. Often, data sets from these research areas need to be…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-21 Javier Álvarez Cid-Fuentes , Pol Álvarez , Salvi Solà , Kuninori Ishii , Rafael K. Morizawa , Rosa M. Badia

Data Grids have been adopted as the platform for scientific communities that need to share, access, transport, process and manage large data collections distributed worldwide. They combine high-end computing technologies with…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Srikumar Venugopal , Rajkumar Buyya , Kotagiri Ramamohanarao

Ensuring the reproducibility of scientific work is crucial as it allows the consistent verification of scientific claims and facilitates the advancement of knowledge by providing a reliable foundation for future research. However,…

Software Engineering · Computer Science 2025-04-14 Lázaro Costa , Susana Barbosa , Jácome Cunha

Reproducibility is a crucial aspect of scientific research that involves the ability to independently replicate experimental results by analysing the same data or repeating the same experiment. Over the years, many works have been proposed…

Digital Libraries · Computer Science 2024-07-16 Andrea Bianchi , Giordano d'Aloisio , Francesca Marzi , Antinisca Di Marco

In the field of computational science and engineering, workflows often entail the application of various software, for instance, for simulation or pre- and postprocessing. Typically, these components have to be combined in arbitrarily…

Software Engineering · Computer Science 2022-11-15 Philipp Diercks , Dennis Gläser , Ontje Lünsdorf , Michael Selzer , Bernd Flemisch , Jörg F. Unger

Remote sensing semantic segmentation (RSS) is an essential technology in earth observation missions. Due to concerns over geographic information security, data privacy, storage bottleneck and industry competition, high-quality annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Jieyi Tan , Yansheng Li , Sergey A. Bartalev , Shinkarenko Stanislav , Bo Dang , Yongjun Zhang , Liangqi Yuan , Wei Chen

Federated machine learning is a versatile and flexible tool to utilize distributed data from different sources, especially when communication technology develops rapidly and an unprecedented amount of data could be collected on mobile…

Machine Learning · Computer Science 2024-03-12 Tianyi Zhang , Shirui Zhang , Ziwei Chen , Dianbo Liu

The ever-increasing volumes of scientific data present new challenges for distributed computing and Grid technologies. The emerging Big Data revolution drives exploration in scientific fields including nanotechnology, astrophysics,…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-14 A. V. Vaniachine

Various computing and data resources on the Web are being enhanced with machine-interpretable semantic descriptions to facilitate better search, discovery and integration. This interconnected metadata constitutes the Semantic Web, whose…

Databases · Computer Science 2016-11-18 Craig Franke , Samuel Morin , Artem Chebotko , John Abraham , Pearl Brazier

Nowadays simulations can produce petabytes of data to be stored in parallel filesystems or large-scale databases. This data is accessed over the course of decades often by thousands of analysts and scientists. However, storing these volumes…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-11 Salvatore Di Girolamo , Pirmin Schmid , Thomas Schulthess , Torsten Hoefler

Here we present CaosDB, a Research Data Management System (RDMS) designed to ensure seamless integration of inhomogeneous data sources and repositories of legacy data. Its primary purpose is the management of data from biomedical sciences,…

Modern scientific applications are increasingly decomposable into individual functions that may be deployed across distributed and diverse cyberinfrastructure such as supercomputers, clouds, and accelerators. Such applications call for new…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-11 Yifei Li , Ryan Chard , Yadu Babuji , Kyle Chard , Ian Foster , Zhuozhao Li

In this thesis first we propose an intermediate data management scheme for a SWfMS. In our second attempt, we explored the possibilities and introduced an automatic recommendation technique for a SWfMS from real-world workflow data (i.e…

Information Retrieval · Computer Science 2020-10-28 Debasish Chakroborti

Information technology and data science development stimulate transformation in many fields of scientific knowledge. In recent years, a large number of specialized systems for information and knowledge management have been created in…

Materials Science · Physics 2025-10-09 Victor Dudarev , Lars Banko , Alfred Ludwig

Deep learning-based methods have achieved encouraging performances in the field of magnetic resonance (MR) image reconstruction. Nevertheless, to properly learn a powerful and robust model, these methods generally require large quantities…

Image and Video Processing · Electrical Eng. & Systems 2023-04-18 Ruoyou Wu , Cheng Li , Juan Zou , Qiegen Liu , Hairong Zheng , Shanshan Wang

Dynamo is a full-stack software solution for scientific data management. Dynamo's architecture is modular, extensible, and customizable, making the software suitable for managing data in a wide range of installation scales, from a few…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-18 Yutaro Iiyama , Benedikt Maier , Daniel Abercrombie , Maxim Goncharov , Christoph Paus

Objective: To (1) demonstrate the implementation of a data science platform built on open-source technology within a large, academic healthcare system and (2) describe two computational healthcare applications built on such a platform.…

Designing a scientific software stack to meet the needs of the next-generation of mesh-based simulation demands, not only scalable and efficient mesh and data management on a wide range of platforms, but also an abstraction layer that makes…

Mathematical Software · Computer Science 2015-05-19 Michael Lange , Matthew G. Knepley , Gerard J. Gorman

Artificial Intelligence for scientific applications increasingly requires training large models on data that cannot be centralized due to privacy constraints, data sovereignty, or the sheer volume of data generated. Federated learning (FL)…

Machine Learning · Computer Science 2026-03-23 Yijiang Li , Zilinghan Li , Kyle Chard , Ian Foster , Todd Munson , Ravi Madduri , Kibaek Kim

At this moment, databanks worldwide contain brain images of previously unimaginable numbers. Combined with developments in data science, these massive data provide the potential to better understand the genetic underpinnings of brain…

Machine Learning · Statistics 2025-01-30 Santiago Silva , Boris Gutman , Eduardo Romero , Paul M Thompson , Andre Altmann , Marco Lorenzi