English
Related papers

Related papers: User-Defined Functions for HDF5

200 papers

Ensuring the reproducibility of scientific work is crucial as it allows the consistent verification of scientific claims and facilitates the advancement of knowledge by providing a reliable foundation for future research. However,…

Software Engineering · Computer Science 2025-04-14 Lázaro Costa , Susana Barbosa , Jácome Cunha

The purpose of this document is to specify the basic data types required for storing electrophysiology and optical imaging data to facilitate computer-based neuroscience studies and data sharing. These requirements are being developed…

Density functional theory (DFT) has been a cornerstone in computational chemistry, physics, and materials science for decades, benefiting from advancements in computational power and theoretical methods. This paper introduces a novel,…

The ubiquity of accelerators in high-performance computing has driven programming complexity beyond the skill-set of the average domain scientist. To maintain performance portability in the future, it is imperative to decouple…

Programming Languages · Computer Science 2020-01-06 Tal Ben-Nun , Johannes de Fine Licht , Alexandros Nikolaos Ziogas , Timo Schneider , Torsten Hoefler

Scientists are increasingly turning to datacenter-scale computers to produce and analyze massive arrays. Despite decades of database research that extols the virtues of declarative query processing, scientists still write, debug and…

Databases · Computer Science 2017-02-28 Haoyuan Xing , Sofoklis Floratos , Spyros Blanas , Suren Byna , Prabhat , Kesheng Wu , Paul Brown

Leadership computing facilities around the world support cutting-edge scientific research across a broad spectrum of disciplines including understanding climate change, combating opioid addiction, or simulating the decay of a neutron. While…

High Energy Physics - Lattice · Physics 2020-04-16 Chia Cheng Chang , Christopher Körber , André Walker-Loud

Over the last two decades, scientific workflow management systems (SWfMS) have emerged as a means to facilitate the design, execution, and monitoring of reusable scientific data processing pipelines. At the same time, the amounts of data…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-03-29 Marc Bux , Ulf Leser

Every research project necessitates data, often requiring sharing and collaborative review within a team. However, there is a dearth of good open-source data sharing and reviewing services. Existing file-sharing services generally mandate…

Databases · Computer Science 2024-06-27 Lexington Whalen , Homayoun Valafar

Science gateways are user-centric, end-to-end cyberinfrastructure for managing scientific data and executions of computational software on distributed resources. In order to simplify the creation and management of science gateways, we have…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-09 Dimuthu Wannipurage , Isuru Ranawaka , Eroma Abeysinghe , Marcus Christie , Suresh Marru , Marlon Pierce

More often than not, there is a need to understand the structure of complex computer code: what functions and in what order they are called, how information travels around static, input, and output variables, what depends on what. As a…

Software Engineering · Computer Science 2016-10-10 Igor Polkovnikov

A fundamental challenge in federated learning lies in mixing heterogeneous datasets and classification tasks while minimizing the high communication cost caused by clients as well as the exchange of weight updates with the server over a…

Image and Video Processing · Electrical Eng. & Systems 2024-08-19 Atefe Hassani , Islem Rekik

Cloud computing has demonstrated that processing very large datasets over commodity clusters can be done simply given the right programming model and infrastructure. In this paper, we describe the design and implementation of the Sector…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-01-17 Yunhong Gu , Robert L Grossman

The AMIDAS website has been established as an online interactive tool for running simulations and analyzing data in direct Dark Matter detection experiments. At the first phase of the website building, only some commonly used WIMP velocity…

Instrumentation and Methods for Astrophysics · Physics 2009-10-13 Chung-Lin Shan

Federated data processing (FDP) offers a promising approach for enabling collaborative analysis of sensitive data without centralizing raw datasets. However, real-world adoption remains limited due to the complexity of managing…

Software Engineering · Computer Science 2026-04-07 Natallia Kokash , Adam Belloum , Paola Grosso

The growing interconnection between software systems increases the need for security already at design time. Security-related properties like confidentiality are often analyzed based on data flow diagrams (DFDs). However, manually analyzing…

Software Engineering · Computer Science 2024-03-15 Nicolas Boltz , Sebastian Hahner , Christopher Gerking , Robert Heinrich

The real-world implementation of federated learning is complex and requires research and development actions at the crossroad between different domains ranging from data science, to software programming, networking, and security. While…

The convergence of high-performance computing (HPC) and artificial intelligence (AI) is driving the emergence of increasingly complex parallel applications and workloads. These workloads often combine multiple parallel runtimes within the…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-29 Aleix Roca , Vicenç Beltran

Exploding data volumes and velocities, new computational methods and platforms, and ubiquitous connectivity demand new approaches to computation in the sciences. These new approaches must enable computation to be mobile, so that, for…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-12 Ryan Chard , Yadu Babuji , Zhuozhao Li , Tyler Skluzacek , Anna Woodard , Ben Blaiszik , Ian Foster , Kyle Chard

Scientific computing can in some sense be distilled to the execution of an application - or rather sets of applications which are combined into complex workflows. Due to the complexity and number both of scientific packages as well as…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-01 Bruce Becker , Sean Murray

The capacity and programmability of reconfigurable hardware such as FPGAs has improved steadily over the years, but they do not readily provide any mechanisms for monitoring or debugging running programs. Such mechanisms need to be written…