中文
相关论文

相关论文: Benchmarking the Open Science Data Federation serv…

200 篇论文

Extensive data processing is becoming commonplace in many fields of science. Distributing data to processing sites and providing methods to share the data with collaborators efficiently has become essential. The Open Science Data Federation…

分布式、并行与集群计算 · 计算机科学 2026-05-18 Fabio Andrijauskas , Derek Weitzel , Frank Wuerthwein

The growing demand for extensive data processing is now a standard in many scientific fields. Efficiently distributing data to processing sites and enabling seamless sharing has become crucial. The Open Science Data Federation (OSDF) builds…

分布式、并行与集群计算 · 计算机科学 2026-05-18 Sydney Montiel , Alexsandra Guadarrama , Fabio Andrijauskas

In this paper we describe the design, and implementation of the Open Science Data Cloud, or OSDC. The goal of the OSDC is to provide petabyte-scale data cloud infrastructure and related services for scientists working with large quantities…

The High Luminosity Large Hadron Collider provides a data challenge. The amount of data recorded from the experiments and transported to hundreds of sites will see a thirty fold increase in annual data volume. A systematic approach to…

分布式、并行与集群计算 · 计算机科学 2021-09-08 Edgar Fajardo , Aashay Arora , Diego Davila , Richard Gao , Frank Würthwein , Brian Bockelman

This report evaluates the new analytical capabilities of DataStax Enterprise (DSE) [1] through the use of standard Hadoop workloads. In particular, we run experiments with CPU and I/O bound micro-benchmarks as well as OLAP-style analytical…

分布式、并行与集群计算 · 计算机科学 2014-12-17 Todor Ivanov , Raik Niemann , Sead Izberovic , Marten Rosselli , Karsten Tolle , Roberto V. Zicari

Software Defined Networking (SDN) offers flexibility to program a network based on a set of network requirements. Programming the networks using SDN is not completely straightforward because a programmer must deal with low level details. To…

网络与互联网体系结构 · 计算机科学 2018-07-09 Douglas Comer , Adib Rastegarnia

A National Science Foundation-sponsored container runtimes investigation was conducted by the Aristotle Cloud Federation to better understand the challenges of selecting and using Docker, Singularity, and X-Containers. The main goal of this…

Imagine an online work environment where researchers have direct and immediate access to myriad data sources and tools and data management resources, useful throughout the research lifecycle. This is our vision for the next generation of…

计算机与社会 · 计算机科学 2015-06-19 Latanya Sweeney , Merce Crosas

We present an experimental study of large-scale RDF federations on top of the Bio2RDF data sources, involving 29 data sets with more than four billion RDF triples deployed in a local federation. Our federation is driven by FedX, a highly…

数据库 · 计算机科学 2012-10-22 Andreas Schwarte , Peter Haase , Michael Schmidt , Katja Hose , Ralf Schenkel

The management of security credentials (e.g., passwords, secret keys) for computational science workflows is a burden for scientists and information security officers. Problems with credentials (e.g., expiration, privilege mismatch) cause…

分布式、并行与集群计算 · 计算机科学 2019-05-27 Alex Withers , Brian Bockelman , Derek Weitzel , Duncan Brown , Jason Patton , Jeff Gaynor , Jim Basney , Todd Tannenbaum , You Alex Gao , Zach Miller

Every research project necessitates data, often requiring sharing and collaborative review within a team. However, there is a dearth of good open-source data sharing and reviewing services. Existing file-sharing services generally mandate…

数据库 · 计算机科学 2024-06-27 Lexington Whalen , Homayoun Valafar

We present algorithmic improvements to the loading operations of certain reduced data ensembles produced from neutron scattering experiments at Oak Ridge National Laboratory (ORNL) facilities. Ensembles from multiple measurements are…

数据库 · 计算机科学 2022-09-07 William F Godoy , Andrei T Savici , Steven E Hahn , Peter F Peterson

Objective: To (1) demonstrate the implementation of a data science platform built on open-source technology within a large, academic healthcare system and (2) describe two computational healthcare applications built on such a platform.…

In the search for a sustainable approach for software ecosystems that supports experimental and observational science (EOS) across Oak Ridge National Laboratory (ORNL), we conducted a survey to understand the current and future landscape of…

软件工程 · 计算机科学 2022-09-07 David E Bernholdt , Mathieu Doucet , William F Godoy , Addi Malviya-Thakur , Gregory R Watson

One-shot federated learning (OSFL) reduces the communication cost and privacy risks of iterative federated learning by constructing a global model with a single round of communication. However, most existing methods struggle to achieve…

机器学习 · 计算机科学 2026-01-08 Shudong Liu , Hanwen Zhang , Xiuling Wang , Yuesheng Zhu , Guibo Luo

The increasingly collaborative, globalized nature of scientific research combined with the need to share data and the explosion in data volumes present an urgent need for a scientific data management system (SDMS). An SDMS presents a…

数据库 · 计算机科学 2020-04-09 Dale Stansberry , Suhas Somnath , Jessica Breet , Gregory Shutt , Mallikarjun Shankar

The XRootD system is used to transfer, store, and cache large datasets from high-energy physics (HEP). In this study we focus on its capability as distributed on-demand storage cache. Through exploring a large set of daily log files between…

分布式、并行与集群计算 · 计算机科学 2022-05-12 Julian Bellavita , Alex Sim , Kesheng Wu , Inder Monga , Chin Guok , Frank Würthwein , Diego Davila

The adoption of Semantic Web technologies, and in particular the Open Data initiative, has contributed to the steady growth of the number of datasets and triples accessible on the Web. Most commonly, queries over RDF data are evaluated over…

数据库 · 计算机科学 2019-12-18 Gabriela Montoya , Ilkcan Keles , Katja Hose

This paper describes a vision and work in progress to elevate network resources and data transfer management to the same level as compute and storage in the context of services access, scheduling, life cycle management, and orchestration.…

COVID-19 had an unprecedented impact on scientific collaboration. The pandemic and its broad response from the scientific community has forged new relationships among domain experts, mathematical modelers, and scientific computing…

分布式、并行与集群计算 · 计算机科学 2023-05-11 Nicholson Collier , Justin M. Wozniak , Abby Stevens , Yadu Babuji , Mickaël Binois , Arindam Fadikar , Alexandra Würth , Kyle Chard , Jonathan Ozik
‹ 上一页 1 2 3 10 下一页 ›