English
Related papers

Related papers: Using the Open Science Data Federation for data di…

200 papers

Extensive data processing is becoming commonplace in many fields of science. Distributing data to processing sites and providing methods to share the data with collaborators efficiently has become essential. The Open Science Data Federation…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-18 Fabio Andrijauskas , Derek Weitzel , Frank Wuerthwein

In this paper we describe the design, and implementation of the Open Science Data Cloud, or OSDC. The goal of the OSDC is to provide petabyte-scale data cloud infrastructure and related services for scientists working with large quantities…

Research has become dependent on processing power and storage, one crucial aspect being data sharing. The Open Science Data Federation (OSDF) project aims to create a scientific global data distribution network based on the Pelican…

Information Retrieval · Computer Science 2026-05-14 Fabio Andrijauskas , Igor Sfiligoi , Frank Würthwein

Data distribution for opportunistic users is challenging as they neither own the computing resources they are using or any nearby storage. Users are motivated to use opportunistic computing to expand their data processing capacity, but they…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-17 Derek Weitzel , Marian Zvada , Ilija Vukotic , Rob Gardner , Brian Bockelman , Mats Rynge , Edgar Fajardo Hernandez , Brian Lin , Matyas Selmeci

The data volumes stored in telescope archives is constantly increasing due to the development and improvements in the instrumentation. Often the archives need to be stored over a distributed storage architecture, provided by independent…

Instrumentation and Methods for Astrophysics · Physics 2022-02-07 Y. G. Grange , V. N. Pandey , X. Espinal , R. Di Maria , A. P. Millar

A distributed data warehouse system is one of the actual issues in the field of astroparticle physics. Famous experiments, such as TAIGA, KASCADE-Grande, produce tens of terabytes of data measured by their instruments. It is critical to…

Astrophysics and Space Science are becoming increasingly characterised by what is now known as "big data", the bottlenecks for progress partly shifting from data acquisition to "data mining". Truth is that the amount and rate of data…

Instrumentation and Methods for Astrophysics · Physics 2019-02-13 Ulisses Barres de Almeida , Paolo Giommi , Carlos H. Brandt , Benno Bodmann

The ever-growing need of data preservation and their systematic analysis contributing to sustainable development of the society spurred in the past decade,numerous Big Data projects and initiatives are focusing on the Earth Observation…

Computers and Society · Computer Science 2021-08-23 Lachezar Filchev , Lyubka Pashova , Vasil Kolev , Stuart Frye

Scientific data collected at ESO's observatories are freely and openly accessible online through the ESO Science Archive Facility. In addition to the raw data straight out of the instruments, the ESO Science Archive also contains four…

Flooding protocols based on concurrent transmissions are regarded as the most reliable way to collect or disseminate data across a multi-hop low-power wireless mesh network. Recent works have shown that such protocols are effective for…

Networking and Internet Architecture · Computer Science 2022-08-30 Michael Baddeley , Yevgen Gyl , Markus Schuss , Xiaoyuan Ma , Carlo Alberto Boano

The increasingly collaborative, globalized nature of scientific research combined with the need to share data and the explosion in data volumes present an urgent need for a scientific data management system (SDMS). An SDMS presents a…

Databases · Computer Science 2020-04-09 Dale Stansberry , Suhas Somnath , Jessica Breet , Gregory Shutt , Mallikarjun Shankar

The emergence of sixth-generation (6G) networks has spurred the development of novel testbeds, including sub-THz networks, cell-free systems, and 6G simulators. To maximize the benefits of these systems, it is crucial to make the generated…

Nowadays, many scientific areas share the same broad requirements of being able to deal with massive and distributed datasets while, when possible, being integrated with services and applications. In order to solve the growing gap between…

Instrumentation and Methods for Astrophysics · Physics 2011-12-06 M. Brescia , S. Cavuoti , R. D'Abrusco , O. Laurino , G. Longo

Imagine an online work environment where researchers have direct and immediate access to myriad data sources and tools and data management resources, useful throughout the research lifecycle. This is our vision for the next generation of…

Computers and Society · Computer Science 2015-06-19 Latanya Sweeney , Merce Crosas

With the increase in amount of Big Data being generated each year, tools and technologies developed and used for the purpose of storing, processing and analyzing Big Data has also improved. Open-Source software has been an important factor…

Software Engineering · Computer Science 2020-05-07 Aleem Akhtar

As the amount of scientific data continues to grow at ever faster rates, the research community is increasingly in need of flexible computational infrastructure that can support the entirety of the data science lifecycle, including…

Computers and Society · Computer Science 2016-04-12 Robert L. Grossman , Allison Heath , Mark Murphy , Maria Patterson , Walt Wells

FAIR Digital Object (FDO) is an emerging concept that is highlighted by European Open Science Cloud (EOSC) as a potential candidate for building a ecosystem of machine-actionable research outputs. In this work we systematically evaluate FDO…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-07 Stian Soiland-Reyes , Carole Goble , Paul Groth

The European Open Science Cloud (EOSC) aims to create a federated environment for hosting and processing research data to support science in all disciplines without geographical boundaries, such that data, software, methods and publications…

Instrumentation and Methods for Astrophysics · Physics 2020-07-14 Eva Sciacca , Fabio Vitello , Ugo Becciani , Cristobal Bordiu , Filomena Bufano , Antonio Calanducci , Alessandro Costa , Mario Raciti , Simone Riggi

Modern scientific data mainly consist of huge datasets gathered by a very large number of techniques and stored in very diversified and often incompatible data repositories. More in general, in the e-science environment, it is considered as…

Instrumentation and Methods for Astrophysics · Physics 2010-10-20 M. Brescia , G. Longo , F. Pasian

Leadership computing facilities around the world support cutting-edge scientific research across a broad spectrum of disciplines including understanding climate change, combating opioid addiction, or simulating the decay of a neutron. While…

High Energy Physics - Lattice · Physics 2020-04-16 Chia Cheng Chang , Christopher Körber , André Walker-Loud
‹ Prev 1 2 3 10 Next ›