English
Related papers

Related papers: Using the Open Science Data Federation for data di…

200 papers

The Observatory Science Operations (OSO) subsystem of the SKAO consists of a range of complex tools which will be used to propose, design, schedule and execute observations. Bridging the gap between the science and telescope domains is the…

Instrumentation and Methods for Astrophysics · Physics 2024-07-25 Thaddeus Kenny , Stewart J. Williams , Viivi Pursiainen , Elizabeth S. Bartlett , Brendan McCollam , Andrew D. Biggs , Sean Ellis , Rupert Lung

This paper proposes a novel framework for fusing multi-temporal, multispectral satellite images and OpenStreetMap (OSM) data for the classification of local climate zones (LCZs). Feature stacking is the most commonly-used method of data…

Machine Learning · Computer Science 2019-10-23 Guichen Zhang , Pedram Ghamisi , Xiao Xiang Zhu

A joint project between the Canadian Astronomy Data Center of the National Research Council Canada, and the italian Istituto Nazionale di Astrofisica-Osservatorio Astronomico di Trieste (INAF-OATs), partially funded by the EGI-Engage H2020…

Instrumentation and Methods for Astrophysics · Physics 2017-12-08 Sara Bertocco , Brjan Major , Patrick Dowler , Séverin Gaudet , Marco Molinaro , Giuliano Taffoni

Shared high-performance computing (HPC) platforms, such as those provided by XSEDE and Compute Canada, enable researchers to carry out large-scale computational experiments at a fraction of the cost of the cloud. Most systems require the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-17 Pierre Rioux , Gregory Kiar , Alexandre Hutton , Alan C. Evans , Shawn T. Brown

Spatio-Temporal (ST) data science, which includes sensing, managing, and mining large-scale data across space and time, is fundamental to understanding complex systems in domains such as urban computing, climate science, and intelligent…

Databases · Computer Science 2025-03-19 Yuxuan Liang , Haomin Wen , Yutong Xia , Ming Jin , Bin Yang , Flora Salim , Qingsong Wen , Shirui Pan , Gao Cong

Objective: To (1) demonstrate the implementation of a data science platform built on open-source technology within a large, academic healthcare system and (2) describe two computational healthcare applications built on such a platform.…

Big Data is the most popular emerging trends that becomes a blessing for human kinds and it is the necessity of day-to-day life. For example, Facebook. Every person involves with producing data either directly or indirectly. Thus, Big Data…

Databases · Computer Science 2019-03-18 Ripon Patgiri , Sabuzima Nayak , Samir Kumar Borgohain

The Harvard College Observatory was the preeminent astronomical data center of the early 20th century: it gathered and archived an enormous collection of glass photographic plates that became, and remains, the largest in the world. For…

Instrumentation and Methods for Astrophysics · Physics 2025-01-23 Peter K. G. Williams

While high-dimensional search-by-similarity techniques reached their maturity and in overall provide good performance, most of them are unable to cope with very large multimedia collections. The 'big data' challenge however has to be…

Information Retrieval · Computer Science 2015-02-02 Denis Shestakov , Diana Moise

The FAIR (Findable, Accessible, Interoperable, and Reusable) data principles [1] promote the interoperability of scientific data by encouraging the use of persistent identifiers, standardized vocabularies, and formal metadata structures.…

The Resource Description Framework (RDF) is continuing to grow outside the bounds of its initial function as a metadata framework and into the domain of general-purpose data modeling. This expansion has been facilitated by the continued…

Artificial Intelligence · Computer Science 2008-07-25 Marko A. Rodriguez

Data collected by large-scale instruments, observatories, and sensor networks are key enablers of scientific discoveries in many disciplines. However, ensuring that these data can be accessed, integrated, and analyzed in a democratized and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-14 Yubo Qin , Ivan Rodero , Manish Parashar

Optimal sensor placement (OSP) is critical for efficient, accurate monitoring, control, and inference in complex physical systems. We propose a machine-learning-based feature attribution (FA) framework to identify OSP for target…

Computational Engineering, Finance, and Science · Computer Science 2026-04-07 Sze Chai Leung , Di Zhou , H. Jane Bae

A scientific instrument comprised of a global network of millions of independent, connected, remote devices presents unique data acquisition challenges. We describe the software design of a mobile application which collects data from…

Instrumentation and Methods for Astrophysics · Physics 2021-08-11 Jeff Swaney , Chase Shimmin , Daniel Whiteson

Load balancing is critical for distributed storage to meet strict service-level objectives (SLOs). It has been shown that a fast cache can guarantee load balancing for a clustered storage system. However, when the system scales out to…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-18 Zaoxing Liu , Zhihao Bai , Zhenming Liu , Xiaozhou Li , Changhoon Kim , Vladimir Braverman , Xin Jin , Ion Stoica

The situation of data sharing in astronomy is positioned in the current general context of a political push towards, and rapid development of, scientific data sharing. Data is already one of the major infrastructures of astronomy, thanks to…

Instrumentation and Methods for Astrophysics · Physics 2018-08-08 Francoise Genova

In edge computing environments, app vendors can cache their data to be shared with their users in many geographically distributed edge servers. However, the cached data is particularly vulnerable to several intentional attacks or…

Cryptography and Security · Computer Science 2023-08-11 Mohammad Ali , Ximeng Liu

Performing data-intensive analytics is an essential part of modern Earth science. As such, research in atmospheric physics and meteorology frequently requires the processing of very large observational and/or modeled datasets. Typically,…

Databases · Computer Science 2021-09-17 Justus Henneberg , Felix Schuhknecht , Philipp Reutter , Nils Brast , Peter Spichtinger

Recently, we have been witnessing huge advancements in the scale of data we routinely generate and collect in pretty much everything we do, as well as our ability to exploit modern technologies to process, analyze and understand this data.…

Databases · Computer Science 2017-09-25 Radwa Elshawi , Sherif Sakr

Astronomical data are gathered through a very large number of heterogeneous techniques and stored in very diversified and often incompatible data repositories. Moreover in the e-science environment, it is needed to integrate services across…