中文
相关论文

相关论文: Scientific Data Management in the Coming Decade

200 篇论文

The advent of experimental science facilities-instruments and observatories, such as the Large Hadron Collider, the Laser Interferometer Gravitational Wave Observatory, and the upcoming Large Synoptic Survey Telescope-has brought about…

分布式、并行与集群计算 · 计算机科学 2019-02-12 E. A. Huerta , Roland Haas , Shantenu Jha , Mark Neubauer , Daniel S. Katz

We live in a data-centric world where we are heading to generate close to 200 Zettabytes of data by the year 2025. Our data processing requirements have also increased as we push to build data processing frameworks that can process large…

分布式、并行与集群计算 · 计算机科学 2021-12-21 Corne Lukken , Animesh Trivedi

Data volumes from multiple sky surveys have grown from gigabytes into terabytes during the past decade, and will grow from terabytes into tens (or hundreds) of petabytes in the next decade. This exponential growth of new data both enables…

天体物理仪器与方法 · 物理学 2009-11-04 Kirk D. Borne

As part of the data-driven paradigm and open science movement, the data paper is becoming a popular way for researchers to publish their research data, based on academic norms that cross knowledge domains. Data journals have also been…

数字图书馆 · 计算机科学 2023-07-20 Chenyue Jiao , Kai Li , Zhichao Fang

Synthetic data are becoming a critical tool for building artificially intelligent systems. Simulators provide a way of generating data systematically and at scale. These data can then be used either exclusively, or in conjunction with real…

人工智能 · 计算机科学 2023-04-07 Daniel McDuff , Theodore Curran , Achuta Kadambi

We envisage future context-aware applications will dynamically adapt their behaviors to various context data from sources in wide-area networks, such as the Internet. Facing the changing context and the sheer number of context sources, a…

数据库 · 计算机科学 2020-03-10 Wenwei Xue , Hungkeng Pung , Wenlong Ng , Tao Gu

In this work, we reflect on the data-driven modeling paradigm that is gaining ground in AI-driven automation of patient care. We argue that the repurposing of existing real-world patient datasets for machine learning may not always…

The proliferation of sensor technologies and advancements in data collection methods have enabled the accumulation of very large amounts of data. Increasingly, these datasets are considered for scientific research. However, the design of…

分布式、并行与集群计算 · 计算机科学 2020-07-28 Fatemeh Rouzbeh , Ananth Grama , Paul Griffin , Mohammad Adibuzzaman

Presently, large enterprises rely on database systems to manage their data and information. These databases are useful for conducting daily business transactions. However, the tight competition in the marketplace has led to the concept of…

数据库 · 计算机科学 2012-12-11 Youssef Bassil

In this paper we define Clinical Data Intelligence as the analysis of data generated in the clinical routine with the goal of improving patient care. We define a science of a Clinical Data Intelligence as a data analysis that permits the…

We make a case for "planetary computing" -- infrastructure to handle the ingestion, transformation, analysis and publication of global data products for furthering environmental science and enabling better informed policy-making. We draw on…

One of the purposes of Big Data systems is to support analysis of data gathered from heterogeneous data sources. Since data warehouses have been used for several decades to achieve the same goal, they could be leveraged also to provide…

数据库 · 计算机科学 2018-09-13 Darja Solodovnikova , Laila Niedrite

This vision paper introduces a pioneering data lake architecture designed to meet Life \& Earth sciences' burgeoning data management needs. As the data landscape evolves, the imperative to navigate and maximize scientific opportunities has…

Upcoming and future astronomy research facilities will systematically generate terabyte-sized data sets moving astronomy into the Petascale data era. While such facilities will provide astronomers with unprecedented levels of accuracy and…

天体物理仪器与方法 · 物理学 2011-11-30 A. H. Hassan , C. J. Fluke , D. G. Barnes

Data-centric AI is at the center of a fundamental shift in software engineering where machine learning becomes the new software, powered by big data and computing infrastructure. Here software engineering needs to be re-thought where data…

机器学习 · 计算机科学 2022-12-27 Steven Euijong Whang , Yuji Roh , Hwanjun Song , Jae-Gil Lee

A common task in scientific computing is the derivation of data. This workflow extracts the most important information from large input data and stores it in smaller derived data objects. The derived data objects can then be used for…

分布式、并行与集群计算 · 计算机科学 2021-05-10 Tobias Wegner , Mario Lassnig , Peer Ueberholz , Christian Zeitnitz

Today's astronomical projects need computational systems capable to store and analyze large amounts of scientific data, to effectively share data with other research Institutes and to easily implement information services to present data…

天体物理学 · 物理学 2007-05-23 G. Calderone , L. Nicastro

Data-driven science is heralded as a new paradigm in materials science. In this field, data is the new resource, and knowledge is extracted from materials data sets that are too big or complex for traditional human reasoning - typically…

计算物理 · 物理学 2019-10-28 Lauri Himanen , Amber Geurts , Adam S. Foster , Patrick Rinke

In this paper we explore visually the structure of the collection of a digital research data archive in terms of metadata for deposited datasets. We look into the distribution of datasets over different scientific fields; the role of main…

数字图书馆 · 计算机科学 2012-04-17 Andrea Scharnhorst , Olav ten Bosch , Peter Doorn

Metadata management for distributed data sources is a long-standing but ever-growing problem. To counter this challenge in a research-data and library-oriented setting, this work constructs a data architecture, derived from the data-lake:…

数据库 · 计算机科学 2026-05-08 Christian Himpe