English
Related papers

Related papers: DatAasee -- A Metadata-Lake as Metadata Catalog fo…

200 papers

The rise of artificial intelligence and data science across industries underscores the pressing need for effective management and governance of machine learning (ML) models. Traditional approaches to ML models management often involve…

Machine Learning · Computer Science 2025-04-01 Moncef Garouani , Franck Ravat , Nathalie Valles-Parlangeau

Given a set of deep learning models, it can be hard to find models appropriate to a task, understand the models, and characterize how models are different one from another. Currently, practitioners rely on manually-written documentation to…

Databases · Computer Science 2025-02-24 Koyena Pal , David Bau , Renée J. Miller

This is a thought piece on data-intensive science requirements for databases and science centers. It argues that peta-scale datasets will be housed by science centers that provide substantial storage and processing for scientists who access…

Databases · Computer Science 2007-05-23 Jim Gray , David T. Liu , Maria Nieto-Santisteban , Alexander S. Szalay , David DeWitt , Gerd Heber

Data commons collate data with cloud computing infrastructure and commonly used software services, tools and applications to create biomedical resources for the large-scale management, analysis, harmonization, and sharing of biomedical…

Genomics · Quantitative Biology 2018-12-27 Robert L. Grossman

Advances in technology and computing hardware are enabling scientists from all areas of science to produce massive amounts of data using large-scale simulations or observational facilities. In this era of data deluge, effective coordination…

Databases · Computer Science 2015-03-31 Spyros Blanas , Surendra Byna

As the Lakehouse architecture becomes more widespread, ensuring the reproducibility of data workloads over data lakes emerges as a crucial concern for data engineers. However, achieving reproducibility remains challenging. The size of data…

Databases · Computer Science 2024-04-23 Jacopo Tagliabue , Ciro Greco

Data management can be a complex challenge in fields such as bioinformatics and health sciences, which continuously generate extensive heterogeneous datasets. In the context of collaborative global health initiatives, secure storage and…

Software Engineering · Computer Science 2026-05-20 Danilo Silva , Monika Moir , Cheryl Baxter , Tulio de Oliveira , Joicymara Xavier , Marcel Dunaiski

Data warehouse, data lake, data lakehouse, data mesh ... many new names for analytical data architectures are currently circulating in the scene. But are the various approaches really so different? This article attempts a structured…

Databases · Computer Science 2022-12-08 Torsten Priebe , Sebastian Neumaier , Stefan Markus

Metadata represents the information about data to be stored in Data Warehouses.It is a mandatory element of Data Warehouse to build an efficient Data Warehouse.Metadata helps in data integration,lineage,data quality and populating…

Databases · Computer Science 2013-06-10 M. Laxmaiah , A. Govardhan

Big Data technology is described. Big data is a popular term used to describe the exponential growth and availability of data, both structured and unstructured. There is constructed dataspace architecture. Dataspace has focused solely - and…

Databases · Computer Science 2019-05-07 Nataliya Shakhovska , Yurii Bolubash

A data lake is a repository of data with potential for future analysis. However, both discovering what data is in a data lake and exploring related data sets can take significant effort, as a data lake can contain an intimidating amount of…

Databases · Computer Science 2022-06-09 Nour Alhammad , Alex Bogatu , Norman W Paton

Since decades, the modelling of metadata has been core to the functioning of any academic library. Its importance has only enhanced with the increasing pervasiveness of Generative Artificial Intelligence (AI)-driven information activities…

Digital Libraries · Computer Science 2025-03-18 Mayukh Bagchi

In this paper we explore visually the structure of the collection of a digital research data archive in terms of metadata for deposited datasets. We look into the distribution of datasets over different scientific fields; the role of main…

Digital Libraries · Computer Science 2012-04-17 Andrea Scharnhorst , Olav ten Bosch , Peter Doorn

Scientists today collect, analyze, and generate TeraBytes and PetaBytes of data. These data are often shared and further processed and analyzed among collaborators. In order to facilitate sharing and data interpretations, data need to carry…

Instrumentation and Methods for Astrophysics · Physics 2010-05-18 Ewa Deelman , Bruce Berriman , Ann Chervenak , Oscar Corcho , Paul Groth , Luc Moreau

In spite of its tremendous value, metadata is generally sparse and incomplete, thereby hampering the effectiveness of digital information services. Many of the existing mechanisms for the automated creation of metadata rely primarily on…

Information Retrieval · Computer Science 2009-03-07 Marko A. Rodriguez , Johan Bollen , Herbert Van de Sompel

Distributed ledgers are a new type of database technology that allows open access to data stored across distributed, decentralised, publicly maintained infrastructures. Current implementations of the such ledgers expect competition between…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-21 Phani Chitti

Traditional data lakes provide critical data infrastructure for analytical workloads by enabling time travel, running SQL queries, ingesting data with ACID transactions, and visualizing petabyte-scale datasets on cloud storage. They allow…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-15 Sasun Hambardzumyan , Abhinav Tuli , Levon Ghukasyan , Fariz Rahman , Hrant Topchyan , David Isayan , Mark McQuade , Mikayel Harutyunyan , Tatevik Hakobyan , Ivo Stranic , Davit Buniatyan

Generating value from data requires the ability to find, access and make sense of datasets. There are many efforts underway to encourage data sharing and reuse, from scientific publishers asking authors to submit data alongside manuscripts…

This paper explores the characteristics of DataCite to determine its possibilities and potential as a new bibliometric data source to analyze the scholarly production of open data. Open science and the increasing data sharing requirements…

Digital Libraries · Computer Science 2017-10-13 Nicolas Robinson-Garcia , Philippe Mongeon , Wei Jeng , Rodrigo Costas

The Data Web refers to the vast and rapidly increasing quantity of scientific, corporate, government and crowd-sourced data published in the form of Linked Open Data, which encourages the uniform representation of heterogeneous data items…