English
Related papers

Related papers: Modeling Data Lake Metadata with a Data Vault

200 papers

AI-augmented data workflows introduce complex governance challenges, as both human and model-driven processes generate, transform, and consume data artifacts. These workflows blend heterogeneous tools, dynamic execution patterns, and opaque…

Databases · Computer Science 2025-08-12 Jinjin Zhao , Sanjay Krishnan

The large size and fast growth of data repositories, such as data lakes, has spurred the need for data discovery to help analysts find related data. The problem has become challenging as (i) a user typically does not know what datasets…

Databases · Computer Science 2023-01-16 Tianji Cong , Fatemeh Nargesian , H. V. Jagadish

Big Data technology is described. Big data is a popular term used to describe the exponential growth and availability of data, both structured and unstructured. There is constructed dataspace architecture. Dataspace has focused solely - and…

Databases · Computer Science 2019-05-07 Nataliya Shakhovska , Yurii Bolubash

Traditional data in Digital Humanities projects bear various formats (structured, semi-structured, textual) and need substantial transformations (encoding and tagging, stemming, lemmatization, etc.) to be managed and analyzed. To fully…

Databases · Computer Science 2020-12-07 Jérôme Darmont , Cécile Favre , Sabine Loudcher , Camille Noûs

Big Data is defined as high volume of variety of data with an exponential data growth rate. Data are amalgamated to generate revenue, which results a large data silo. Data are the oils of modern IT industries. Therefore, the data are…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-15 Ripon Patgiri , Sabuzima Nayak

Metadata are like the steam engine of the 21st century, driving businesses and offer multiple enhancements. Nevertheless, many companies are unaware that these data can be used efficiently to improve their own operation. This is where the…

Information Retrieval · Computer Science 2021-08-17 Peter Hillmann , Erik Heiland , Andreas Karcher

Data lakes are widely used to store extensive and heterogeneous datasets for advanced analytics. However, the unstructured nature of data in these repositories introduces complexities in exploiting them and extracting meaningful insights.…

Databases · Computer Science 2024-08-27 Anes Bendimerad , Romain Mathonat , Youcef Remil , Mehdi Kaytoue

Machine learning (ML) practitioners and organizations are building model zoos of pre-trained models, containing metadata describing properties of the ML models and datasets that are useful for reporting, auditing, reproducibility, and…

Machine Learning · Computer Science 2022-07-20 Ziyu Li , Rihan Hai , Alessandro Bozzon , Asterios Katsifodimos

The exponential growth of artificial intelligence (AI) and machine learning (ML) applications has necessitated the development of efficient storage solutions for vector and tensor data. This paper presents a novel approach for tensor…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-14 Zhiwei Bao , Liu Liao-Liao , Zhiyu Wu , Yifan Zhou , Dan Fan , Michal Aibin , Yvonne Coady , Andrew Brownsword

This vision paper introduces a pioneering data lake architecture designed to meet Life \& Earth sciences' burgeoning data management needs. As the data landscape evolves, the imperative to navigate and maximize scientific opportunities has…

The personalized health care service utilizes the relational patient data and big data analytics to tailor the medication recommendations. However, most of the health care data are in unstructured form and it consumes a lot of time and…

Computers and Society · Computer Science 2018-02-13 Sarathkumar Rangarajan , Huai Liu , Hua Wang , Chuan-Long Wang

Data management can be a complex challenge in fields such as bioinformatics and health sciences, which continuously generate extensive heterogeneous datasets. In the context of collaborative global health initiatives, secure storage and…

Software Engineering · Computer Science 2026-05-20 Danilo Silva , Monika Moir , Cheryl Baxter , Tulio de Oliveira , Joicymara Xavier , Marcel Dunaiski

Organizations are collecting increasingly large amounts of data for data driven decision making. These data are often dumped into a centralized repository, e.g., a data lake, consisting of thousands of structured and unstructured datasets.…

Artificial Intelligence · Computer Science 2023-07-18 Mohamed Y. Eltabakh , Mayuresh Kunjir , Ahmed Elmagarmid , Mohammad Shahmeer Ahmad

As XML becomes ubiquitous and XML storage and processing becomes more efficient, the range of use cases for these technologies widens daily. One promising area is the integration of XML and data warehouses, where an XML-native database…

Databases · Computer Science 2009-12-08 Serge Boucher , Boris Verhaegen , Esteban Zimányi

Data warehousing and OLAP applications must nowadays handle complex data that are not only numerical or symbolic. The XML language is well-suited to logically and physically represent complex data. However, its usage induces new theoretical…

To satisfy the need for analytical data in the development of digital services, many organizations use data warehouse, and, more recently, data lake architectures. These architectures have traditionally been accompanied by centralized…

Software Engineering · Computer Science 2022-04-22 Kathrine Vestues , Geir Kjetil Hanssen , Marius Mikalsen , Thor Aleksander Buan , Kieran Conboy

Recent work on database application development platforms has sought to include a declarative formulation of a conceptual data model in the application code, using annotations or attributes. Some recent work has used metadata to include the…

Databases · Computer Science 2023-08-15 Malcolm Crowe , Fritz Laux

In this paper, the authors identify key entities and relationships in the operational management of metadata catalogs that describe digital collections, and they draft a data model to support the administration of metadata maintenance for…

Digital Libraries · Computer Science 2007-05-23 Martin Kurth , Jim LeBlanc

The ability to collect and analyze large amounts of data is a growing problem within the scientific community. The growing gap between data and users calls for innovative tools that address the challenges faced by big data volume, velocity…

Databases · Computer Science 2016-08-01 Vijay Gadepally , Jeremy Kepner

Big data analysis has become an active area of study with the growth of machine learning techniques. To properly analyze data, it is important to maintain high-quality data. Thus, research on data cleaning is also important. It is difficult…

Databases · Computer Science 2019-10-25 Toshiyuki Shimizu , Hiroki Omori , Masatoshi Yoshikawa