English
Related papers

Related papers: Towards Schema Inference for Data Lakes

200 papers

This document develops general concepts useful for extracting knowledge embedded in large graphs or datasets that have pair-wise relationships, such as cause-effect-type relations. Almost no underlying assumptions are made, other than that…

Machine Learning · Computer Science 2019-02-22 Linas Vepstas

Our work addresses the challenges of understanding tables. Existing methods often struggle with the unpredictable nature of table content, leading to a reliance on preprocessing and keyword matching. They also face limitations due to the…

Computation and Language · Computer Science 2025-08-26 Thi-Nhung Nguyen , Hoang Ngo , Dinh Phung , Thuy-Trang Vu , Dat Quoc Nguyen

Since data is often stored in different sources, it needs to be integrated to gather a global view that is required in order to create value and derive knowledge from it. A critical step in data integration is schema matching which aims to…

Databases · Computer Science 2022-03-10 Benjamin Hättasch , Michael Truong-Ngoc , Andreas Schmidt , Carsten Binnig

Analysis of data without labels is commonly subject to scrutiny by unsupervised machine learning techniques. Such techniques provide more meaningful representations, useful for better understanding of a problem at hand, than by looking only…

Artificial Intelligence · Computer Science 2010-07-05 Jan Feyereisl , Uwe Aickelin

Table retrieval is essential for accessing information stored in structured tabular formats; however, it remains less explored than text retrieval. The content of the table primarily consists of phrases and words, which include a large…

Information Retrieval · Computer Science 2025-04-10 Da Li , Keping Bi , Jiafeng Guo , Xueqi Cheng

Recently ontologies have been exploited in a wide range of research areas for data modeling and data management. They greatly assists in defining the semantic model of the underlying data combined with domain knowledge. In this paper, we…

Databases · Computer Science 2021-06-08 Jiantao Wu , Fabrizio Orlandi , Declan O'Sullivan , Soumyabrata Dev

In this paper, we observe that semi-structured tabulated text is ubiquitous; understanding them requires not only comprehending the meaning of text fragments, but also implicit relationships between them. We argue that such data can prove…

Computation and Language · Computer Science 2020-05-14 Vivek Gupta , Maitrey Mehta , Pegah Nokhiz , Vivek Srikumar

Traditional data lakes provide critical data infrastructure for analytical workloads by enabling time travel, running SQL queries, ingesting data with ACID transactions, and visualizing petabyte-scale datasets on cloud storage. They allow…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-15 Sasun Hambardzumyan , Abhinav Tuli , Levon Ghukasyan , Fariz Rahman , Hrant Topchyan , David Isayan , Mark McQuade , Mikayel Harutyunyan , Tatevik Hakobyan , Ivo Stranic , Davit Buniatyan

Large knowledge bases typically contain data adhering to various schemas with incomplete and/or noisy type information. This seriously complicates further integration and post-processing efforts, as type information is crucial in correctly…

Applications · Statistics 2019-02-19 Artem Lutov , Soheil Roshankish , Mourad Khayati , Philippe Cudré-Mauroux

Generating insightful and actionable information from databases is critical in data analysis. This paper introduces a novel approach using Large Language Models (LLMs) to automatically generate textual insights. Given a multi-table database…

Artificial Intelligence · Computer Science 2025-03-18 Alberto Sánchez Pérez , Alaa Boukhary , Paolo Papotti , Luis Castejón Lozano , Adam Elwood

We propose Cognitive Databases, an approach for transparently enabling Artificial Intelligence (AI) capabilities in relational databases. A novel aspect of our design is to first view the structured data source as meaningful unstructured…

Databases · Computer Science 2017-12-21 Rajesh Bordawekar , Bortik Bandyopadhyay , Oded Shmueli

Indexing the Web of Data offers many opportunities, in particular, to find and explore data sources. One major design decision when indexing the Web of Data is to find a suitable index model, i.e., how to index and summarize data. Various…

Databases · Computer Science 2020-06-15 Till Blume , Ansgar Scherp

Clustering provides a common means of identifying structure in complex data, and there is renewed interest in clustering as a tool for the analysis of large data sets in many fields. A natural question is how many clusters are appropriate…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Susanne Still , William Bialek

Document-level relation extraction (RE) aims to extract the relations between entities from the input document that usually containing many difficultly-predicted entity pairs whose relations can only be predicted through relational…

Computation and Language · Computer Science 2022-11-29 Liang Zhang , Jinsong Su , Yidong Chen , Zhongjian Miao , Zijun Min , Qingguo Hu , Xiaodong Shi

In this paper, I outline several conceptual and methodological issues related to modeling individual and group processes embedded in clustered/hierarchical data structures. We position multilevel modeling techniques within a broader set of…

Methodology · Statistics 2022-12-29 Amira Ibrahim El-Desokey

Scholarly data are largely fragmented across siloed databases with divergent metadata and missing linkages among them. We present the Science Data Lake, a locally-deployable infrastructure built on DuckDB and simple Parquet files that…

Digital Libraries · Computer Science 2026-03-04 Jonas Wilinski

Since long, corporations are looking for knowledge sources which can provide structured description of data and can focus on meaning and shared understanding. Structures which can facilitate open world assumptions and can be flexible enough…

Artificial Intelligence · Computer Science 2014-03-31 Iti Mathur , Nisheeth Joshi , Hemant Darbari , Ajai Kumar

Similarities between entities occur frequently in many real-world scenarios. For over a century, researchers in different fields have proposed a range of approaches to measure the similarity between entities. More recently, inspired by…

Artificial Intelligence · Computer Science 2023-03-21 Giovanni Amendola , Marco Manna , Aldo Ricioppo

Identifying meaningful concepts in large data sets can provide valuable insights into engineering design problems. Concept identification aims at identifying non-overlapping groups of design instances that are similar in a joint space of…

Machine Learning · Computer Science 2023-11-15 Felix Lanfermann , Sebastian Schmitt , Patricia Wollstadt

The ability to automatically identify whether an entity is referenced in a future context can have multiple applications including decision making, planning and trend forecasting. This paper focuses on detecting implicit future references…

Computation and Language · Computer Science 2025-02-24 Puneet Prashar , Krishna Mohan Shukla , Adam Jatowt