English
Related papers

Related papers: Efficient Joinable Table Discovery in Data Lakes: …

200 papers

As a pivotal task in data lake management, joinable table discovery has attracted widespread interest. While existing language model-based methods achieve remarkable performance by combining offline column representation learning with…

Computation and Language · Computer Science 2026-01-06 Shiyuan Liu , Jianwei Wang , Xuemin Lin , Lu Qin , Wenjie Zhang , Ying Zhang

Table integration aims to create a comprehensive table by consolidating tuples containing relevant information. In this work, we investigate the challenge of integrating multiple tables from a data lake, focusing on three core tasks: 1)…

Databases · Computer Science 2025-04-15 Daomin Ji , Hui Luo , Zhifeng Bao , Shane Culpepper

Unionable table search techniques input a query table from a user and search for data lake tables that can contribute additional rows to the query table. The definition of unionability is generally based on similarity measures which may…

Databases · Computer Science 2025-09-03 Aamod Khatiwada , Roee Shraga , Renée J. Miller

Querying and exploring massive collections of data sources, such as data lakes, has been an essential research topic in the database community. Although many efforts have been paid in the field of data discovery and data integration in data…

Databases · Computer Science 2025-04-04 Jin Wang , Yanlin Feng , Chen Shen , Sajjadur Rahman , Eser Kandogan

Within enterprises, there is a growing need to intelligently navigate data lakes, specifically focusing on data discovery. Of particular importance to enterprises is the ability to find related tables in data repositories. These tables can…

Data from different sources rarely conform to a single formatting even if they describe the same set of entities, and this raises concerns when data from multiple sources must be joined or cross-referenced. Such a formatting mismatch is…

Databases · Computer Science 2022-03-08 Arash Dargahi Nobari , Davood Rafiei

We present ModelTables, a benchmark of tables in Model Lakes that captures the structured semantics of performance and configuration tables often overlooked by text only retrieval. The corpus is built from Hugging Face model cards, GitHub…

Databases · Computer Science 2025-12-19 Zhengyuan Dong , Victor Zhong , Renée J. Miller

Co-clustering simultaneously clusters rows and columns, revealing more fine-grained groups. However, existing co-clustering methods suffer from poor scalability and cannot handle large-scale data. This paper presents a novel and scalable…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-20 Zihan Wu , Zhaoke Huang , Hong Yan

Data lakes are massive repositories of raw and heterogeneous data, designed to meet the requirements of modern data storage. Nonetheless, this same philosophy increases the complexity of performing discovery tasks to find relevant data for…

Databases · Computer Science 2026-01-23 Marc Maynou , Sergi Nadal , Raquel Panadero , Javier Flores , Oscar Romero , Anna Queralt

Tables on the Web contain a vast amount of knowledge in a structured form. To tap into this valuable resource, we address the problem of table retrieval: answering an information need with a ranked list of tables. We investigate this…

Information Retrieval · Computer Science 2021-05-14 Shuo Zhang , Krisztian Balog

Organizations are collecting increasingly large amounts of data for data driven decision making. These data are often dumped into a centralized repository, e.g., a data lake, consisting of thousands of structured and unstructured datasets.…

Artificial Intelligence · Computer Science 2023-07-18 Mohamed Y. Eltabakh , Mayuresh Kunjir , Ahmed Elmagarmid , Mohammad Shahmeer Ahmad

The task of joining two tables is fundamental for querying databases. In this paper, we focus on the equi-join problem, where a pair of records from the two joined tables are part of the join results if equality holds between their values…

Databases · Computer Science 2025-03-14 Ahmed Metwally

Data discovery - retrieving relevant tables from a data lake in response to user queries - is a fundamental building block for downstream analytics. In practice, data discovery must support different query modalities, including natural…

Data discovery in data lakes with ever increasing datasets has long been recognized as a big challenge in the realm of data management, especially for semantic search of and hierarchical global catalog generation of tables. While large…

Databases · Computer Science 2025-02-24 Qi An , Chihua Ying , Yuqing Zhu , Yihao Xu , Manwei Zhang , Jianmin Wang

Contemporary approaches to data management are increasingly relying on unified analytics and AI platforms to foster collaboration, interoperability, seamless access to reliable data, and high performance. Data Lakes featuring open standard…

Discovering valuable insights from data through meaningful associations is a crucial task. However, it becomes challenging when trying to identify representative patterns in quantitative databases, especially with large datasets, as…

Databases · Computer Science 2024-10-31 Lamine Diop , Marc Plantevit

As an essential operation in data cleaning, the similarity join has attracted considerable attention from the database community. In this paper, we study string similarity joins with edit-distance constraints, which find similar string…

Databases · Computer Science 2011-12-01 Guoliang Li , Dong Deng , Jiannan Wang , Jianhua Feng

Most, if not all, modern deep learning systems restrict themselves to a single dataset for neural network training and inference. In this article, we are interested in systematic ways to join datasets that are made of similar purposes.…

Machine Learning · Computer Science 2021-06-18 Jake Zhao , Mingfeng Ou , Linji Xue , Yunkai Cui , Sai Wu , Gang Chen

Accurate and efficient entity resolution (ER) is a significant challenge in many data mining and analysis projects requiring integrating and processing massive data collections. It is becoming increasingly important in real-world…

Databases · Computer Science 2021-11-09 Samudra Herath , Matthew Roughan , Gary Glonek

Entity alignment has always had significant uses within a multitude of diverse scientific fields. In particular, the concept of matching entities across networks has grown in significance in the world of social science as communicative…

Social and Information Networks · Computer Science 2020-04-21 James Flamino , Christopher Abriola , Ben Zimmerman , Zhongheng Li , Joel Douglas