English
Related papers

Related papers: LakeBench: Benchmarks for Data Discovery over Data…

200 papers

Finding joinable tables in data lakes is key procedure in many applications such as data integration, data augmentation, data analysis, and data market. Traditional approaches that find equi-joinable tables are unable to deal with…

Information Retrieval · Computer Science 2023-08-31 Yuyang Dong , Kunihiro Takeoka , Chuan Xiao , Masafumi Oyamada

Machine-learning from a disparate set of tables, a data lake, requires assembling features by merging and aggregating tables. Data discovery can extend autoML to data tables by automating these steps. We present an in-depth analysis of such…

Databases · Computer Science 2025-05-20 Riccardo Cappuzzo , Aimee Coelho , Felix Lefebvre , Paolo Papotti , Gael Varoquaux

Table integration aims to create a comprehensive table by consolidating tuples containing relevant information. In this work, we investigate the challenge of integrating multiple tables from a data lake, focusing on three core tasks: 1)…

Databases · Computer Science 2025-04-15 Daomin Ji , Hui Luo , Zhifeng Bao , Shane Culpepper

Progress toward the United Nations Sustainable Development Goals (SDGs) has been hindered by a lack of data on key environmental and socioeconomic indicators, which historically have come from ground surveys with sparse temporal and spatial…

Open government and open (government) data are seen as tools to create new opportunities, eliminate or at least reduce information inequalities and improve public services. More than a decade of these efforts has provided much experience,…

Data-driven approaches, most prominently deep learning, have become powerful tools for prediction in many domains. A natural question to ask is whether data-driven methods could also be used to predict global weather patterns days in…

Atmospheric and Oceanic Physics · Physics 2020-12-30 Stephan Rasp , Peter D. Dueben , Sebastian Scher , Jonathan A. Weyn , Soukayna Mouatadid , Nils Thuerey

In settings where only a budgeted amount of labeled data can be afforded, active learning seeks to devise query strategies for selecting the most informative data points to be labeled, aiming to enhance learning algorithms' efficiency and…

Machine Learning · Computer Science 2024-06-26 Valentin Margraf , Marcel Wever , Sandra Gilhuber , Gabriel Marques Tavares , Thomas Seidl , Eyke Hüllermeier

Graph data management is instrumental for several use cases such as recommendation, root cause analysis, financial fraud detection, and enterprise knowledge representation. Efficiently supporting these use cases yields a number of unique…

A data product is created with the intention of solving a specific problem, addressing a specific business usecase or meeting a particular need, going beyond just serving data as a raw asset. Data products enable end users to gain greater…

Databases · Computer Science 2025-12-19 Faisal Chowdhury , Sola Shirai , Sarthak Dash , Nandana Mihindukulasooriya , Horst Samulowitz

Large language models (LLMs) are increasingly exposed to data contamination, i.e., performance gains driven by prior exposure of test datasets rather than generalization. However, in the context of tabular data, this problem is largely…

Computation and Language · Computer Science 2026-03-31 Matteo Silvestri , Fabiano Veglianti , Flavio Giorgi , Fabrizio Silvestri , Gabriele Tolomei

Data discovery in data lakes with ever increasing datasets has long been recognized as a big challenge in the realm of data management, especially for semantic search of and hierarchical global catalog generation of tables. While large…

Databases · Computer Science 2025-02-24 Qi An , Chihua Ying , Yuqing Zhu , Yihao Xu , Manwei Zhang , Jianmin Wang

We introduce DRBench, a benchmark for evaluating AI agents on complex, open-ended deep research tasks in enterprise settings. Unlike prior benchmarks that focus on simple questions or web-only queries, DRBench evaluates agents on multi-step…

Empirical and LLM-based research in model-driven engineering increasingly relies on datasets of software models, for instance, to train or evaluate machine learning techniques for modeling support. These datasets have a significant impact…

Software Engineering · Computer Science 2026-03-06 Philipp-Lorenz Glaser , Lola Burgueño , Dominik Bork

Benefiting from high-quality datasets and standardized evaluation metrics, machine learning (ML) has achieved sustained progress and widespread applications. However, while applying machine learning to relational databases (RDBs), the…

Machine Learning · Computer Science 2023-10-31 Zizhao Zhang , Yi Yang , Lutong Zou , He Wen , Tao Feng , Jiaxuan You

The selection, development, or comparison of machine learning methods in data mining can be a difficult task based on the target problem and goals of a particular study. Numerous publicly available real-world and simulated benchmark…

Machine Learning · Computer Science 2017-03-03 Randal S. Olson , William La Cava , Patryk Orzechowski , Ryan J. Urbanowicz , Jason H. Moore

Machine learning on graphs has made substantial progress across domains such as molecular property prediction and chip design. Yet benchmarking practices remain fragmented, often relying on narrow, task-specific datasets and inconsistent…

The data landscape is rich with structured data, often of high value to organizations, driving important applications in data analysis and machine learning. Recent progress in representation learning and generative models for such data has…

Information Retrieval · Computer Science 2025-05-20 Xingyu Ji , Parker Glenn , Aditya G. Parameswaran , Madelon Hulsebos

Accurate parsing of citations is necessary for machine-readable scholarly infrastructure. But, despite sustained interest in this problem, existing evaluation techniques are often not generalizable, based on synthetic data, or not publicly…

Digital Libraries · Computer Science 2026-03-27 Parth Sarin , Juan Pablo Alperin , Adam Buttrick , Dione Mentis

Real-world data analysis tasks often come with under-specified goals and unclean data. User interaction is necessary to understand and disambiguate a user's intent, and hence, essential to solving these complex tasks. Existing benchmarks…

Data lakes enable easy maintenance of heterogeneous data in its native form. While this flexibility can accelerate data ingestion, it shifts the complexity of data preparation and query processing to data discovery tasks. One such task is…

Databases · Computer Science 2025-11-05 Tim Otto