English
Related papers

Related papers: Measuring and Predicting the Quality of a Join for…

200 papers

This work is motivated by two key facts. First, it is highly desirable to be able to learn and perform knowledge discovery and analytics (LKD) tasks without the need to access raw-data tables. This may be due to organizations finding it…

Databases · Computer Science 2022-06-22 Ali Mohammadi Shanghooshabad , Peter Triantafillou

Similarity join--a widely used operation in data science--finds all pairs of items that have distance smaller than a threshold. Prior work has explored distributed computation methods to scale similarity join to large data volumes but these…

Databases · Computer Science 2025-10-13 Yanqi Chen , Xiao Yan , Alexandra Meliou , Eric Lo

Pattern set mining, which is the task of finding a good set of patterns instead of all patterns, is a fundamental problem in data mining. Many different definitions of what constitutes a good set have been proposed in recent years. In this…

Databases · Computer Science 2025-07-14 Maiju Karjalainen , Pauli Miettinen

Discovering valuable insights from data through meaningful associations is a crucial task. However, it becomes challenging when trying to identify representative patterns in quantitative databases, especially with large datasets, as…

Databases · Computer Science 2024-10-31 Lamine Diop , Marc Plantevit

Statistical-Relational Model Discovery aims to find statistically relevant patterns in relational data. For example, a relational dependency pattern may stipulate that a user's gender is associated with the gender of their friends. As with…

Machine Learning · Computer Science 2021-10-20 Richard Mar , Oliver Schulte

A core operation in data discovery is to find joinable tables for a given table. Real-world tables include both unary and n-ary join keys. However, existing table discovery systems are optimized for unary joins and are ineffective and slow…

Databases · Computer Science 2022-04-26 Mahdi Esmailoghli , Jorge-Arnulfo Quiané-Ruiz , Ziawasch Abedjan

Join ordering is the NP-hard problem of selecting the most efficient order in which to evaluate joins (conjunctive, binary operators) in a database query. Because query execution performance critically depends on this choice, join ordering…

Databases · Computer Science 2026-05-18 Tim Schwabe , Maribel Acosta

We study the problem of similarity self-join and similarity join size estimation in a streaming setting where the goal is to estimate, in one scan of the input and with sublinear space in the input size, the number of record pairs that have…

Databases · Computer Science 2020-05-11 Davood Rafiei , Fan Deng

Relational query optimisers rely on cost models to choose between different query execution plans. Selectivity estimates are known to be a crucial input to the cost model. In practice, standard selectivity estimation procedures are prone to…

Databases · Computer Science 2020-09-22 Max Halford , Philippe Saint-Pierre , Franck Morvan

With the proliferation of increasingly complicated Deep Learning architectures, data synthesis is a highly promising technique to address the demand of data-hungry models. However, reliably assessing the quality of a 'synthesiser' model's…

Machine Learning · Computer Science 2025-05-05 Julia A. Meister , Khuong An Nguyen

This work considers clustering nodes of a largely incomplete graph. Under the problem setting, only a small amount of queries about the edges can be made, but the entire graph is not observable. This problem finds applications in…

Machine Learning · Computer Science 2021-10-04 Shahana Ibrahim , Xiao Fu

Many algorithms have been proposed for detecting disjoint communities (relatively densely connected subgraphs) in networks. One popular technique is to optimize modularity, a measure of the quality of a partition in terms of the number of…

Physics and Society · Physics 2012-02-03 Bowen Yan , Steve Gregory

In this work, we study the problem of co-optimize communication, pre-computing, and computation cost in one-round multi-way join evaluation. We propose a multi-way join approach ADJ (Adaptive Distributed Join) for complex join which finds…

Databases · Computer Science 2021-03-01 Hao Zhang , Miao Qiao , Jeffrey Xu Yu , Hong Cheng

Finding joinable tables in data lakes is key procedure in many applications such as data integration, data augmentation, data analysis, and data market. Traditional approaches that find equi-joinable tables are unable to deal with…

Information Retrieval · Computer Science 2023-08-31 Yuyang Dong , Kunihiro Takeoka , Chuan Xiao , Masafumi Oyamada

An overarching objective in contemporary statistical network analysis is extracting salient information from datasets consisting of multiple networks. To date, considerable attention has been devoted to node and network clustering, while…

Methodology · Statistics 2025-08-19 Wenlong Jiang , Chris McKennan , Jesús Arroyo , Joshua Cape

With time, machine learning models have increased in their scope, functionality and size. Consequently, the increased functionality and size of such models requires high-end hardware to both train and provide inference after the fact. This…

Machine Learning · Computer Science 2021-09-07 Arhum Ishtiaq , Sara Mahmood , Maheen Anees , Neha Mumtaz

Selectivity estimation aims at estimating the number of database objects that satisfy a selection criterion. Answering this problem accurately and efficiently is essential to many applications, such as density estimation, outlier detection,…

Databases · Computer Science 2021-05-28 Yaoshu Wang , Chuan Xiao , Jianbin Qin , Rui Mao , Onizuka Makoto , Wei Wang , Rui Zhang , Yoshiharu Ishikawa

With the increasing application of Linked Open Data, assessing the quality of datasets by computing quality metrics becomes an issue of crucial importance. For large and evolving datasets, an exact, deterministic computation of the quality…

Databases · Computer Science 2015-03-18 Jeremy Debattista , Santiago Londoño , Christoph Lange , Sören Auer

Data intensive research requires the support of appropriate datasets. However, it is often time-consuming to discover usable datasets matching a specific research topic. We formulate the dataset discovery problem on an attributed…

Information Retrieval · Computer Science 2021-06-08 Basmah Altaf , Shichao Pei , Xiangliang Zhang

As the cost of training large language models continues to increase and high-quality training data become increasingly scarce, selecting high-value samples or synthesizing effective training data under limited data budgets has emerged as a…

Computation and Language · Computer Science 2026-01-19 Bo Yang , Yunkui Chen , Lanfei Feng , Yu Zhang , Shijian Li