English
Related papers

Related papers: FactorJoin: A New Cardinality Estimation Framework…

200 papers

This work presents new cardinality estimation methods for data sets recorded by HyperLogLog sketches. A simple derivation of the original estimator was found, that also gives insight how to correct its deficiencies. The result is an…

Data Structures and Algorithms · Computer Science 2017-06-23 Otmar Ertl

Exhaustive enumeration of all possible join orders is often avoided, and most optimizers leverage heuristics to prune the search space. The design and implementation of heuristics are well-understood when the cost model is roughly linear,…

Databases · Computer Science 2019-01-14 Sanjay Krishnan , Zongheng Yang , Ken Goldberg , Joseph Hellerstein , Ion Stoica

We present Factorbird, a prototype of a parameter server approach for factorizing large matrices with Stochastic Gradient Descent-based algorithms. We designed Factorbird to meet the following desiderata: (a) scalability to tall and wide…

Machine Learning · Computer Science 2014-11-04 Sebastian Schelter , Venu Satuluri , Reza Zadeh

In a large database system, upper-bounding the cardinality of a join query is a crucial task called $\textit{pessimistic cardinality estimation}$. Recently, Abo Khamis, Nakos, Olteanu, and Suciu unified related works into the following…

Databases · Computer Science 2025-10-07 Yu-Ting Lin , Hsin-Po Wang

Joinable Column Discovery is a critical challenge in automating enterprise data analysis. While existing approaches focus on syntactic overlap and semantic similarity, there remains limited understanding of which methods perform best for…

Relatively recently, the field of join processing has been swayed by the discovery of a new class of multi-way join algorithms. The new algorithms join multiple relations simultaneously rather than perform a series of pairwise joins. The…

Databases · Computer Science 2020-01-01 Alan Fekete , Brody Franks , Herbert Jordan , Bernhard Scholz

Factor score estimation in small sample sizes often encounters parameter bias and convergence failures when constructing hierarchical national/sub-national indices. This paper proposes a novel method for hierarchical factor analysis called…

Methodology · Statistics 2025-08-22 Zachary Esses Johnson

Federated Learning (FL) facilitates data privacy by enabling collaborative in-situ training across decentralized clients. Despite its inherent advantages, FL faces significant challenges of performance and convergence when dealing with data…

Machine Learning · Computer Science 2024-10-07 Sunny Gupta , Nikita Jangid , Amit Sethi

Various factorization-based methods have been proposed to leverage second-order, or higher-order cross features for boosting the performance of predictive models. They generally enumerate all the cross features under a predefined maximum…

Machine Learning · Computer Science 2020-06-25 Weiyu Cheng , Yanyan Shen , Linpeng Huang

In real-world federated learning scenarios, participants could have their own personalized labels which are incompatible with those from other clients, due to using different label permutations or tackling completely different tasks or…

Machine Learning · Computer Science 2022-02-02 Wonyong Jeong , Sung Ju Hwang

We propose a totally corrective boosting algorithm with explicit cardinality regularization. The resulting combinatorial optimization problems are not known to be efficiently solvable with existing classical methods, but emerging quantum…

Machine Learning · Computer Science 2015-04-09 Vasil S. Denchev , Nan Ding , Shin Matsushima , S. V. N. Vishwanathan , Hartmut Neven

Despite decades of research, cardinality estimation remains the optimizer's Achilles heel, with industrial-strength systems exhibiting a systemic tendency toward underestimation. At cloud scale, this is a severe production vulnerability: in…

Databases · Computer Science 2026-03-06 Mihail Stoian , Tiemo Bang , Hangdong Zhao , Jesús Camacho-Rodríguez , Yuanyuan Tian , Andreas Kipf

Selectivity estimation - the problem of estimating the result size of queries - is a fundamental problem in databases. Accurate estimation of query selectivity involving multiple correlated attributes is especially challenging. Poor…

Databases · Computer Science 2019-06-19 Shohedul Hasan , Saravanan Thirumuruganathan , Jees Augustine , Nick Koudas , Gautam Das

Landmarks have long played a pivotal role in automated planning, serving as crucial elements for improving the planning algorithms. The main limitation of classical landmark extraction methods is their sensitivity to specific planning…

Artificial Intelligence · Computer Science 2025-09-23 Cristian Pérez-Corral , Antonio Garrido , Laura Sebastia

Cardinality estimation is the problem of estimating the size of the output of a query, without actually evaluating the query. The cardinality estimator is a critical piece of a query optimizer, and is often the main culprit when the…

Databases · Computer Science 2025-02-11 Haozhe Zhang , Christoph Mayer , Mahmoud Abo Khamis , Dan Olteanu , Dan Suciu

The task of joining two tables is fundamental for querying databases. In this paper, we focus on the equi-join problem, where a pair of records from the two joined tables are part of the join results if equality holds between their values…

Databases · Computer Science 2025-03-14 Ahmed Metwally

We describe FactorBase, a new SQL-based framework that leverages a relational database management system to support multi-relational model discovery. A multi-relational statistical model provides an integrated analysis of the heterogeneous…

Databases · Computer Science 2015-08-12 Oliver Schulte , Zhensong Qian

Recent advances in quantum computing have led to progress in exploring quantum applications across diverse fields, including databases and data management. This work presents a quantum machine learning model that tackles the challenge of…

Databases · Computer Science 2026-01-08 Valter Uotila

We consider the problem of deciding the satisfiability of quantifier-free formulas in the theory of finite sets with cardinality constraints. Sets are a common high-level data structure used in programming; thus, such a theory is useful for…

Logic in Computer Science · Computer Science 2023-06-22 Kshitij Bansal , Clark Barrett , Andrew Reynolds , Cesare Tinelli

Sketches have shown high accuracy in multi-way join cardinality estimation, a critical problem in cost-based query optimization. Accurately estimating the cardinality of a join operation -- analogous to its computational cost -- allows the…

Databases · Computer Science 2025-06-18 Brian Tsan , Abylay Amanbayev , Asoke Datta , Florin Rusu